Sep 13 19:58:12.778106 ip-10-0-142-113 systemd[1]: Starting Kubernetes Kubelet... Sep 13 19:58:13.206453 ip-10-0-142-113 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 19:58:13.206453 ip-10-0-142-113 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 13 19:58:13.206453 ip-10-0-142-113 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 19:58:13.206453 ip-10-0-142-113 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 13 19:58:13.206453 ip-10-0-142-113 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 19:58:13.207167 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.206515 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 13 19:58:13.211237 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211213 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:58:13.211237 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211231 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:58:13.211237 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211235 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:58:13.211237 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211239 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:58:13.211237 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211242 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:58:13.211237 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211245 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211249 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211252 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211255 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211259 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211262 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211265 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211268 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211272 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211276 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211279 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211282 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211284 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211287 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211290 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211292 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211295 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211297 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211300 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211309 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:58:13.211466 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211312 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211314 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211317 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211319 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211322 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211325 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211327 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211330 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211332 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211335 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211337 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211340 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211342 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211345 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211349 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211352 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211355 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211357 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211360 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211362 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:58:13.211954 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211365 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211368 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211371 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211373 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211376 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211378 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211381 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211384 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211387 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211391 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211393 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211396 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211399 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211402 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211404 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211407 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211410 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211413 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211415 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211418 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:58:13.212456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211420 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211422 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211425 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211428 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211430 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211433 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211437 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211442 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211444 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211447 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211450 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211452 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211455 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211457 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211461 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211465 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211468 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211471 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211476 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:58:13.212976 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211479 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211482 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211484 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211487 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211490 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211492 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211495 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211499 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211502 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211505 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211507 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211510 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211513 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211515 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.211518 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.212997 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213004 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213008 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213011 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:58:13.213433 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213013 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213017 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213019 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213022 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213024 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213027 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213030 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213032 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213035 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213038 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213040 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213043 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213046 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213050 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213053 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213056 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213059 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213062 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213064 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:58:13.213996 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213067 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213070 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213072 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213075 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213077 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213080 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213083 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213087 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213090 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213094 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213097 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213100 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213103 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213105 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213108 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213111 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213114 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213117 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213119 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213122 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:58:13.214476 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213125 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213127 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213130 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213133 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213135 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213138 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213141 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213144 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213147 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213150 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213153 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213156 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213159 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213162 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213164 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213167 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213169 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213172 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213174 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:58:13.214981 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213177 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213180 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213184 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213186 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213190 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213193 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213196 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213199 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213202 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213204 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213207 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213210 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213213 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213215 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213218 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213221 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213225 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213227 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213230 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:58:13.215456 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213233 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213236 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213239 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213242 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213245 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213248 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213250 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213253 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213256 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213258 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213261 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213263 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213266 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213268 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213271 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213273 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213276 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213278 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213672 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213677 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213680 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:58:13.215948 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213683 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213685 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213688 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213691 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213694 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213696 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213699 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213702 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213705 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213707 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213710 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213714 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213716 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213719 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213722 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213725 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213728 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213731 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213734 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213736 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:58:13.216483 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213739 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213742 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213744 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213747 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213750 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213752 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213755 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213758 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213761 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213763 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213766 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213768 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213771 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213773 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213776 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213779 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213782 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213784 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213788 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213790 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:58:13.216995 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213797 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213799 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213802 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213804 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213820 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213823 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213826 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213828 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213831 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213834 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213837 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213840 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213843 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213845 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213848 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213850 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213853 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213855 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213858 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:58:13.217501 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213861 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213863 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213866 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213868 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213871 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213873 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213876 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213880 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213884 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213887 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213890 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213893 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213896 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213901 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213905 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213909 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213912 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213915 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213917 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:58:13.218019 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213920 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213923 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213926 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213930 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213934 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213936 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213939 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213943 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213946 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213949 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213951 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213954 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213957 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213959 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213962 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213965 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213968 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.213970 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214040 2569 flags.go:64] FLAG: --address="0.0.0.0" Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214072 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214094 2569 flags.go:64] FLAG: --anonymous-auth="true" Sep 13 19:58:13.218492 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214099 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214104 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214108 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214112 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214117 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214121 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214124 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214128 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214131 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214134 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214137 2569 flags.go:64] FLAG: --cgroup-root="" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214140 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214143 2569 flags.go:64] FLAG: --client-ca-file="" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214147 2569 flags.go:64] FLAG: --cloud-provider="external" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214150 2569 flags.go:64] FLAG: --cluster-dns="[]" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214154 2569 flags.go:64] FLAG: --cluster-domain="" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214157 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214160 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214164 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214167 2569 flags.go:64] FLAG: --container-log-max-files="5" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214171 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214174 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214177 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 13 19:58:13.219061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214180 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214183 2569 flags.go:64] FLAG: --contention-profiling="false" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214186 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214189 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214192 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214195 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214199 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214202 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214205 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214208 2569 flags.go:64] FLAG: --enable-load-reader="false" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214211 2569 flags.go:64] FLAG: --enable-server="true" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214214 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214218 2569 flags.go:64] FLAG: --event-burst="100" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214221 2569 flags.go:64] FLAG: --event-qps="50" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214225 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214228 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214231 2569 flags.go:64] FLAG: --eviction-hard="" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214235 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214238 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214241 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214244 2569 flags.go:64] FLAG: --eviction-soft="" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214248 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214250 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214254 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214257 2569 flags.go:64] FLAG: --experimental-mounter-path="" Sep 13 19:58:13.219626 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214260 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214264 2569 flags.go:64] FLAG: --fail-swap-on="true" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214266 2569 flags.go:64] FLAG: --feature-gates="" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214270 2569 flags.go:64] FLAG: --file-check-frequency="20s" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214273 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214276 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214279 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214283 2569 flags.go:64] FLAG: --healthz-port="10248" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214286 2569 flags.go:64] FLAG: --help="false" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214289 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214292 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214295 2569 flags.go:64] FLAG: --http-check-frequency="20s" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214298 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214302 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214305 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214308 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214311 2569 flags.go:64] FLAG: --image-service-endpoint="" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214313 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214316 2569 flags.go:64] FLAG: --kube-api-burst="100" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214319 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214322 2569 flags.go:64] FLAG: --kube-api-qps="50" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214325 2569 flags.go:64] FLAG: --kube-reserved="" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214328 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214331 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 13 19:58:13.220285 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214334 2569 flags.go:64] FLAG: --kubelet-cgroups="" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214337 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214340 2569 flags.go:64] FLAG: --lock-file="" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214343 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214346 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214349 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214354 2569 flags.go:64] FLAG: --log-json-split-stream="false" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214357 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214360 2569 flags.go:64] FLAG: --log-text-split-stream="false" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214363 2569 flags.go:64] FLAG: --logging-format="text" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214366 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214370 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214372 2569 flags.go:64] FLAG: --manifest-url="" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214375 2569 flags.go:64] FLAG: --manifest-url-header="" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214380 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214383 2569 flags.go:64] FLAG: --max-open-files="1000000" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214387 2569 flags.go:64] FLAG: --max-pods="110" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214390 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214393 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214396 2569 flags.go:64] FLAG: --memory-manager-policy="None" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214399 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214402 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214405 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214408 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214415 2569 flags.go:64] FLAG: --node-status-max-images="50" Sep 13 19:58:13.220905 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214418 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214421 2569 flags.go:64] FLAG: --oom-score-adj="-999" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214424 2569 flags.go:64] FLAG: --pod-cidr="" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214427 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214433 2569 flags.go:64] FLAG: --pod-manifest-path="" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214436 2569 flags.go:64] FLAG: --pod-max-pids="-1" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214439 2569 flags.go:64] FLAG: --pods-per-core="0" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214442 2569 flags.go:64] FLAG: --port="10250" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214445 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214448 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ebcaeec3925f778f" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214451 2569 flags.go:64] FLAG: --qos-reserved="" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214454 2569 flags.go:64] FLAG: --read-only-port="10255" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214457 2569 flags.go:64] FLAG: --register-node="true" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214460 2569 flags.go:64] FLAG: --register-with-taints="" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214463 2569 flags.go:64] FLAG: --registry-burst="10" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214467 2569 flags.go:64] FLAG: --registry-qps="5" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214470 2569 flags.go:64] FLAG: --reserved-cpus="" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214472 2569 flags.go:64] FLAG: --reserved-memory="" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214476 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214479 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214483 2569 flags.go:64] FLAG: --rotate-certificates="false" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214485 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214489 2569 flags.go:64] FLAG: --runonce="false" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214492 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214495 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 13 19:58:13.221522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214498 2569 flags.go:64] FLAG: --seccomp-default="false" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214500 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214503 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214506 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214509 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214512 2569 flags.go:64] FLAG: --storage-driver-password="root" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214515 2569 flags.go:64] FLAG: --storage-driver-secure="false" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214518 2569 flags.go:64] FLAG: --storage-driver-table="stats" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214521 2569 flags.go:64] FLAG: --storage-driver-user="root" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214524 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214527 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214532 2569 flags.go:64] FLAG: --system-cgroups="" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214536 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214541 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214544 2569 flags.go:64] FLAG: --tls-cert-file="" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214547 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214552 2569 flags.go:64] FLAG: --tls-min-version="" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214555 2569 flags.go:64] FLAG: --tls-private-key-file="" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214558 2569 flags.go:64] FLAG: --topology-manager-policy="none" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214561 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214564 2569 flags.go:64] FLAG: --topology-manager-scope="container" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214567 2569 flags.go:64] FLAG: --v="2" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214571 2569 flags.go:64] FLAG: --version="false" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214575 2569 flags.go:64] FLAG: --vmodule="" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214579 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 13 19:58:13.222218 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.214582 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214694 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214698 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214701 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214704 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214708 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214712 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214715 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214718 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214720 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214723 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214726 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214729 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214732 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214735 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214737 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214740 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214743 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214747 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:58:13.222883 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214751 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214754 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214756 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214759 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214762 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214764 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214767 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214769 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214772 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214775 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214777 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214780 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214783 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214786 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214788 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214791 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214794 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214796 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214799 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214802 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:58:13.223351 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214804 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214820 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214823 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214825 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214828 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214831 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214848 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214851 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214855 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214858 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214860 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214865 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214869 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214871 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214874 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214877 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214880 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214883 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214886 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214889 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:58:13.223870 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214892 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214894 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214897 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214899 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214902 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214906 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214910 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214914 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214917 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214920 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214922 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214925 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214928 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214931 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214933 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214936 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214939 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214941 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214944 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214947 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:58:13.224374 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214949 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214952 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214956 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214960 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214964 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214967 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214969 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214972 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214974 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214977 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214980 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214983 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214986 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214989 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214991 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214994 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214997 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.214999 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.215002 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:58:13.224906 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.215005 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.215008 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.215672 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.223352 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.223368 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.224297 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.224304 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224366 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224371 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224374 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224377 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224381 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224386 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224390 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:58:13.225380 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224393 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224396 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224399 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224402 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224405 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224407 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224410 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224413 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224415 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224418 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224421 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224423 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224427 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224431 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224434 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224437 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224440 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224444 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224446 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224449 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:58:13.225735 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224451 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224454 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224457 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224460 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224462 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224465 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224467 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224470 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224473 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224475 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224478 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224481 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224483 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224486 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224489 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224491 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224494 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224497 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224500 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224502 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:58:13.226276 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224505 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224507 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224510 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224512 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224515 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224518 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224520 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224523 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224526 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224529 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224532 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224535 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224537 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224540 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224543 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224546 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224550 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224554 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224557 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:58:13.226767 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224560 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224563 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224565 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224568 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224571 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224573 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224576 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224578 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224581 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224583 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224586 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224588 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224591 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224593 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224596 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224598 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224601 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224603 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224606 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224609 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:58:13.227294 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224618 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224621 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224624 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224627 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224630 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224633 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224636 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224639 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224641 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224644 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224646 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224649 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224651 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.224657 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224774 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:58:13.227914 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224778 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224781 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224785 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224790 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224793 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224796 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224799 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224801 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224804 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224820 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224825 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224828 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224830 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224833 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224836 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224838 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224841 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224844 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224846 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224849 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:58:13.228331 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224851 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224854 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224858 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224861 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224864 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224866 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224869 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224872 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224874 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224877 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224879 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224882 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224885 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224887 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224890 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224892 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224895 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224897 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224900 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224902 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:58:13.228911 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224905 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224908 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224911 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224913 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224918 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224921 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224924 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224927 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224930 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224933 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224937 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224939 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224942 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224944 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224947 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224952 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224956 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224959 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224961 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:58:13.229412 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224964 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224967 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224970 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224973 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224975 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224978 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224981 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224983 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224986 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224989 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224991 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224994 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224997 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.224999 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225002 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225004 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225007 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225009 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225012 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225014 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:58:13.229971 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225017 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225020 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225022 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225025 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225028 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225030 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225032 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225035 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225038 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225041 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225043 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225046 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225049 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225051 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225054 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225057 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225060 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225062 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:58:13.230459 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:13.225065 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:58:13.230982 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.225070 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 19:58:13.230982 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.225182 2569 server.go:962] "Client rotation is on, will bootstrap in background" Sep 13 19:58:13.230982 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.227545 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 13 19:58:13.230982 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.228719 2569 server.go:1019] "Starting client certificate rotation" Sep 13 19:58:13.230982 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.228844 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 13 19:58:13.230982 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.229597 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 13 19:58:13.231786 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.231768 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 13 19:58:13.234137 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.232946 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 13 19:58:13.248705 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.248682 2569 log.go:25] "Validated CRI v1 runtime API" Sep 13 19:58:13.251901 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.251881 2569 log.go:25] "Validated CRI v1 image API" Sep 13 19:58:13.252708 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.252692 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 13 19:58:13.255881 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.255861 2569 fs.go:135] Filesystem UUIDs: map[34a246ef-f936-4f12-bc3a-359df169d6c3:/dev/nvme0n1p3 6588f57d-dad2-4b63-9041-f8e3c523ca4d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 13 19:58:13.255940 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.255880 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 13 19:58:13.257972 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.257955 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 13 19:58:13.262352 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.262242 2569 manager.go:216] Machine: {Timestamp:2026-09-13 19:58:13.260765841 +0000 UTC m=+0.373913935 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100132 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25908f9c0953671bf8db9b1fa6ad9d SystemUUID:ec25908f-9c09-5367-1bf8-db9b1fa6ad9d BootID:9f6860f6-41fa-4a08-9c70-ce3c36e85437 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e8:cf:3e:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e8:cf:3e:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:8d:e2:5f:f1:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 13 19:58:13.262352 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.262344 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 13 19:58:13.262471 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.262459 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 13 19:58:13.265850 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.265828 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 13 19:58:13.265987 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.265853 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-113.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 13 19:58:13.266718 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.266708 2569 topology_manager.go:138] "Creating topology manager with none policy" Sep 13 19:58:13.266753 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.266720 2569 container_manager_linux.go:309] "Creating device plugin manager" Sep 13 19:58:13.266753 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.266733 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 13 19:58:13.267599 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.267589 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 13 19:58:13.268786 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.268777 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 13 19:58:13.273270 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.273256 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 13 19:58:13.273390 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.273380 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 13 19:58:13.273423 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.273413 2569 kubelet.go:486] "Attempting to sync node with API server" Sep 13 19:58:13.273454 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.273428 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 13 19:58:13.273454 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.273452 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 13 19:58:13.273508 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.273466 2569 kubelet.go:398] "Adding apiserver pod source" Sep 13 19:58:13.273508 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.273479 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 13 19:58:13.273911 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.273899 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 13 19:58:13.273955 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.273919 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 13 19:58:13.276502 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.276475 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 13 19:58:13.279549 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.279533 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 13 19:58:13.279598 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.279573 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 13 19:58:13.282282 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282268 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 13 19:58:13.282340 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282291 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 13 19:58:13.282340 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282300 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 13 19:58:13.282340 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282308 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 13 19:58:13.282340 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282321 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 13 19:58:13.282340 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282330 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 13 19:58:13.282511 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282347 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 13 19:58:13.282511 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282356 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 13 19:58:13.282511 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282366 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 13 19:58:13.282511 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282375 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 13 19:58:13.282511 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282388 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 13 19:58:13.282511 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.282396 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 13 19:58:13.283327 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.283304 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 13 19:58:13.283327 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.283319 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 13 19:58:13.284685 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.284662 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 13 19:58:13.284685 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.284664 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 13 19:58:13.287414 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.287396 2569 server.go:1268] "Started kubelet" Sep 13 19:58:13.287497 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.287470 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 13 19:58:13.287595 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.287541 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 13 19:58:13.287640 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.287624 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 13 19:58:13.292325 ip-10-0-142-113 systemd[1]: Started Kubernetes Kubelet. Sep 13 19:58:13.292486 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.292346 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 13 19:58:13.294112 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.294018 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 13 19:58:13.294506 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.294482 2569 server.go:310] "Adding debug handlers to kubelet server" Sep 13 19:58:13.297276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.297259 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-113.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 13 19:58:13.298138 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.297078 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-113.ec2.internal.18d4f9b1a185ccb6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-113.ec2.internal,UID:ip-10-0-142-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-113.ec2.internal,},FirstTimestamp:2026-09-13 19:58:13.287357622 +0000 UTC m=+0.400505697,LastTimestamp:2026-09-13 19:58:13.287357622 +0000 UTC m=+0.400505697,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-113.ec2.internal,}" Sep 13 19:58:13.299539 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.299513 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9qrkc" Sep 13 19:58:13.302343 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.302326 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 13 19:58:13.302993 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.302969 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 13 19:58:13.303133 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.303118 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:13.303864 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.303843 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 13 19:58:13.303864 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.303866 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 13 19:58:13.303993 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.303843 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 13 19:58:13.303993 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.303991 2569 reconstruct.go:97] "Volume reconstruction finished" Sep 13 19:58:13.304097 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.303999 2569 reconciler.go:29] "Reconciler: start to sync state" Sep 13 19:58:13.304097 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.304020 2569 factory.go:55] Registering systemd factory Sep 13 19:58:13.304097 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.304036 2569 factory.go:223] Registration of the systemd container factory successfully Sep 13 19:58:13.304267 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.304250 2569 factory.go:153] Registering CRI-O factory Sep 13 19:58:13.304267 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.304268 2569 factory.go:223] Registration of the crio container factory successfully Sep 13 19:58:13.304403 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.304319 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 13 19:58:13.304403 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.304336 2569 factory.go:103] Registering Raw factory Sep 13 19:58:13.304403 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.304350 2569 manager.go:1196] Started watching for new ooms in manager Sep 13 19:58:13.304715 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.304699 2569 manager.go:349] Starting recovery of all containers Sep 13 19:58:13.304879 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.304857 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 13 19:58:13.305119 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.304975 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 13 19:58:13.306456 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.306436 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9qrkc" Sep 13 19:58:13.314896 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.314880 2569 manager.go:354] Recovery completed Sep 13 19:58:13.319167 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.319153 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:58:13.320908 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.320893 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:58:13.320987 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.320920 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:58:13.320987 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.320930 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:58:13.321497 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.321483 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 13 19:58:13.321497 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.321493 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 13 19:58:13.321497 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.321497 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:58:13.321497 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.321507 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 13 19:58:13.322164 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.322150 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:58:13.322216 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.322175 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:58:13.322216 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.322185 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:58:13.323610 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.323599 2569 policy_none.go:49] "None policy: Start" Sep 13 19:58:13.323655 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.323614 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 13 19:58:13.323655 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.323624 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 13 19:58:13.325560 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.325549 2569 policy_none.go:47] "Start" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.375568 2569 manager.go:337] "Starting Device Plugin manager" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.375622 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.375636 2569 server.go:87] "Starting device plugin registration server" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.375942 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.375952 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.376063 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.376153 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.376163 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.376683 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 13 19:58:13.379554 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.376726 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:13.399832 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.399790 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 13 19:58:13.401072 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.401053 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 13 19:58:13.401138 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.401114 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 13 19:58:13.401185 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.401141 2569 kubelet.go:2448] "Starting kubelet main sync loop" Sep 13 19:58:13.401237 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.401189 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 13 19:58:13.403296 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.403272 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:58:13.477133 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.477021 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:58:13.478032 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.478013 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:58:13.478095 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.478052 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:58:13.478095 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.478064 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:58:13.478095 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.478087 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.487040 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.487016 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.487129 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.487045 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-113.ec2.internal\": node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:13.501643 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.501604 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal"] Sep 13 19:58:13.501844 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.501694 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:58:13.503195 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.503180 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:58:13.503287 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.503213 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:58:13.503287 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.503227 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:58:13.505368 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.505351 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f5218005f3a455108224e70d90a1a51-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal\" (UID: \"4f5218005f3a455108224e70d90a1a51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.505472 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.505376 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f5218005f3a455108224e70d90a1a51-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal\" (UID: \"4f5218005f3a455108224e70d90a1a51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.505555 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.505541 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:58:13.505659 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.505632 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.505659 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.505662 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:58:13.506360 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.506343 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:58:13.506360 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.506359 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:58:13.506498 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.506372 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:58:13.506498 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.506381 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:58:13.506498 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.506385 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:58:13.506498 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.506396 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:58:13.507852 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.507836 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:13.508655 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.508640 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.508721 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.508665 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:58:13.509402 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.509387 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:58:13.509454 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.509416 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:58:13.509454 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.509431 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:58:13.531608 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.531587 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-113.ec2.internal\" not found" node="ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.535932 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.535916 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-113.ec2.internal\" not found" node="ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.606000 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.605970 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f5218005f3a455108224e70d90a1a51-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal\" (UID: \"4f5218005f3a455108224e70d90a1a51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.606000 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.606001 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f5218005f3a455108224e70d90a1a51-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal\" (UID: \"4f5218005f3a455108224e70d90a1a51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.606215 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.606022 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7461e26c7315106ef2eff1b716d85f1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-113.ec2.internal\" (UID: \"d7461e26c7315106ef2eff1b716d85f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.606215 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.606075 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f5218005f3a455108224e70d90a1a51-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal\" (UID: \"4f5218005f3a455108224e70d90a1a51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.606215 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.606083 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f5218005f3a455108224e70d90a1a51-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal\" (UID: \"4f5218005f3a455108224e70d90a1a51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.608082 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.608056 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:13.706799 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.706771 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7461e26c7315106ef2eff1b716d85f1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-113.ec2.internal\" (UID: \"d7461e26c7315106ef2eff1b716d85f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.706947 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.706851 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7461e26c7315106ef2eff1b716d85f1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-113.ec2.internal\" (UID: \"d7461e26c7315106ef2eff1b716d85f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.709059 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.709035 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:13.809180 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.809115 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:13.833684 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.833654 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.839180 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:13.838895 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal" Sep 13 19:58:13.909943 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:13.909901 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:14.010285 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:14.010250 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:14.111481 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:14.111403 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:14.212066 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:14.212031 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:14.228400 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.228369 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 13 19:58:14.228576 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.228556 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 13 19:58:14.311432 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.311388 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-12 19:53:13 +0000 UTC" deadline="2028-04-02 08:43:01.200521894 +0000 UTC" Sep 13 19:58:14.311432 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.311419 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13596h44m46.889105513s" Sep 13 19:58:14.312568 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:14.312551 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:14.413317 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:14.413245 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:14.514359 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:14.514307 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:14.557419 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:14.557382 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7461e26c7315106ef2eff1b716d85f1.slice/crio-9b9672817ca9f3e2229990197ecaf7317bd8ff79115d0a4ca6c7cb70c32e4e45 WatchSource:0}: Error finding container 9b9672817ca9f3e2229990197ecaf7317bd8ff79115d0a4ca6c7cb70c32e4e45: Status 404 returned error can't find the container with id 9b9672817ca9f3e2229990197ecaf7317bd8ff79115d0a4ca6c7cb70c32e4e45 Sep 13 19:58:14.563808 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.563790 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 19:58:14.567362 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:14.567319 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5218005f3a455108224e70d90a1a51.slice/crio-41789edc70d5f0eb6aa5caf34ba6b55e89d9746a4577b70519d0736c015b7ca9 WatchSource:0}: Error finding container 41789edc70d5f0eb6aa5caf34ba6b55e89d9746a4577b70519d0736c015b7ca9: Status 404 returned error can't find the container with id 41789edc70d5f0eb6aa5caf34ba6b55e89d9746a4577b70519d0736c015b7ca9 Sep 13 19:58:14.592408 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.592384 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:58:14.615118 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:14.615089 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:14.716292 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:14.716204 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-113.ec2.internal\" not found" Sep 13 19:58:14.729131 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.729109 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:58:14.804955 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.804919 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" Sep 13 19:58:14.820995 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.820967 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 13 19:58:14.822352 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.822334 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal" Sep 13 19:58:14.831053 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.831032 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 13 19:58:14.851156 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:14.851131 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:58:15.276360 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.276313 2569 apiserver.go:52] "Watching apiserver" Sep 13 19:58:15.289655 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.287111 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 13 19:58:15.289655 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.289045 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qfsm9","kube-system/konnectivity-agent-htg87","kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal","openshift-cluster-node-tuning-operator/tuned-v6cjn","openshift-dns/node-resolver-ncgpc","openshift-image-registry/node-ca-m7nqq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal","openshift-multus/multus-additional-cni-plugins-gcc85","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4","openshift-multus/multus-g2fmm","openshift-multus/network-metrics-daemon-7lwvg","openshift-network-diagnostics/network-check-target-d6bxm","openshift-network-operator/iptables-alerter-vcpqk","openshift-ovn-kubernetes/ovnkube-node-bhcvh"] Sep 13 19:58:15.291974 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.291950 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.295179 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.294661 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:15.298183 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.295639 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 13 19:58:15.298183 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.295915 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 13 19:58:15.298183 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.296122 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lspmm\"" Sep 13 19:58:15.298183 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.296326 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 13 19:58:15.298183 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.297177 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.298183 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.298185 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-njqq9\"" Sep 13 19:58:15.298538 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.298258 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 13 19:58:15.298538 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.298313 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 13 19:58:15.300499 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.299569 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:15.300499 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.299646 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:15.300499 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.300055 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 13 19:58:15.300499 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.300384 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6gvjl\"" Sep 13 19:58:15.300747 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.300602 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 13 19:58:15.300803 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.300765 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 13 19:58:15.303935 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.300984 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 13 19:58:15.303935 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.301078 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 13 19:58:15.303935 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.301413 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 13 19:58:15.303935 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.301566 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:15.303935 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.301623 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:15.303935 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.303546 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 13 19:58:15.304591 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.304471 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.306470 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.306448 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.307380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.306790 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 13 19:58:15.307380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.306790 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z84zk\"" Sep 13 19:58:15.307380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.307001 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 13 19:58:15.307380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.307236 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 13 19:58:15.309061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.309044 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.309549 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.309525 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 13 19:58:15.309767 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.309743 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 13 19:58:15.309876 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.309862 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sftbb\"" Sep 13 19:58:15.309972 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.309962 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 13 19:58:15.310155 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.310122 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 13 19:58:15.311665 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.311324 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2czds\"" Sep 13 19:58:15.311665 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.311635 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.311665 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.311648 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 13 19:58:15.311961 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.311760 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 13 19:58:15.314116 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.313990 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 13 19:58:15.314253 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.314233 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jrfx8\"" Sep 13 19:58:15.314903 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.314340 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.314903 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.314621 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 13 19:58:15.315414 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.315394 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-registration-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.315655 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.315577 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-sys-fs\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.315844 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-cni-dir\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.315874 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-cnibin\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.315916 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-run-k8s-cni-cncf-io\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.315941 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-var-lib-kubelet\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.315984 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-run-ovn\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.316060 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.316113 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhgxg\" (UniqueName: \"kubernetes.io/projected/d184429c-6ecd-415f-a5be-c96f7afc59b6-kube-api-access-vhgxg\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.316163 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.316198 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36d1e385-0377-4ed8-912d-2c5fdc1e7be6-host\") pod \"node-ca-m7nqq\" (UID: \"36d1e385-0377-4ed8-912d-2c5fdc1e7be6\") " pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.316242 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36d1e385-0377-4ed8-912d-2c5fdc1e7be6-serviceca\") pod \"node-ca-m7nqq\" (UID: \"36d1e385-0377-4ed8-912d-2c5fdc1e7be6\") " pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.316267 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-var-lib-cni-bin\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.316314 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-run-multus-certs\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.316341 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-log-socket\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.317269 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.317395 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7cb68\"" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.317509 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.317877 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:15.318276 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.317943 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.316367 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318619 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvfpx\" (UniqueName: \"kubernetes.io/projected/6a563e60-e64b-4e7d-8211-650ee89a4816-kube-api-access-bvfpx\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318648 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-etc-openvswitch\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318672 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-node-log\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318712 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d81020d-4c38-4543-8b9f-7686539e35e9-ovnkube-config\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318757 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318797 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghnw9\" (UniqueName: \"kubernetes.io/projected/8579a980-87c8-459e-90c7-d81ac524a9e6-kube-api-access-ghnw9\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318848 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa735bd5-2718-4898-a9a8-dc76008e50df-konnectivity-ca\") pod \"konnectivity-agent-htg87\" (UID: \"aa735bd5-2718-4898-a9a8-dc76008e50df\") " pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318872 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-systemd-units\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318888 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-var-lib-openvswitch\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318941 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-cni-netd\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d81020d-4c38-4543-8b9f-7686539e35e9-ovn-node-metrics-cert\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.318995 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-daemon-config\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319026 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-hostroot\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-etc-kubernetes\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.319496 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319081 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-run-netns\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319104 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-run-systemd\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-run-openvswitch\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319163 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v765\" (UniqueName: \"kubernetes.io/projected/8d81020d-4c38-4543-8b9f-7686539e35e9-kube-api-access-2v765\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319190 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-socket-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319213 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-device-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319291 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-conf-dir\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319329 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-kubelet\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319374 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319402 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wp65\" (UniqueName: \"kubernetes.io/projected/36d1e385-0377-4ed8-912d-2c5fdc1e7be6-kube-api-access-6wp65\") pod \"node-ca-m7nqq\" (UID: \"36d1e385-0377-4ed8-912d-2c5fdc1e7be6\") " pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319426 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-system-cni-dir\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319451 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-run-netns\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-var-lib-cni-multus\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319512 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-slash\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319553 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-cni-bin\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319577 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d81020d-4c38-4543-8b9f-7686539e35e9-env-overrides\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.320338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319629 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d81020d-4c38-4543-8b9f-7686539e35e9-ovnkube-script-lib\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.321191 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319673 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.321191 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319702 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a563e60-e64b-4e7d-8211-650ee89a4816-cni-binary-copy\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.321191 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319727 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-socket-dir-parent\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.321191 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.319752 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa735bd5-2718-4898-a9a8-dc76008e50df-agent-certs\") pod \"konnectivity-agent-htg87\" (UID: \"aa735bd5-2718-4898-a9a8-dc76008e50df\") " pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:15.321191 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.320298 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 13 19:58:15.321191 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.320490 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.322808 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.322786 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 13 19:58:15.323325 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.323305 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gm4vr\"" Sep 13 19:58:15.323426 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.323309 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 13 19:58:15.323426 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.323386 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 13 19:58:15.344431 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.344408 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nd62w" Sep 13 19:58:15.353282 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.353256 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nd62w" Sep 13 19:58:15.405550 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.405123 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 13 19:58:15.408753 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.408666 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" event={"ID":"4f5218005f3a455108224e70d90a1a51","Type":"ContainerStarted","Data":"41789edc70d5f0eb6aa5caf34ba6b55e89d9746a4577b70519d0736c015b7ca9"} Sep 13 19:58:15.410164 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.410139 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal" event={"ID":"d7461e26c7315106ef2eff1b716d85f1","Type":"ContainerStarted","Data":"9b9672817ca9f3e2229990197ecaf7317bd8ff79115d0a4ca6c7cb70c32e4e45"} Sep 13 19:58:15.419977 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.419952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhgxg\" (UniqueName: \"kubernetes.io/projected/d184429c-6ecd-415f-a5be-c96f7afc59b6-kube-api-access-vhgxg\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.420089 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.419994 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:15.420089 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420025 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-var-lib-cni-bin\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.420089 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420051 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-run-multus-certs\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.420089 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420077 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-log-socket\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.420305 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420104 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-etc-openvswitch\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.420305 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420129 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-node-log\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.420305 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420156 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:15.420305 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420185 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f0c999-550f-4957-a2e4-9ef903418850-system-cni-dir\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.420305 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420214 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f0c999-550f-4957-a2e4-9ef903418850-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.420305 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-sys\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.420305 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420261 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2b5801b-42a5-4419-841a-6411b1c69ffd-hosts-file\") pod \"node-resolver-ncgpc\" (UID: \"a2b5801b-42a5-4419-841a-6411b1c69ffd\") " pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.420305 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420288 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-systemd-units\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420325 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-lib-modules\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420350 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-daemon-config\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420375 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-hostroot\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420399 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-etc-kubernetes\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420426 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-run-openvswitch\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420450 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v765\" (UniqueName: \"kubernetes.io/projected/8d81020d-4c38-4543-8b9f-7686539e35e9-kube-api-access-2v765\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420475 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2n2q\" (UniqueName: \"kubernetes.io/projected/d1f0c999-550f-4957-a2e4-9ef903418850-kube-api-access-x2n2q\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420504 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-socket-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-kubelet\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420560 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420615 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-sysctl-d\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420641 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wp65\" (UniqueName: \"kubernetes.io/projected/36d1e385-0377-4ed8-912d-2c5fdc1e7be6-kube-api-access-6wp65\") pod \"node-ca-m7nqq\" (UID: \"36d1e385-0377-4ed8-912d-2c5fdc1e7be6\") " pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420694 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-system-cni-dir\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420731 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-run-netns\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420763 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-cni-bin\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.420812 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420789 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d81020d-4c38-4543-8b9f-7686539e35e9-env-overrides\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420814 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-systemd\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420840 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2b5801b-42a5-4419-841a-6411b1c69ffd-tmp-dir\") pod \"node-resolver-ncgpc\" (UID: \"a2b5801b-42a5-4419-841a-6411b1c69ffd\") " pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420866 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.420976 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-etc-kubernetes\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.421315 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.421394 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:15.921372647 +0000 UTC m=+3.034520712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421427 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a563e60-e64b-4e7d-8211-650ee89a4816-cni-binary-copy\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421466 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-socket-dir-parent\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421497 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa735bd5-2718-4898-a9a8-dc76008e50df-agent-certs\") pod \"konnectivity-agent-htg87\" (UID: \"aa735bd5-2718-4898-a9a8-dc76008e50df\") " pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421524 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f828953-60a4-4515-af41-79f52c3d8d8d-iptables-alerter-script\") pod \"iptables-alerter-vcpqk\" (UID: \"1f828953-60a4-4515-af41-79f52c3d8d8d\") " pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421560 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbvs\" (UniqueName: \"kubernetes.io/projected/1f828953-60a4-4515-af41-79f52c3d8d8d-kube-api-access-mhbvs\") pod \"iptables-alerter-vcpqk\" (UID: \"1f828953-60a4-4515-af41-79f52c3d8d8d\") " pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421565 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-var-lib-cni-bin\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f0c999-550f-4957-a2e4-9ef903418850-cnibin\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421625 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-log-socket\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.421647 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-host\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421661 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-run-netns\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421673 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-etc-openvswitch\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421686 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-registration-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421714 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-cni-dir\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421724 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-run-openvswitch\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-cnibin\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421769 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-node-log\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421813 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-run-k8s-cni-cncf-io\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421851 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-cni-bin\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421963 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-systemd-units\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422218 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-socket-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422272 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-kubelet\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422316 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422338 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d81020d-4c38-4543-8b9f-7686539e35e9-env-overrides\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422497 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-daemon-config\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422526 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.421770 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-run-k8s-cni-cncf-io\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.422574 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422555 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-hostroot\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422586 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422618 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d81020d-4c38-4543-8b9f-7686539e35e9-ovn-node-metrics-cert\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422627 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-socket-dir-parent\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422649 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-var-lib-kubelet\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422677 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36d1e385-0377-4ed8-912d-2c5fdc1e7be6-host\") pod \"node-ca-m7nqq\" (UID: \"36d1e385-0377-4ed8-912d-2c5fdc1e7be6\") " pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422702 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36d1e385-0377-4ed8-912d-2c5fdc1e7be6-serviceca\") pod \"node-ca-m7nqq\" (UID: \"36d1e385-0377-4ed8-912d-2c5fdc1e7be6\") " pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422728 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d81020d-4c38-4543-8b9f-7686539e35e9-ovnkube-config\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422756 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f0c999-550f-4957-a2e4-9ef903418850-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422782 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422809 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvfpx\" (UniqueName: \"kubernetes.io/projected/6a563e60-e64b-4e7d-8211-650ee89a4816-kube-api-access-bvfpx\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422836 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-modprobe-d\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422861 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-kubernetes\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422904 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zhkg\" (UniqueName: \"kubernetes.io/projected/2d179438-90f4-4969-b54f-cb48028a5e50-kube-api-access-7zhkg\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422930 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9whf\" (UniqueName: \"kubernetes.io/projected/a2b5801b-42a5-4419-841a-6411b1c69ffd-kube-api-access-p9whf\") pod \"node-resolver-ncgpc\" (UID: \"a2b5801b-42a5-4419-841a-6411b1c69ffd\") " pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422957 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-dbus\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.422984 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghnw9\" (UniqueName: \"kubernetes.io/projected/8579a980-87c8-459e-90c7-d81ac524a9e6-kube-api-access-ghnw9\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:15.423686 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423013 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa735bd5-2718-4898-a9a8-dc76008e50df-konnectivity-ca\") pod \"konnectivity-agent-htg87\" (UID: \"aa735bd5-2718-4898-a9a8-dc76008e50df\") " pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423036 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-run-multus-certs\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423104 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-system-cni-dir\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423313 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423110 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36d1e385-0377-4ed8-912d-2c5fdc1e7be6-host\") pod \"node-ca-m7nqq\" (UID: \"36d1e385-0377-4ed8-912d-2c5fdc1e7be6\") " pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423149 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-var-lib-openvswitch\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423357 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d81020d-4c38-4543-8b9f-7686539e35e9-ovnkube-config\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423369 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-cni-netd\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423181 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-var-lib-openvswitch\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423164 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-registration-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423403 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-sysconfig\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423245 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423478 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-kubelet-config\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423496 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-cnibin\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423503 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-cni-dir\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423508 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f828953-60a4-4515-af41-79f52c3d8d8d-host-slash\") pod \"iptables-alerter-vcpqk\" (UID: \"1f828953-60a4-4515-af41-79f52c3d8d8d\") " pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423541 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-run-netns\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423593 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36d1e385-0377-4ed8-912d-2c5fdc1e7be6-serviceca\") pod \"node-ca-m7nqq\" (UID: \"36d1e385-0377-4ed8-912d-2c5fdc1e7be6\") " pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.424614 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423116 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423745 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-run-systemd\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423777 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d179438-90f4-4969-b54f-cb48028a5e50-tmp\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423806 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-device-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423852 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-conf-dir\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423881 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-sysctl-conf\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423955 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-run-systemd\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423966 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-cni-netd\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423979 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a563e60-e64b-4e7d-8211-650ee89a4816-cni-binary-copy\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.423988 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-run\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424010 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-device-dir\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424020 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-var-lib-cni-multus\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424034 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-multus-conf-dir\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424054 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-run-netns\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424078 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa735bd5-2718-4898-a9a8-dc76008e50df-konnectivity-ca\") pod \"konnectivity-agent-htg87\" (UID: \"aa735bd5-2718-4898-a9a8-dc76008e50df\") " pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424094 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-slash\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424122 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d81020d-4c38-4543-8b9f-7686539e35e9-ovnkube-script-lib\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424147 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-var-lib-cni-multus\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.425645 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424197 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-host-slash\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424212 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1f0c999-550f-4957-a2e4-9ef903418850-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424246 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1f0c999-550f-4957-a2e4-9ef903418850-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424284 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-sys-fs\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424325 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-var-lib-kubelet\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424362 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-run-ovn\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424367 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d184429c-6ecd-415f-a5be-c96f7afc59b6-sys-fs\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424368 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a563e60-e64b-4e7d-8211-650ee89a4816-host-var-lib-kubelet\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424398 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d179438-90f4-4969-b54f-cb48028a5e50-etc-tuned\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424423 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d81020d-4c38-4543-8b9f-7686539e35e9-run-ovn\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.426635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.424632 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d81020d-4c38-4543-8b9f-7686539e35e9-ovnkube-script-lib\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.428423 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.427687 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:58:15.428423 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.427711 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:58:15.428423 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.427725 2569 projected.go:196] Error preparing data for projected volume kube-api-access-brrfm for pod openshift-network-diagnostics/network-check-target-d6bxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:15.428423 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.427809 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm podName:a55d1f28-4449-4ae2-b6f0-1694970d30dd nodeName:}" failed. No retries permitted until 2026-09-13 19:58:15.927777177 +0000 UTC m=+3.040925242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-brrfm" (UniqueName: "kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm") pod "network-check-target-d6bxm" (UID: "a55d1f28-4449-4ae2-b6f0-1694970d30dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:15.428423 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.428357 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa735bd5-2718-4898-a9a8-dc76008e50df-agent-certs\") pod \"konnectivity-agent-htg87\" (UID: \"aa735bd5-2718-4898-a9a8-dc76008e50df\") " pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:15.429930 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.429903 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d81020d-4c38-4543-8b9f-7686539e35e9-ovn-node-metrics-cert\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.436323 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.436252 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghnw9\" (UniqueName: \"kubernetes.io/projected/8579a980-87c8-459e-90c7-d81ac524a9e6-kube-api-access-ghnw9\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:15.438324 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.438301 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvfpx\" (UniqueName: \"kubernetes.io/projected/6a563e60-e64b-4e7d-8211-650ee89a4816-kube-api-access-bvfpx\") pod \"multus-g2fmm\" (UID: \"6a563e60-e64b-4e7d-8211-650ee89a4816\") " pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.438417 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.438338 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wp65\" (UniqueName: \"kubernetes.io/projected/36d1e385-0377-4ed8-912d-2c5fdc1e7be6-kube-api-access-6wp65\") pod \"node-ca-m7nqq\" (UID: \"36d1e385-0377-4ed8-912d-2c5fdc1e7be6\") " pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.438936 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.438915 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhgxg\" (UniqueName: \"kubernetes.io/projected/d184429c-6ecd-415f-a5be-c96f7afc59b6-kube-api-access-vhgxg\") pod \"aws-ebs-csi-driver-node-wrzf4\" (UID: \"d184429c-6ecd-415f-a5be-c96f7afc59b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.440993 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.440970 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v765\" (UniqueName: \"kubernetes.io/projected/8d81020d-4c38-4543-8b9f-7686539e35e9-kube-api-access-2v765\") pod \"ovnkube-node-bhcvh\" (UID: \"8d81020d-4c38-4543-8b9f-7686539e35e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.525386 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525343 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1f0c999-550f-4957-a2e4-9ef903418850-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.525580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525399 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d179438-90f4-4969-b54f-cb48028a5e50-etc-tuned\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525458 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f0c999-550f-4957-a2e4-9ef903418850-system-cni-dir\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.525580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525488 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f0c999-550f-4957-a2e4-9ef903418850-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.525580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525513 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-sys\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525538 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2b5801b-42a5-4419-841a-6411b1c69ffd-hosts-file\") pod \"node-resolver-ncgpc\" (UID: \"a2b5801b-42a5-4419-841a-6411b1c69ffd\") " pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.525580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525562 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-lib-modules\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525565 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f0c999-550f-4957-a2e4-9ef903418850-system-cni-dir\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525593 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2n2q\" (UniqueName: \"kubernetes.io/projected/d1f0c999-550f-4957-a2e4-9ef903418850-kube-api-access-x2n2q\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525626 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-sysctl-d\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525643 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-sys\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525651 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525694 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-systemd\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525721 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2b5801b-42a5-4419-841a-6411b1c69ffd-tmp-dir\") pod \"node-resolver-ncgpc\" (UID: \"a2b5801b-42a5-4419-841a-6411b1c69ffd\") " pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.525737 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525750 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f828953-60a4-4515-af41-79f52c3d8d8d-iptables-alerter-script\") pod \"iptables-alerter-vcpqk\" (UID: \"1f828953-60a4-4515-af41-79f52c3d8d8d\") " pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525778 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbvs\" (UniqueName: \"kubernetes.io/projected/1f828953-60a4-4515-af41-79f52c3d8d8d-kube-api-access-mhbvs\") pod \"iptables-alerter-vcpqk\" (UID: \"1f828953-60a4-4515-af41-79f52c3d8d8d\") " pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.525797 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret podName:d313ffdb-9c1c-442c-b9ed-06eb5b20ec99 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:16.025778788 +0000 UTC m=+3.138926857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret") pod "global-pull-secret-syncer-qfsm9" (UID: "d313ffdb-9c1c-442c-b9ed-06eb5b20ec99") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f0c999-550f-4957-a2e4-9ef903418850-cnibin\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525851 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-host\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525898 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-var-lib-kubelet\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525930 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f0c999-550f-4957-a2e4-9ef903418850-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525957 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-modprobe-d\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525974 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-kubernetes\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.525984 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.525989 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zhkg\" (UniqueName: \"kubernetes.io/projected/2d179438-90f4-4969-b54f-cb48028a5e50-kube-api-access-7zhkg\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526012 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9whf\" (UniqueName: \"kubernetes.io/projected/a2b5801b-42a5-4419-841a-6411b1c69ffd-kube-api-access-p9whf\") pod \"node-resolver-ncgpc\" (UID: \"a2b5801b-42a5-4419-841a-6411b1c69ffd\") " pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526037 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-dbus\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526045 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2b5801b-42a5-4419-841a-6411b1c69ffd-hosts-file\") pod \"node-resolver-ncgpc\" (UID: \"a2b5801b-42a5-4419-841a-6411b1c69ffd\") " pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526068 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-sysconfig\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526067 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1f0c999-550f-4957-a2e4-9ef903418850-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526094 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-kubelet-config\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526120 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f828953-60a4-4515-af41-79f52c3d8d8d-host-slash\") pod \"iptables-alerter-vcpqk\" (UID: \"1f828953-60a4-4515-af41-79f52c3d8d8d\") " pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526147 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d179438-90f4-4969-b54f-cb48028a5e50-tmp\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526173 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-sysctl-conf\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526182 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-lib-modules\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526197 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-run\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526237 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-kubernetes\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526236 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1f0c999-550f-4957-a2e4-9ef903418850-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526327 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2b5801b-42a5-4419-841a-6411b1c69ffd-tmp-dir\") pod \"node-resolver-ncgpc\" (UID: \"a2b5801b-42a5-4419-841a-6411b1c69ffd\") " pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526382 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-sysctl-d\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526386 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-systemd\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.526928 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526529 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f0c999-550f-4957-a2e4-9ef903418850-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526589 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-var-lib-kubelet\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526631 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f0c999-550f-4957-a2e4-9ef903418850-cnibin\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526674 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-host\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526706 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f0c999-550f-4957-a2e4-9ef903418850-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526747 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1f0c999-550f-4957-a2e4-9ef903418850-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526762 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-modprobe-d\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526767 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-kubelet-config\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526783 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f828953-60a4-4515-af41-79f52c3d8d8d-iptables-alerter-script\") pod \"iptables-alerter-vcpqk\" (UID: \"1f828953-60a4-4515-af41-79f52c3d8d8d\") " pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526810 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f828953-60a4-4515-af41-79f52c3d8d8d-host-slash\") pod \"iptables-alerter-vcpqk\" (UID: \"1f828953-60a4-4515-af41-79f52c3d8d8d\") " pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526857 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-sysconfig\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526859 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-dbus\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.526923 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-run\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.527055 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d179438-90f4-4969-b54f-cb48028a5e50-etc-sysctl-conf\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.527860 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.527214 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:58:15.529731 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.529709 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d179438-90f4-4969-b54f-cb48028a5e50-tmp\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.529883 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.529756 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d179438-90f4-4969-b54f-cb48028a5e50-etc-tuned\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.535470 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.535443 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zhkg\" (UniqueName: \"kubernetes.io/projected/2d179438-90f4-4969-b54f-cb48028a5e50-kube-api-access-7zhkg\") pod \"tuned-v6cjn\" (UID: \"2d179438-90f4-4969-b54f-cb48028a5e50\") " pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.536213 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.535920 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9whf\" (UniqueName: \"kubernetes.io/projected/a2b5801b-42a5-4419-841a-6411b1c69ffd-kube-api-access-p9whf\") pod \"node-resolver-ncgpc\" (UID: \"a2b5801b-42a5-4419-841a-6411b1c69ffd\") " pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.536213 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.536145 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbvs\" (UniqueName: \"kubernetes.io/projected/1f828953-60a4-4515-af41-79f52c3d8d8d-kube-api-access-mhbvs\") pod \"iptables-alerter-vcpqk\" (UID: \"1f828953-60a4-4515-af41-79f52c3d8d8d\") " pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.536845 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.536805 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2n2q\" (UniqueName: \"kubernetes.io/projected/d1f0c999-550f-4957-a2e4-9ef903418850-kube-api-access-x2n2q\") pod \"multus-additional-cni-plugins-gcc85\" (UID: \"d1f0c999-550f-4957-a2e4-9ef903418850\") " pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.610834 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.610795 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" Sep 13 19:58:15.622015 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.621983 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:15.625342 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:15.625299 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd184429c_6ecd_415f_a5be_c96f7afc59b6.slice/crio-d3c89bc519986b038f2ad309003ccf4d44e26703f1754bdbf747ba47671bd462 WatchSource:0}: Error finding container d3c89bc519986b038f2ad309003ccf4d44e26703f1754bdbf747ba47671bd462: Status 404 returned error can't find the container with id d3c89bc519986b038f2ad309003ccf4d44e26703f1754bdbf747ba47671bd462 Sep 13 19:58:15.632444 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:15.632401 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa735bd5_2718_4898_a9a8_dc76008e50df.slice/crio-416c26b6a06d211ae28d6b948852cc0c69b46a57791674b46a2a54fe4b359d93 WatchSource:0}: Error finding container 416c26b6a06d211ae28d6b948852cc0c69b46a57791674b46a2a54fe4b359d93: Status 404 returned error can't find the container with id 416c26b6a06d211ae28d6b948852cc0c69b46a57791674b46a2a54fe4b359d93 Sep 13 19:58:15.638679 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.638652 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:15.642526 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.642502 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7nqq" Sep 13 19:58:15.650738 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.650708 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g2fmm" Sep 13 19:58:15.651919 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:15.651888 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d81020d_4c38_4543_8b9f_7686539e35e9.slice/crio-a4cb216659249159f97aded5a2933a42d5f85eb052107b850dedec02f24dab1d WatchSource:0}: Error finding container a4cb216659249159f97aded5a2933a42d5f85eb052107b850dedec02f24dab1d: Status 404 returned error can't find the container with id a4cb216659249159f97aded5a2933a42d5f85eb052107b850dedec02f24dab1d Sep 13 19:58:15.661055 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.661029 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gcc85" Sep 13 19:58:15.668270 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.668246 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" Sep 13 19:58:15.678230 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.678202 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ncgpc" Sep 13 19:58:15.688263 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.688236 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vcpqk" Sep 13 19:58:15.929653 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.929568 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:15.929653 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:15.929607 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:15.929864 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.929726 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:15.929864 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.929738 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:58:15.929864 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.929757 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:58:15.929864 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.929770 2569 projected.go:196] Error preparing data for projected volume kube-api-access-brrfm for pod openshift-network-diagnostics/network-check-target-d6bxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:15.929864 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.929799 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:16.929780723 +0000 UTC m=+4.042928802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:15.929864 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:15.929815 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm podName:a55d1f28-4449-4ae2-b6f0-1694970d30dd nodeName:}" failed. No retries permitted until 2026-09-13 19:58:16.929808518 +0000 UTC m=+4.042956580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-brrfm" (UniqueName: "kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm") pod "network-check-target-d6bxm" (UID: "a55d1f28-4449-4ae2-b6f0-1694970d30dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:16.014315 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:16.014275 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d1e385_0377_4ed8_912d_2c5fdc1e7be6.slice/crio-bf529ee934df3742658ce498593bf4ecb369c862fa4e60f8eaa7d733ce38babc WatchSource:0}: Error finding container bf529ee934df3742658ce498593bf4ecb369c862fa4e60f8eaa7d733ce38babc: Status 404 returned error can't find the container with id bf529ee934df3742658ce498593bf4ecb369c862fa4e60f8eaa7d733ce38babc Sep 13 19:58:16.030161 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:16.030129 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:16.030289 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:16.030266 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:16.030336 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:16.030326 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret podName:d313ffdb-9c1c-442c-b9ed-06eb5b20ec99 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:17.030310387 +0000 UTC m=+4.143458455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret") pod "global-pull-secret-syncer-qfsm9" (UID: "d313ffdb-9c1c-442c-b9ed-06eb5b20ec99") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:16.358032 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:16.357950 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-12 19:53:15 +0000 UTC" deadline="2028-05-17 13:15:47.847408431 +0000 UTC" Sep 13 19:58:16.358032 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:16.357992 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14681h17m31.489420681s" Sep 13 19:58:16.413802 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:16.413759 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7nqq" event={"ID":"36d1e385-0377-4ed8-912d-2c5fdc1e7be6","Type":"ContainerStarted","Data":"bf529ee934df3742658ce498593bf4ecb369c862fa4e60f8eaa7d733ce38babc"} Sep 13 19:58:16.415198 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:16.415161 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" event={"ID":"8d81020d-4c38-4543-8b9f-7686539e35e9","Type":"ContainerStarted","Data":"a4cb216659249159f97aded5a2933a42d5f85eb052107b850dedec02f24dab1d"} Sep 13 19:58:16.416380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:16.416357 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-htg87" event={"ID":"aa735bd5-2718-4898-a9a8-dc76008e50df","Type":"ContainerStarted","Data":"416c26b6a06d211ae28d6b948852cc0c69b46a57791674b46a2a54fe4b359d93"} Sep 13 19:58:16.417607 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:16.417581 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" event={"ID":"d184429c-6ecd-415f-a5be-c96f7afc59b6","Type":"ContainerStarted","Data":"d3c89bc519986b038f2ad309003ccf4d44e26703f1754bdbf747ba47671bd462"} Sep 13 19:58:16.782328 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:16.782122 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2b5801b_42a5_4419_841a_6411b1c69ffd.slice/crio-49f5c550f81ac9a3d9f35d8d0e0636b7daab454c588040cef00186fc0a27a13d WatchSource:0}: Error finding container 49f5c550f81ac9a3d9f35d8d0e0636b7daab454c588040cef00186fc0a27a13d: Status 404 returned error can't find the container with id 49f5c550f81ac9a3d9f35d8d0e0636b7daab454c588040cef00186fc0a27a13d Sep 13 19:58:16.783943 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:16.783866 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a563e60_e64b_4e7d_8211_650ee89a4816.slice/crio-722f2dea4147dd803669fb9e3e332929025e51d7ceb85dda7ff45d7dc4edb7d5 WatchSource:0}: Error finding container 722f2dea4147dd803669fb9e3e332929025e51d7ceb85dda7ff45d7dc4edb7d5: Status 404 returned error can't find the container with id 722f2dea4147dd803669fb9e3e332929025e51d7ceb85dda7ff45d7dc4edb7d5 Sep 13 19:58:16.787417 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:16.787249 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f828953_60a4_4515_af41_79f52c3d8d8d.slice/crio-ffb0a347065f87235bd91290b9567f853b2a0e35873b53a14c1033bd788735a8 WatchSource:0}: Error finding container ffb0a347065f87235bd91290b9567f853b2a0e35873b53a14c1033bd788735a8: Status 404 returned error can't find the container with id ffb0a347065f87235bd91290b9567f853b2a0e35873b53a14c1033bd788735a8 Sep 13 19:58:16.789934 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:16.789910 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f0c999_550f_4957_a2e4_9ef903418850.slice/crio-c5ffe6dfd9b56189a5892dfda2688722a41cb243c370832b5a19094bb50f506e WatchSource:0}: Error finding container c5ffe6dfd9b56189a5892dfda2688722a41cb243c370832b5a19094bb50f506e: Status 404 returned error can't find the container with id c5ffe6dfd9b56189a5892dfda2688722a41cb243c370832b5a19094bb50f506e Sep 13 19:58:16.791510 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:16.791486 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d179438_90f4_4969_b54f_cb48028a5e50.slice/crio-f33633216bf96ad5864c6e5e06bd586f62e1d7afdb3a457f0e1fe2e6cdb0be2a WatchSource:0}: Error finding container f33633216bf96ad5864c6e5e06bd586f62e1d7afdb3a457f0e1fe2e6cdb0be2a: Status 404 returned error can't find the container with id f33633216bf96ad5864c6e5e06bd586f62e1d7afdb3a457f0e1fe2e6cdb0be2a Sep 13 19:58:16.938155 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:16.938116 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:16.938326 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:16.938169 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:16.938326 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:16.938297 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:58:16.938446 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:16.938350 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:58:16.938446 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:16.938362 2569 projected.go:196] Error preparing data for projected volume kube-api-access-brrfm for pod openshift-network-diagnostics/network-check-target-d6bxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:16.938446 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:16.938295 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:16.938446 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:16.938421 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm podName:a55d1f28-4449-4ae2-b6f0-1694970d30dd nodeName:}" failed. No retries permitted until 2026-09-13 19:58:18.938401262 +0000 UTC m=+6.051549350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-brrfm" (UniqueName: "kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm") pod "network-check-target-d6bxm" (UID: "a55d1f28-4449-4ae2-b6f0-1694970d30dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:16.938665 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:16.938485 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:18.938454496 +0000 UTC m=+6.051602582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:17.038916 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.038806 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:17.039095 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:17.038968 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:17.039095 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:17.039036 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret podName:d313ffdb-9c1c-442c-b9ed-06eb5b20ec99 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:19.039016199 +0000 UTC m=+6.152164277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret") pod "global-pull-secret-syncer-qfsm9" (UID: "d313ffdb-9c1c-442c-b9ed-06eb5b20ec99") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:17.358383 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.358277 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-12 19:53:15 +0000 UTC" deadline="2028-02-14 08:58:38.746656668 +0000 UTC" Sep 13 19:58:17.358383 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.358322 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12445h0m21.388339249s" Sep 13 19:58:17.402292 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.402257 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:17.402461 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:17.402418 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:17.404535 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.404505 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:17.404718 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:17.404694 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:17.405522 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.405500 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:17.405691 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:17.405665 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:17.430188 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.430147 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g2fmm" event={"ID":"6a563e60-e64b-4e7d-8211-650ee89a4816","Type":"ContainerStarted","Data":"722f2dea4147dd803669fb9e3e332929025e51d7ceb85dda7ff45d7dc4edb7d5"} Sep 13 19:58:17.435199 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.435163 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ncgpc" event={"ID":"a2b5801b-42a5-4419-841a-6411b1c69ffd","Type":"ContainerStarted","Data":"49f5c550f81ac9a3d9f35d8d0e0636b7daab454c588040cef00186fc0a27a13d"} Sep 13 19:58:17.447420 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.447386 2569 generic.go:356] "Generic (PLEG): container finished" podID="4f5218005f3a455108224e70d90a1a51" containerID="a8d9906f90185b1cfd56ca40420f5bb43349b76bad9e87f80a412d65b97381df" exitCode=0 Sep 13 19:58:17.447753 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.447690 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" event={"ID":"4f5218005f3a455108224e70d90a1a51","Type":"ContainerDied","Data":"a8d9906f90185b1cfd56ca40420f5bb43349b76bad9e87f80a412d65b97381df"} Sep 13 19:58:17.454684 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.454342 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal" event={"ID":"d7461e26c7315106ef2eff1b716d85f1","Type":"ContainerStarted","Data":"bb163cee7c5f25474792d11b3c284ab187886ef177f34dc499d2a83446ffe26f"} Sep 13 19:58:17.458785 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.458696 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" event={"ID":"2d179438-90f4-4969-b54f-cb48028a5e50","Type":"ContainerStarted","Data":"f33633216bf96ad5864c6e5e06bd586f62e1d7afdb3a457f0e1fe2e6cdb0be2a"} Sep 13 19:58:17.474151 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.474114 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vcpqk" event={"ID":"1f828953-60a4-4515-af41-79f52c3d8d8d","Type":"ContainerStarted","Data":"ffb0a347065f87235bd91290b9567f853b2a0e35873b53a14c1033bd788735a8"} Sep 13 19:58:17.477145 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.477118 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcc85" event={"ID":"d1f0c999-550f-4957-a2e4-9ef903418850","Type":"ContainerStarted","Data":"c5ffe6dfd9b56189a5892dfda2688722a41cb243c370832b5a19094bb50f506e"} Sep 13 19:58:17.484909 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:17.480247 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-113.ec2.internal" podStartSLOduration=2.48022812 podStartE2EDuration="2.48022812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:17.479499998 +0000 UTC m=+4.592648087" watchObservedRunningTime="2026-09-13 19:58:17.48022812 +0000 UTC m=+4.593376207" Sep 13 19:58:18.507600 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:18.507465 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" event={"ID":"4f5218005f3a455108224e70d90a1a51","Type":"ContainerStarted","Data":"3c2502810155ec16a379ecbb16482d9ab2d651ac2dd968ec211f00888e23b319"} Sep 13 19:58:18.956634 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:18.955797 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:18.956634 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:18.955862 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:18.956634 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:18.956017 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:58:18.956634 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:18.956038 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:58:18.956634 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:18.956052 2569 projected.go:196] Error preparing data for projected volume kube-api-access-brrfm for pod openshift-network-diagnostics/network-check-target-d6bxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:18.956634 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:18.956113 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm podName:a55d1f28-4449-4ae2-b6f0-1694970d30dd nodeName:}" failed. No retries permitted until 2026-09-13 19:58:22.956093796 +0000 UTC m=+10.069241865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-brrfm" (UniqueName: "kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm") pod "network-check-target-d6bxm" (UID: "a55d1f28-4449-4ae2-b6f0-1694970d30dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:18.956634 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:18.956502 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:18.956634 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:18.956550 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:22.956535627 +0000 UTC m=+10.069683693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:19.056985 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:19.056933 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:19.057171 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:19.057115 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:19.057233 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:19.057180 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret podName:d313ffdb-9c1c-442c-b9ed-06eb5b20ec99 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:23.057161943 +0000 UTC m=+10.170310009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret") pod "global-pull-secret-syncer-qfsm9" (UID: "d313ffdb-9c1c-442c-b9ed-06eb5b20ec99") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:19.401881 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:19.401673 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:19.401881 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:19.401822 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:19.402535 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:19.402203 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:19.402535 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:19.402322 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:19.402535 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:19.402393 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:19.402535 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:19.402475 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:21.403891 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:21.403859 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:21.403891 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:21.403879 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:21.404402 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:21.404042 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:21.404402 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:21.404246 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:21.404402 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:21.404306 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:21.404557 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:21.404408 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:22.990768 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:22.990682 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:22.990768 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:22.990723 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:22.991260 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:22.990880 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:22.991260 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:22.990961 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:30.990942101 +0000 UTC m=+18.104090168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:22.991260 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:22.990973 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:58:22.991260 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:22.990991 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:58:22.991260 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:22.991005 2569 projected.go:196] Error preparing data for projected volume kube-api-access-brrfm for pod openshift-network-diagnostics/network-check-target-d6bxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:22.991260 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:22.991056 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm podName:a55d1f28-4449-4ae2-b6f0-1694970d30dd nodeName:}" failed. No retries permitted until 2026-09-13 19:58:30.991039104 +0000 UTC m=+18.104187182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-brrfm" (UniqueName: "kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm") pod "network-check-target-d6bxm" (UID: "a55d1f28-4449-4ae2-b6f0-1694970d30dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:23.091751 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:23.091701 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:23.091959 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:23.091912 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:23.092019 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:23.091973 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret podName:d313ffdb-9c1c-442c-b9ed-06eb5b20ec99 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:31.091955292 +0000 UTC m=+18.205103358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret") pod "global-pull-secret-syncer-qfsm9" (UID: "d313ffdb-9c1c-442c-b9ed-06eb5b20ec99") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:23.406301 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:23.405993 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:23.406468 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:23.406322 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:23.406468 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:23.406013 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:23.406468 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:23.406417 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:23.406468 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:23.406000 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:23.406715 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:23.406499 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:25.401862 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:25.401790 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:25.402313 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:25.401790 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:25.402313 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:25.401937 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:25.402313 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:25.401952 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:25.402313 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:25.402042 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:25.402313 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:25.402132 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:27.401912 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:27.401872 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:27.402380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:27.401873 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:27.402380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:27.402005 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:27.402380 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:27.402001 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:27.402380 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:27.402079 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:27.402380 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:27.402179 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:29.402319 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:29.402287 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:29.402788 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:29.402421 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:29.402788 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:29.402434 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:29.402788 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:29.402508 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:29.402788 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:29.402607 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:29.402788 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:29.402702 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:31.045774 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:31.045730 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:31.046224 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:31.045938 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:31.046224 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.045983 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:58:31.046224 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.046013 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:58:31.046224 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.046026 2569 projected.go:196] Error preparing data for projected volume kube-api-access-brrfm for pod openshift-network-diagnostics/network-check-target-d6bxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:31.046224 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.046098 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm podName:a55d1f28-4449-4ae2-b6f0-1694970d30dd nodeName:}" failed. No retries permitted until 2026-09-13 19:58:47.046083486 +0000 UTC m=+34.159231546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-brrfm" (UniqueName: "kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm") pod "network-check-target-d6bxm" (UID: "a55d1f28-4449-4ae2-b6f0-1694970d30dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:31.046224 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.046111 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:31.046224 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.046188 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:47.046169672 +0000 UTC m=+34.159317735 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:31.146933 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:31.146801 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:31.146933 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.146929 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:31.147162 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.146994 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret podName:d313ffdb-9c1c-442c-b9ed-06eb5b20ec99 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:47.146976263 +0000 UTC m=+34.260124328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret") pod "global-pull-secret-syncer-qfsm9" (UID: "d313ffdb-9c1c-442c-b9ed-06eb5b20ec99") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:31.401892 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:31.401513 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:31.401892 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:31.401513 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:31.401892 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.401655 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:31.401892 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:31.401689 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:31.401892 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.401778 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:31.401892 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:31.401883 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:33.402317 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:33.402285 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:33.402848 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:33.402386 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:33.402848 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:33.402429 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:33.402848 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:33.402475 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:33.402848 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:33.402501 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:33.402848 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:33.402577 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:34.546628 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.546416 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" event={"ID":"8d81020d-4c38-4543-8b9f-7686539e35e9","Type":"ContainerStarted","Data":"fe526ff31270d968863796b996defdd02794b71739df68d09f7923f208627f30"} Sep 13 19:58:34.547401 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.546706 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" event={"ID":"8d81020d-4c38-4543-8b9f-7686539e35e9","Type":"ContainerStarted","Data":"829cba2552c0dd5a2e37d2201439bcbf971691a1e13fbdbc0fab3c6f49114837"} Sep 13 19:58:34.548184 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.548111 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-htg87" event={"ID":"aa735bd5-2718-4898-a9a8-dc76008e50df","Type":"ContainerStarted","Data":"1b5e5e55417d67b3e6dc9ea682d8648d7423703969a7ae29aa17c0fc2468b133"} Sep 13 19:58:34.550376 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.550037 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" event={"ID":"2d179438-90f4-4969-b54f-cb48028a5e50","Type":"ContainerStarted","Data":"75d61b718b7f397ab6407d360777a23a1bdf0eb449e4ad3459af8cd17079203b"} Sep 13 19:58:34.551781 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.551747 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7nqq" event={"ID":"36d1e385-0377-4ed8-912d-2c5fdc1e7be6","Type":"ContainerStarted","Data":"aee3ddc7c51dfb60ed21476387f0143b74a8a445cacf213f6ae461435a09b14c"} Sep 13 19:58:34.553422 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.553396 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" event={"ID":"d184429c-6ecd-415f-a5be-c96f7afc59b6","Type":"ContainerStarted","Data":"80a15c7a6e9c12214d1ce2d4110157bc9b252f2804446448792f6679f91841f4"} Sep 13 19:58:34.555098 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.555066 2569 generic.go:356] "Generic (PLEG): container finished" podID="d1f0c999-550f-4957-a2e4-9ef903418850" containerID="5615e264ffd67be4f5790ebac3f94cdeedc91ef1027c9a39cc8d6ef24e0f0960" exitCode=0 Sep 13 19:58:34.555204 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.555134 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcc85" event={"ID":"d1f0c999-550f-4957-a2e4-9ef903418850","Type":"ContainerDied","Data":"5615e264ffd67be4f5790ebac3f94cdeedc91ef1027c9a39cc8d6ef24e0f0960"} Sep 13 19:58:34.556863 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.556840 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g2fmm" event={"ID":"6a563e60-e64b-4e7d-8211-650ee89a4816","Type":"ContainerStarted","Data":"01c7505d9c098e070e42bd296159bdd2249afa3431f487f8fd43e62dfd196ebb"} Sep 13 19:58:34.560918 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.560891 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ncgpc" event={"ID":"a2b5801b-42a5-4419-841a-6411b1c69ffd","Type":"ContainerStarted","Data":"ed83c128f1d8bec9ebbbde45bba71de1a5db5d631591159bff68ea7552ec1469"} Sep 13 19:58:34.561932 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.561890 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-htg87" podStartSLOduration=2.9880537929999997 podStartE2EDuration="21.561876301s" totalImagesPullingTime="18.573822508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:34.561779663 +0000 UTC m=+21.674927747" watchObservedRunningTime="2026-09-13 19:58:34.561876301 +0000 UTC m=+21.675024380" Sep 13 19:58:34.562109 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.562091 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-113.ec2.internal" podStartSLOduration=19.562086159 podStartE2EDuration="19.562086159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:18.521962816 +0000 UTC m=+5.635110900" watchObservedRunningTime="2026-09-13 19:58:34.562086159 +0000 UTC m=+21.675234241" Sep 13 19:58:34.574049 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.573960 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m7nqq" podStartSLOduration=3.365392697 podStartE2EDuration="21.573936091s" totalImagesPullingTime="18.208543394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:34.573554684 +0000 UTC m=+21.686702778" watchObservedRunningTime="2026-09-13 19:58:34.573936091 +0000 UTC m=+21.687084174" Sep 13 19:58:34.609926 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.609869 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g2fmm" podStartSLOduration=4.099719555 podStartE2EDuration="21.609850733s" totalImagesPullingTime="17.510131178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:34.609520063 +0000 UTC m=+21.722668177" watchObservedRunningTime="2026-09-13 19:58:34.609850733 +0000 UTC m=+21.722998815" Sep 13 19:58:34.642828 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.642767 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v6cjn" podStartSLOduration=3.20488713 podStartE2EDuration="20.642749227s" totalImagesPullingTime="17.437862097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:34.629403601 +0000 UTC m=+21.742551702" watchObservedRunningTime="2026-09-13 19:58:34.642749227 +0000 UTC m=+21.755897313" Sep 13 19:58:34.642994 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:34.642886 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ncgpc" podStartSLOduration=3.198090051 podStartE2EDuration="20.642880592s" totalImagesPullingTime="17.444790541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:34.642403373 +0000 UTC m=+21.755551482" watchObservedRunningTime="2026-09-13 19:58:34.642880592 +0000 UTC m=+21.756028674" Sep 13 19:58:35.401847 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.401802 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:35.402036 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.401820 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:35.402036 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.401976 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:35.402036 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:35.401942 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:35.402203 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:35.402077 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:35.402203 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:35.402171 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:35.566424 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.566383 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" event={"ID":"8d81020d-4c38-4543-8b9f-7686539e35e9","Type":"ContainerStarted","Data":"b110535dae327614d7ae51f489c59590d7d512324bcb93b78b173dd2de520a27"} Sep 13 19:58:35.567031 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.566464 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" event={"ID":"8d81020d-4c38-4543-8b9f-7686539e35e9","Type":"ContainerStarted","Data":"0ad85452c5277d50e504118b6a6642d39b6f591179e7d235efedcddba37d9339"} Sep 13 19:58:35.567031 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.566508 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" event={"ID":"8d81020d-4c38-4543-8b9f-7686539e35e9","Type":"ContainerStarted","Data":"9adae76b4fa841570d9369907d9a62e3320af1bfb3a48b5c32e1f597edccd2c0"} Sep 13 19:58:35.567031 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.566544 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" event={"ID":"8d81020d-4c38-4543-8b9f-7686539e35e9","Type":"ContainerStarted","Data":"c813e6bd072a76973d9fee40391f2198065ac10a50fbcb0d078dc5bc74ebc5db"} Sep 13 19:58:35.573422 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.573391 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:35.574327 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.574305 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:35.838112 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:35.837862 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 13 19:58:36.393887 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:36.393758 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-13T19:58:35.838105096Z","UUID":"eabe3636-60cd-46ef-97b0-11fd05ce47ce","Handler":null,"Name":"","Endpoint":""} Sep 13 19:58:36.395951 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:36.395926 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 13 19:58:36.396076 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:36.395959 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 13 19:58:36.572627 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:36.572576 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vcpqk" event={"ID":"1f828953-60a4-4515-af41-79f52c3d8d8d","Type":"ContainerStarted","Data":"0dbc9d3fc4555af4fe2946a121e5bc21fcf28f90093ebc6e7051db4d7f6f02a0"} Sep 13 19:58:36.575322 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:36.575284 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" event={"ID":"d184429c-6ecd-415f-a5be-c96f7afc59b6","Type":"ContainerStarted","Data":"80f5710b6cb63d3e341a2924ee9903c795a9d28f4bbf1e7b0573dd1e3a035d46"} Sep 13 19:58:36.585994 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:36.585926 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vcpqk" podStartSLOduration=5.16709769 podStartE2EDuration="22.585905363s" totalImagesPullingTime="17.418807673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:36.58542852 +0000 UTC m=+23.698576626" watchObservedRunningTime="2026-09-13 19:58:36.585905363 +0000 UTC m=+23.699053447" Sep 13 19:58:37.401923 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:37.401893 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:37.402061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:37.401893 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:37.402061 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:37.402005 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:37.402061 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:37.402012 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:37.402177 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:37.402071 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:37.402177 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:37.402146 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:37.580000 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:37.579891 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" event={"ID":"d184429c-6ecd-415f-a5be-c96f7afc59b6","Type":"ContainerStarted","Data":"ace5d76bba50738c71eba6a0d56c2301378f011ba860996c875878ee6ef6753f"} Sep 13 19:58:37.583823 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:37.583783 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" event={"ID":"8d81020d-4c38-4543-8b9f-7686539e35e9","Type":"ContainerStarted","Data":"6204e839aeba8bc907557885c932cfe51fc5094b3d5cf60e50e60ad30ccea57b"} Sep 13 19:58:37.583960 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:37.583895 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 13 19:58:37.597740 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:37.597683 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wrzf4" podStartSLOduration=3.248959526 podStartE2EDuration="24.597660864s" totalImagesPullingTime="21.348701338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:37.596242294 +0000 UTC m=+24.709390396" watchObservedRunningTime="2026-09-13 19:58:37.597660864 +0000 UTC m=+24.710808948" Sep 13 19:58:38.272903 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:38.272865 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:38.273627 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:38.273600 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-htg87" Sep 13 19:58:39.402368 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:39.402336 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:39.402849 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:39.402341 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:39.402849 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:39.402470 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:39.402849 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:39.402579 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:39.402849 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:39.402341 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:39.402849 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:39.402699 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:39.595028 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:39.594506 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" event={"ID":"8d81020d-4c38-4543-8b9f-7686539e35e9","Type":"ContainerStarted","Data":"7beb0c99df85f436c939e18d1f281c20a7f33b80a55eca24ef894015529cd16f"} Sep 13 19:58:39.619536 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:39.619487 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" podStartSLOduration=7.941593238 podStartE2EDuration="26.619471139s" totalImagesPullingTime="18.677877901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:39.61917869 +0000 UTC m=+26.732326802" watchObservedRunningTime="2026-09-13 19:58:39.619471139 +0000 UTC m=+26.732619222" Sep 13 19:58:40.598800 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:40.598761 2569 generic.go:356] "Generic (PLEG): container finished" podID="d1f0c999-550f-4957-a2e4-9ef903418850" containerID="adccc2714e46df15c1c32f8f74ebc59f2a6f285fa8e77db00fd0ac5c27b281a0" exitCode=0 Sep 13 19:58:40.599677 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:40.598846 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcc85" event={"ID":"d1f0c999-550f-4957-a2e4-9ef903418850","Type":"ContainerDied","Data":"adccc2714e46df15c1c32f8f74ebc59f2a6f285fa8e77db00fd0ac5c27b281a0"} Sep 13 19:58:40.599677 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:40.599268 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:40.599677 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:40.599334 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:40.599677 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:40.599376 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:40.616605 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:40.616575 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:40.616751 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:40.616685 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:58:41.402358 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:41.402317 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:41.402549 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:41.402317 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:41.402549 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:41.402449 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:41.402549 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:41.402467 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:41.402709 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:41.402555 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:41.402709 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:41.402652 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:41.672151 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:41.672075 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d6bxm"] Sep 13 19:58:41.672829 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:41.672218 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:41.672829 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:41.672328 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:41.675717 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:41.675673 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qfsm9"] Sep 13 19:58:41.675907 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:41.675876 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:41.676010 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:41.675984 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:41.676338 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:41.676313 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7lwvg"] Sep 13 19:58:41.676428 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:41.676398 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:41.676512 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:41.676489 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:42.605914 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:42.605697 2569 generic.go:356] "Generic (PLEG): container finished" podID="d1f0c999-550f-4957-a2e4-9ef903418850" containerID="b1a91568fbd3c98aebae35e6dd287b0227e0fb239aeeacd0a541fae29ab055f3" exitCode=0 Sep 13 19:58:42.605914 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:42.605775 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcc85" event={"ID":"d1f0c999-550f-4957-a2e4-9ef903418850","Type":"ContainerDied","Data":"b1a91568fbd3c98aebae35e6dd287b0227e0fb239aeeacd0a541fae29ab055f3"} Sep 13 19:58:43.403248 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:43.403219 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:43.403658 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:43.403313 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:43.403658 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:43.403357 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:43.403658 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:43.403405 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:43.403658 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:43.403433 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:43.403658 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:43.403504 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:44.612799 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:44.612763 2569 generic.go:356] "Generic (PLEG): container finished" podID="d1f0c999-550f-4957-a2e4-9ef903418850" containerID="4e7cd478200ac0f93eab1ae96668343e69dfa5c1e5fdb534341bec4563914678" exitCode=0 Sep 13 19:58:44.613400 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:44.612827 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcc85" event={"ID":"d1f0c999-550f-4957-a2e4-9ef903418850","Type":"ContainerDied","Data":"4e7cd478200ac0f93eab1ae96668343e69dfa5c1e5fdb534341bec4563914678"} Sep 13 19:58:45.402015 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:45.401978 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:45.402182 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:45.401978 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:45.402182 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:45.402086 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6bxm" podUID="a55d1f28-4449-4ae2-b6f0-1694970d30dd" Sep 13 19:58:45.402182 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:45.402105 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:45.402303 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:45.402193 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 19:58:45.402303 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:45.402283 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfsm9" podUID="d313ffdb-9c1c-442c-b9ed-06eb5b20ec99" Sep 13 19:58:47.059764 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.059725 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:47.060314 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.059804 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:47.060314 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.059913 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:47.060314 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.059987 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 19:59:19.059965619 +0000 UTC m=+66.173113687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:58:47.060314 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.060016 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:58:47.060314 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.060042 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:58:47.060314 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.060056 2569 projected.go:196] Error preparing data for projected volume kube-api-access-brrfm for pod openshift-network-diagnostics/network-check-target-d6bxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:47.060314 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.060112 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm podName:a55d1f28-4449-4ae2-b6f0-1694970d30dd nodeName:}" failed. No retries permitted until 2026-09-13 19:59:19.060096431 +0000 UTC m=+66.173244506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-brrfm" (UniqueName: "kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm") pod "network-check-target-d6bxm" (UID: "a55d1f28-4449-4ae2-b6f0-1694970d30dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:58:47.160985 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.160889 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:47.161175 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.161060 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:47.161175 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.161136 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret podName:d313ffdb-9c1c-442c-b9ed-06eb5b20ec99 nodeName:}" failed. No retries permitted until 2026-09-13 19:59:19.161119884 +0000 UTC m=+66.274267949 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret") pod "global-pull-secret-syncer-qfsm9" (UID: "d313ffdb-9c1c-442c-b9ed-06eb5b20ec99") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:58:47.187646 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.187611 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-113.ec2.internal" event="NodeReady" Sep 13 19:58:47.187846 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.187785 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 13 19:58:47.219561 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.219524 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5"] Sep 13 19:58:47.222783 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.222756 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d46487cf9-z4l8j"] Sep 13 19:58:47.222993 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.222909 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:47.225243 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.225213 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 13 19:58:47.225380 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.225248 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7xmgm\"" Sep 13 19:58:47.225589 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.225566 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 13 19:58:47.226563 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.226534 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.228792 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.228774 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 13 19:58:47.229289 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.229272 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 13 19:58:47.229381 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.229350 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 13 19:58:47.229443 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.229350 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fshcc\"" Sep 13 19:58:47.235251 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.235081 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 13 19:58:47.235609 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.235585 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5"] Sep 13 19:58:47.237071 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.236569 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sgjt2"] Sep 13 19:58:47.241713 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.241387 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f9s98"] Sep 13 19:58:47.241713 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.241591 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgjt2" Sep 13 19:58:47.244178 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.244110 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 13 19:58:47.244178 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.244152 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 13 19:58:47.244366 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.244349 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 13 19:58:47.244507 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.244488 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-stlr4\"" Sep 13 19:58:47.248350 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.248192 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d46487cf9-z4l8j"] Sep 13 19:58:47.248350 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.248327 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.248568 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.248508 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgjt2"] Sep 13 19:58:47.250562 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.250539 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pm8n4\"" Sep 13 19:58:47.250913 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.250771 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 13 19:58:47.251423 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.251404 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 13 19:58:47.254699 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.254673 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f9s98"] Sep 13 19:58:47.363364 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363268 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-image-registry-private-configuration\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.363364 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363311 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-registry-certificates\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.363364 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363333 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqd85\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-kube-api-access-xqd85\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.363580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/778172bd-98e3-4ca4-a15f-12b06c94ae66-config-volume\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.363580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363420 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.363580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363443 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778172bd-98e3-4ca4-a15f-12b06c94ae66-tmp-dir\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.363580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf4xr\" (UniqueName: \"kubernetes.io/projected/778172bd-98e3-4ca4-a15f-12b06c94ae66-kube-api-access-mf4xr\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.363580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363498 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28b67391-3565-4995-88db-bfcf87c81c1f-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:47.363580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363523 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-bound-sa-token\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.363580 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363563 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmz9j\" (UniqueName: \"kubernetes.io/projected/3b873e7a-1282-4602-9959-9208c4de4d7e-kube-api-access-lmz9j\") pod \"ingress-canary-sgjt2\" (UID: \"3b873e7a-1282-4602-9959-9208c4de4d7e\") " pod="openshift-ingress-canary/ingress-canary-sgjt2" Sep 13 19:58:47.363889 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363591 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e269525d-e500-44de-b654-b3a51ff70610-ca-trust-extracted\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.363889 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363610 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-trusted-ca\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.363889 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363638 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-installation-pull-secrets\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.363889 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363656 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b873e7a-1282-4602-9959-9208c4de4d7e-cert\") pod \"ingress-canary-sgjt2\" (UID: \"3b873e7a-1282-4602-9959-9208c4de4d7e\") " pod="openshift-ingress-canary/ingress-canary-sgjt2" Sep 13 19:58:47.363889 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363676 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:47.363889 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.363696 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.401758 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.401714 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:58:47.401758 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.401734 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:58:47.401758 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.401714 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:58:47.404536 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.404339 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 13 19:58:47.404536 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.404382 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bxmhk\"" Sep 13 19:58:47.404536 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.404390 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 13 19:58:47.404829 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.404601 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hvn9g\"" Sep 13 19:58:47.404829 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.404662 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 13 19:58:47.404829 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.404720 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 13 19:58:47.464482 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.464439 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmz9j\" (UniqueName: \"kubernetes.io/projected/3b873e7a-1282-4602-9959-9208c4de4d7e-kube-api-access-lmz9j\") pod \"ingress-canary-sgjt2\" (UID: \"3b873e7a-1282-4602-9959-9208c4de4d7e\") " pod="openshift-ingress-canary/ingress-canary-sgjt2" Sep 13 19:58:47.464678 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.464498 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e269525d-e500-44de-b654-b3a51ff70610-ca-trust-extracted\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.464678 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.464528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-trusted-ca\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.464678 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.464549 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-installation-pull-secrets\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.464678 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.464576 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b873e7a-1282-4602-9959-9208c4de4d7e-cert\") pod \"ingress-canary-sgjt2\" (UID: \"3b873e7a-1282-4602-9959-9208c4de4d7e\") " pod="openshift-ingress-canary/ingress-canary-sgjt2" Sep 13 19:58:47.465142 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465108 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:47.465269 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465162 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.465269 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465201 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e269525d-e500-44de-b654-b3a51ff70610-ca-trust-extracted\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.465269 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465235 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-image-registry-private-configuration\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.465437 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465274 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-registry-certificates\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.465437 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.465296 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 13 19:58:47.465437 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465304 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqd85\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-kube-api-access-xqd85\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.465437 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465327 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/778172bd-98e3-4ca4-a15f-12b06c94ae66-config-volume\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.465437 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.465349 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert podName:28b67391-3565-4995-88db-bfcf87c81c1f nodeName:}" failed. No retries permitted until 2026-09-13 19:58:47.965333304 +0000 UTC m=+35.078481376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-l7zs5" (UID: "28b67391-3565-4995-88db-bfcf87c81c1f") : secret "networking-console-plugin-cert" not found Sep 13 19:58:47.465437 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465383 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.465437 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465415 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778172bd-98e3-4ca4-a15f-12b06c94ae66-tmp-dir\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.465785 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465442 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf4xr\" (UniqueName: \"kubernetes.io/projected/778172bd-98e3-4ca4-a15f-12b06c94ae66-kube-api-access-mf4xr\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.465785 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28b67391-3565-4995-88db-bfcf87c81c1f-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:47.465785 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-bound-sa-token\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.465785 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465700 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-trusted-ca\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.466010 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.465806 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:58:47.466010 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.465854 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 19:58:47.466010 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.465871 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d46487cf9-z4l8j: secret "image-registry-tls" not found Sep 13 19:58:47.466010 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.465883 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls podName:778172bd-98e3-4ca4-a15f-12b06c94ae66 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:47.965865762 +0000 UTC m=+35.079013845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls") pod "dns-default-f9s98" (UID: "778172bd-98e3-4ca4-a15f-12b06c94ae66") : secret "dns-default-metrics-tls" not found Sep 13 19:58:47.466010 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.465885 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/778172bd-98e3-4ca4-a15f-12b06c94ae66-config-volume\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.466010 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.465913 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls podName:e269525d-e500-44de-b654-b3a51ff70610 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:47.965899677 +0000 UTC m=+35.079047749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls") pod "image-registry-6d46487cf9-z4l8j" (UID: "e269525d-e500-44de-b654-b3a51ff70610") : secret "image-registry-tls" not found Sep 13 19:58:47.466301 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.466208 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778172bd-98e3-4ca4-a15f-12b06c94ae66-tmp-dir\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.466397 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.466378 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-registry-certificates\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.466529 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.466510 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28b67391-3565-4995-88db-bfcf87c81c1f-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:47.470319 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.470293 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b873e7a-1282-4602-9959-9208c4de4d7e-cert\") pod \"ingress-canary-sgjt2\" (UID: \"3b873e7a-1282-4602-9959-9208c4de4d7e\") " pod="openshift-ingress-canary/ingress-canary-sgjt2" Sep 13 19:58:47.470443 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.470324 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-installation-pull-secrets\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.470443 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.470324 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-image-registry-private-configuration\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.473771 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.473739 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmz9j\" (UniqueName: \"kubernetes.io/projected/3b873e7a-1282-4602-9959-9208c4de4d7e-kube-api-access-lmz9j\") pod \"ingress-canary-sgjt2\" (UID: \"3b873e7a-1282-4602-9959-9208c4de4d7e\") " pod="openshift-ingress-canary/ingress-canary-sgjt2" Sep 13 19:58:47.474410 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.474387 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-bound-sa-token\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.474617 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.474588 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf4xr\" (UniqueName: \"kubernetes.io/projected/778172bd-98e3-4ca4-a15f-12b06c94ae66-kube-api-access-mf4xr\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.474720 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.474674 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqd85\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-kube-api-access-xqd85\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.557085 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.557049 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgjt2" Sep 13 19:58:47.849960 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.849697 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgjt2"] Sep 13 19:58:47.969419 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.969314 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:47.969419 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.969408 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:47.969655 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:47.969435 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:47.969655 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.969501 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 19:58:47.969655 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.969538 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d46487cf9-z4l8j: secret "image-registry-tls" not found Sep 13 19:58:47.969655 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.969556 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 13 19:58:47.969655 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.969568 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:58:47.969655 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.969606 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls podName:e269525d-e500-44de-b654-b3a51ff70610 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:48.969586253 +0000 UTC m=+36.082734314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls") pod "image-registry-6d46487cf9-z4l8j" (UID: "e269525d-e500-44de-b654-b3a51ff70610") : secret "image-registry-tls" not found Sep 13 19:58:47.969655 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.969625 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert podName:28b67391-3565-4995-88db-bfcf87c81c1f nodeName:}" failed. No retries permitted until 2026-09-13 19:58:48.969615178 +0000 UTC m=+36.082763241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-l7zs5" (UID: "28b67391-3565-4995-88db-bfcf87c81c1f") : secret "networking-console-plugin-cert" not found Sep 13 19:58:47.969655 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:47.969641 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls podName:778172bd-98e3-4ca4-a15f-12b06c94ae66 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:48.969632847 +0000 UTC m=+36.082780920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls") pod "dns-default-f9s98" (UID: "778172bd-98e3-4ca4-a15f-12b06c94ae66") : secret "dns-default-metrics-tls" not found Sep 13 19:58:48.979561 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:48.979526 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:48.980038 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:48.979593 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:48.980038 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:48.979613 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:48.980038 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:48.979695 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 19:58:48.980038 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:48.979719 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:58:48.980038 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:48.979727 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d46487cf9-z4l8j: secret "image-registry-tls" not found Sep 13 19:58:48.980038 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:48.979771 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls podName:778172bd-98e3-4ca4-a15f-12b06c94ae66 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:50.979758255 +0000 UTC m=+38.092906316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls") pod "dns-default-f9s98" (UID: "778172bd-98e3-4ca4-a15f-12b06c94ae66") : secret "dns-default-metrics-tls" not found Sep 13 19:58:48.980038 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:48.979695 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 13 19:58:48.980038 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:48.979805 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls podName:e269525d-e500-44de-b654-b3a51ff70610 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:50.979787846 +0000 UTC m=+38.092935927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls") pod "image-registry-6d46487cf9-z4l8j" (UID: "e269525d-e500-44de-b654-b3a51ff70610") : secret "image-registry-tls" not found Sep 13 19:58:48.980038 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:48.979887 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert podName:28b67391-3565-4995-88db-bfcf87c81c1f nodeName:}" failed. No retries permitted until 2026-09-13 19:58:50.979870369 +0000 UTC m=+38.093018435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-l7zs5" (UID: "28b67391-3565-4995-88db-bfcf87c81c1f") : secret "networking-console-plugin-cert" not found Sep 13 19:58:49.127247 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:58:49.127210 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b873e7a_1282_4602_9959_9208c4de4d7e.slice/crio-76a2d13203711697f6923ad6957ff3e38056a8a4a3c3130f2314b45ba36fe851 WatchSource:0}: Error finding container 76a2d13203711697f6923ad6957ff3e38056a8a4a3c3130f2314b45ba36fe851: Status 404 returned error can't find the container with id 76a2d13203711697f6923ad6957ff3e38056a8a4a3c3130f2314b45ba36fe851 Sep 13 19:58:49.628177 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:49.628143 2569 generic.go:356] "Generic (PLEG): container finished" podID="d1f0c999-550f-4957-a2e4-9ef903418850" containerID="49fea3fb03829fb67fe965eb6ba2f9605fc3abd56b7ce30e65be8bb24e519ef0" exitCode=0 Sep 13 19:58:49.628381 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:49.628236 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcc85" event={"ID":"d1f0c999-550f-4957-a2e4-9ef903418850","Type":"ContainerDied","Data":"49fea3fb03829fb67fe965eb6ba2f9605fc3abd56b7ce30e65be8bb24e519ef0"} Sep 13 19:58:49.629457 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:49.629439 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgjt2" event={"ID":"3b873e7a-1282-4602-9959-9208c4de4d7e","Type":"ContainerStarted","Data":"76a2d13203711697f6923ad6957ff3e38056a8a4a3c3130f2314b45ba36fe851"} Sep 13 19:58:50.634494 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:50.634457 2569 generic.go:356] "Generic (PLEG): container finished" podID="d1f0c999-550f-4957-a2e4-9ef903418850" containerID="383c7dbf54ea79cca37c322d79690fa444a2031d209b50c8b877424825c38e9e" exitCode=0 Sep 13 19:58:50.635168 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:50.634519 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcc85" event={"ID":"d1f0c999-550f-4957-a2e4-9ef903418850","Type":"ContainerDied","Data":"383c7dbf54ea79cca37c322d79690fa444a2031d209b50c8b877424825c38e9e"} Sep 13 19:58:51.001363 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:51.001272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:51.001363 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:51.001349 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:51.001588 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:51.001378 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:51.001588 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:51.001433 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 19:58:51.001588 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:51.001450 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d46487cf9-z4l8j: secret "image-registry-tls" not found Sep 13 19:58:51.001588 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:51.001487 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:58:51.001588 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:51.001509 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 13 19:58:51.001588 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:51.001521 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls podName:e269525d-e500-44de-b654-b3a51ff70610 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:55.001502545 +0000 UTC m=+42.114650626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls") pod "image-registry-6d46487cf9-z4l8j" (UID: "e269525d-e500-44de-b654-b3a51ff70610") : secret "image-registry-tls" not found Sep 13 19:58:51.001853 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:51.001599 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls podName:778172bd-98e3-4ca4-a15f-12b06c94ae66 nodeName:}" failed. No retries permitted until 2026-09-13 19:58:55.001576168 +0000 UTC m=+42.114724252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls") pod "dns-default-f9s98" (UID: "778172bd-98e3-4ca4-a15f-12b06c94ae66") : secret "dns-default-metrics-tls" not found Sep 13 19:58:51.001853 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:51.001622 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert podName:28b67391-3565-4995-88db-bfcf87c81c1f nodeName:}" failed. No retries permitted until 2026-09-13 19:58:55.001613052 +0000 UTC m=+42.114761114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-l7zs5" (UID: "28b67391-3565-4995-88db-bfcf87c81c1f") : secret "networking-console-plugin-cert" not found Sep 13 19:58:51.640089 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:51.639997 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcc85" event={"ID":"d1f0c999-550f-4957-a2e4-9ef903418850","Type":"ContainerStarted","Data":"e6d7fbe69821d726b6704705c163ca5b30404f76ada8b970579ec0e6ad96c59e"} Sep 13 19:58:51.660154 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:51.660102 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gcc85" podStartSLOduration=9.380272664 podStartE2EDuration="38.660085643s" totalImagesPullingTime="29.279812979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:51.65870493 +0000 UTC m=+38.771853035" watchObservedRunningTime="2026-09-13 19:58:51.660085643 +0000 UTC m=+38.773233725" Sep 13 19:58:52.644862 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:52.644655 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgjt2" event={"ID":"3b873e7a-1282-4602-9959-9208c4de4d7e","Type":"ContainerStarted","Data":"03303b3f918fb596beaa9b88ab7fdf339b027504b635b501a7c2295105fc14a4"} Sep 13 19:58:52.660034 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:52.659980 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sgjt2" podStartSLOduration=2.742996678 podStartE2EDuration="5.659961357s" totalImagesPullingTime="2.916964679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:58:52.658867789 +0000 UTC m=+39.772015883" watchObservedRunningTime="2026-09-13 19:58:52.659961357 +0000 UTC m=+39.773109476" Sep 13 19:58:55.031669 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:55.031630 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:58:55.031669 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:55.031670 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:58:55.032100 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:55.031788 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:58:55.032100 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:55.031794 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 13 19:58:55.032100 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:58:55.031829 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:58:55.032100 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:55.031866 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls podName:778172bd-98e3-4ca4-a15f-12b06c94ae66 nodeName:}" failed. No retries permitted until 2026-09-13 19:59:03.031848401 +0000 UTC m=+50.144996492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls") pod "dns-default-f9s98" (UID: "778172bd-98e3-4ca4-a15f-12b06c94ae66") : secret "dns-default-metrics-tls" not found Sep 13 19:58:55.032100 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:55.031888 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert podName:28b67391-3565-4995-88db-bfcf87c81c1f nodeName:}" failed. No retries permitted until 2026-09-13 19:59:03.03187955 +0000 UTC m=+50.145027617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-l7zs5" (UID: "28b67391-3565-4995-88db-bfcf87c81c1f") : secret "networking-console-plugin-cert" not found Sep 13 19:58:55.032100 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:55.031907 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 19:58:55.032100 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:55.031917 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d46487cf9-z4l8j: secret "image-registry-tls" not found Sep 13 19:58:55.032100 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:58:55.031951 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls podName:e269525d-e500-44de-b654-b3a51ff70610 nodeName:}" failed. No retries permitted until 2026-09-13 19:59:03.03193894 +0000 UTC m=+50.145087006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls") pod "image-registry-6d46487cf9-z4l8j" (UID: "e269525d-e500-44de-b654-b3a51ff70610") : secret "image-registry-tls" not found Sep 13 19:59:03.091595 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:03.091560 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:59:03.092099 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:03.091624 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:59:03.092099 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:03.091644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:59:03.092099 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:03.091742 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:59:03.092099 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:03.091745 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 13 19:59:03.092099 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:03.091791 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls podName:778172bd-98e3-4ca4-a15f-12b06c94ae66 nodeName:}" failed. No retries permitted until 2026-09-13 19:59:19.091778187 +0000 UTC m=+66.204926248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls") pod "dns-default-f9s98" (UID: "778172bd-98e3-4ca4-a15f-12b06c94ae66") : secret "dns-default-metrics-tls" not found Sep 13 19:59:03.092099 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:03.091828 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert podName:28b67391-3565-4995-88db-bfcf87c81c1f nodeName:}" failed. No retries permitted until 2026-09-13 19:59:19.091797221 +0000 UTC m=+66.204945285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-l7zs5" (UID: "28b67391-3565-4995-88db-bfcf87c81c1f") : secret "networking-console-plugin-cert" not found Sep 13 19:59:03.092099 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:03.091753 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 19:59:03.092099 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:03.091842 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d46487cf9-z4l8j: secret "image-registry-tls" not found Sep 13 19:59:03.092099 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:03.091864 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls podName:e269525d-e500-44de-b654-b3a51ff70610 nodeName:}" failed. No retries permitted until 2026-09-13 19:59:19.091857579 +0000 UTC m=+66.205005639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls") pod "image-registry-6d46487cf9-z4l8j" (UID: "e269525d-e500-44de-b654-b3a51ff70610") : secret "image-registry-tls" not found Sep 13 19:59:12.625583 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:12.625551 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bhcvh" Sep 13 19:59:19.109098 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.109057 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 19:59:19.109098 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.109100 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.109123 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.109236 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:19.109288 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.109310 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:19.109369 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert podName:28b67391-3565-4995-88db-bfcf87c81c1f nodeName:}" failed. No retries permitted until 2026-09-13 19:59:51.109348425 +0000 UTC m=+98.222496492 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-l7zs5" (UID: "28b67391-3565-4995-88db-bfcf87c81c1f") : secret "networking-console-plugin-cert" not found Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:19.109385 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:19.109443 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls podName:778172bd-98e3-4ca4-a15f-12b06c94ae66 nodeName:}" failed. No retries permitted until 2026-09-13 19:59:51.10942982 +0000 UTC m=+98.222577887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls") pod "dns-default-f9s98" (UID: "778172bd-98e3-4ca4-a15f-12b06c94ae66") : secret "dns-default-metrics-tls" not found Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:19.109388 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:19.109465 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d46487cf9-z4l8j: secret "image-registry-tls" not found Sep 13 19:59:19.109601 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:19.109494 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls podName:e269525d-e500-44de-b654-b3a51ff70610 nodeName:}" failed. No retries permitted until 2026-09-13 19:59:51.109487049 +0000 UTC m=+98.222635113 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls") pod "image-registry-6d46487cf9-z4l8j" (UID: "e269525d-e500-44de-b654-b3a51ff70610") : secret "image-registry-tls" not found Sep 13 19:59:19.111635 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.111620 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 13 19:59:19.111876 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.111864 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 13 19:59:19.119707 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:19.119691 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 19:59:19.119759 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:19.119740 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 20:00:23.119726254 +0000 UTC m=+130.232874314 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : secret "metrics-daemon-secret" not found Sep 13 19:59:19.121443 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.121430 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 13 19:59:19.133744 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.133716 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brrfm\" (UniqueName: \"kubernetes.io/projected/a55d1f28-4449-4ae2-b6f0-1694970d30dd-kube-api-access-brrfm\") pod \"network-check-target-d6bxm\" (UID: \"a55d1f28-4449-4ae2-b6f0-1694970d30dd\") " pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:59:19.209864 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.209827 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:59:19.212557 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.212541 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 13 19:59:19.217401 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.217387 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bxmhk\"" Sep 13 19:59:19.222224 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.222209 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d313ffdb-9c1c-442c-b9ed-06eb5b20ec99-original-pull-secret\") pod \"global-pull-secret-syncer-qfsm9\" (UID: \"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99\") " pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:59:19.226161 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.226139 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:59:19.228433 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.228416 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfsm9" Sep 13 19:59:19.526517 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.526444 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d6bxm"] Sep 13 19:59:19.529612 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:59:19.529583 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55d1f28_4449_4ae2_b6f0_1694970d30dd.slice/crio-66e436b8de8b730575dbc3af4d07e2b02fc78695822b5935b227292c518c6ec0 WatchSource:0}: Error finding container 66e436b8de8b730575dbc3af4d07e2b02fc78695822b5935b227292c518c6ec0: Status 404 returned error can't find the container with id 66e436b8de8b730575dbc3af4d07e2b02fc78695822b5935b227292c518c6ec0 Sep 13 19:59:19.547618 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.547590 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qfsm9"] Sep 13 19:59:19.551761 ip-10-0-142-113 kubenswrapper[2569]: W0913 19:59:19.551736 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd313ffdb_9c1c_442c_b9ed_06eb5b20ec99.slice/crio-d515c803e37556b39bf7cef6d703bb8d9121a030d38c8405abe6f6f1a5fb9df4 WatchSource:0}: Error finding container d515c803e37556b39bf7cef6d703bb8d9121a030d38c8405abe6f6f1a5fb9df4: Status 404 returned error can't find the container with id d515c803e37556b39bf7cef6d703bb8d9121a030d38c8405abe6f6f1a5fb9df4 Sep 13 19:59:19.711867 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.711830 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d6bxm" event={"ID":"a55d1f28-4449-4ae2-b6f0-1694970d30dd","Type":"ContainerStarted","Data":"66e436b8de8b730575dbc3af4d07e2b02fc78695822b5935b227292c518c6ec0"} Sep 13 19:59:19.712863 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:19.712838 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qfsm9" event={"ID":"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99","Type":"ContainerStarted","Data":"d515c803e37556b39bf7cef6d703bb8d9121a030d38c8405abe6f6f1a5fb9df4"} Sep 13 19:59:24.727400 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:24.727362 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qfsm9" event={"ID":"d313ffdb-9c1c-442c-b9ed-06eb5b20ec99","Type":"ContainerStarted","Data":"72cc75460f7e4047c9fe7d33a531577ed394574fd5ca6675e461a22e52c8207a"} Sep 13 19:59:24.728845 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:24.728806 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d6bxm" event={"ID":"a55d1f28-4449-4ae2-b6f0-1694970d30dd","Type":"ContainerStarted","Data":"db91dea2292c1b8ffb10eb8468dceea74d374a99c93b936dca0ab203c85c4ed9"} Sep 13 19:59:24.728968 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:24.728956 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 19:59:24.740396 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:24.740352 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qfsm9" podStartSLOduration=66.024853507 podStartE2EDuration="1m10.740338285s" totalImagesPullingTime="4.715484778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:59:24.740305991 +0000 UTC m=+71.853454075" watchObservedRunningTime="2026-09-13 19:59:24.740338285 +0000 UTC m=+71.853486419" Sep 13 19:59:24.752701 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:24.752655 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d6bxm" podStartSLOduration=67.019613603 podStartE2EDuration="1m11.752642449s" totalImagesPullingTime="4.733028846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:59:24.752245664 +0000 UTC m=+71.865393746" watchObservedRunningTime="2026-09-13 19:59:24.752642449 +0000 UTC m=+71.865790526" Sep 13 19:59:51.147115 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:51.147057 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 19:59:51.147115 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:51.147115 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 19:59:51.147702 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:51.147172 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 19:59:51.147702 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:51.147227 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 13 19:59:51.147702 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:51.147279 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:59:51.147702 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:51.147306 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert podName:28b67391-3565-4995-88db-bfcf87c81c1f nodeName:}" failed. No retries permitted until 2026-09-13 20:00:55.147289593 +0000 UTC m=+162.260437654 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-l7zs5" (UID: "28b67391-3565-4995-88db-bfcf87c81c1f") : secret "networking-console-plugin-cert" not found Sep 13 19:59:51.147702 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:51.147305 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 19:59:51.147702 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:51.147321 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d46487cf9-z4l8j: secret "image-registry-tls" not found Sep 13 19:59:51.147702 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:51.147340 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls podName:778172bd-98e3-4ca4-a15f-12b06c94ae66 nodeName:}" failed. No retries permitted until 2026-09-13 20:00:55.14732669 +0000 UTC m=+162.260474750 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls") pod "dns-default-f9s98" (UID: "778172bd-98e3-4ca4-a15f-12b06c94ae66") : secret "dns-default-metrics-tls" not found Sep 13 19:59:51.147702 ip-10-0-142-113 kubenswrapper[2569]: E0913 19:59:51.147353 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls podName:e269525d-e500-44de-b654-b3a51ff70610 nodeName:}" failed. No retries permitted until 2026-09-13 20:00:55.147347677 +0000 UTC m=+162.260495737 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls") pod "image-registry-6d46487cf9-z4l8j" (UID: "e269525d-e500-44de-b654-b3a51ff70610") : secret "image-registry-tls" not found Sep 13 19:59:55.734341 ip-10-0-142-113 kubenswrapper[2569]: I0913 19:59:55.734308 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d6bxm" Sep 13 20:00:23.184799 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:00:23.184745 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 20:00:23.185302 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:23.184908 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 20:00:23.185302 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:23.184984 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:25.184968842 +0000 UTC m=+252.298116903 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : secret "metrics-daemon-secret" not found Sep 13 20:00:50.237462 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:50.237410 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" podUID="28b67391-3565-4995-88db-bfcf87c81c1f" Sep 13 20:00:50.244615 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:50.244588 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" podUID="e269525d-e500-44de-b654-b3a51ff70610" Sep 13 20:00:50.263845 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:50.263776 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f9s98" podUID="778172bd-98e3-4ca4-a15f-12b06c94ae66" Sep 13 20:00:50.421844 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:50.421771 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 20:00:50.939584 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:00:50.939552 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9s98" Sep 13 20:00:50.939785 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:00:50.939552 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:00:50.939785 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:00:50.939552 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 20:00:55.203511 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:00:55.203456 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:00:55.203921 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:00:55.203529 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 20:00:55.203921 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:00:55.203548 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 20:00:55.203921 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:55.203620 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 20:00:55.203921 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:55.203640 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d46487cf9-z4l8j: secret "image-registry-tls" not found Sep 13 20:00:55.203921 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:55.203644 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:00:55.203921 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:55.203677 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 13 20:00:55.203921 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:55.203706 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls podName:778172bd-98e3-4ca4-a15f-12b06c94ae66 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:57.203692033 +0000 UTC m=+284.316840094 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls") pod "dns-default-f9s98" (UID: "778172bd-98e3-4ca4-a15f-12b06c94ae66") : secret "dns-default-metrics-tls" not found Sep 13 20:00:55.203921 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:55.203740 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls podName:e269525d-e500-44de-b654-b3a51ff70610 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:57.203716197 +0000 UTC m=+284.316864291 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls") pod "image-registry-6d46487cf9-z4l8j" (UID: "e269525d-e500-44de-b654-b3a51ff70610") : secret "image-registry-tls" not found Sep 13 20:00:55.203921 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:00:55.203758 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert podName:28b67391-3565-4995-88db-bfcf87c81c1f nodeName:}" failed. No retries permitted until 2026-09-13 20:02:57.203751313 +0000 UTC m=+284.316899375 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-l7zs5" (UID: "28b67391-3565-4995-88db-bfcf87c81c1f") : secret "networking-console-plugin-cert" not found Sep 13 20:01:01.402406 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:01:01.402369 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 20:02:25.244247 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:25.244203 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 20:02:25.244737 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:25.244354 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 20:02:25.244737 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:25.244415 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs podName:8579a980-87c8-459e-90c7-d81ac524a9e6 nodeName:}" failed. No retries permitted until 2026-09-13 20:04:27.244400456 +0000 UTC m=+374.357548517 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs") pod "network-metrics-daemon-7lwvg" (UID: "8579a980-87c8-459e-90c7-d81ac524a9e6") : secret "metrics-daemon-secret" not found Sep 13 20:02:36.661069 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.660988 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl"] Sep 13 20:02:36.662967 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.662942 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5"] Sep 13 20:02:36.663071 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.663060 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.664857 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.664840 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9"] Sep 13 20:02:36.664961 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.664939 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:36.665301 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.665280 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 13 20:02:36.666056 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.666038 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 13 20:02:36.666137 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.666056 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vq6vp\"" Sep 13 20:02:36.666137 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.666056 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:02:36.666379 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.666365 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 13 20:02:36.666508 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.666494 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz"] Sep 13 20:02:36.666635 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.666618 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:36.667088 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.667068 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:02:36.667421 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.667405 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 13 20:02:36.667421 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.667418 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-brjkc\"" Sep 13 20:02:36.667733 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.667720 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 13 20:02:36.668356 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.668343 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86c6dbdcb8-7qsmg"] Sep 13 20:02:36.668490 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.668477 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.669718 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.669701 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 13 20:02:36.669981 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.669962 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 13 20:02:36.670067 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.669962 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 13 20:02:36.671117 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.671021 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.671559 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.671538 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 13 20:02:36.671655 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.671609 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 13 20:02:36.671655 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.671618 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 13 20:02:36.671655 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.671609 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lm8s8\"" Sep 13 20:02:36.671655 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.671639 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 13 20:02:36.671902 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.671678 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dg9t6\"" Sep 13 20:02:36.671902 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.671848 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:02:36.674055 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.674027 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fmn4t\"" Sep 13 20:02:36.674119 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.674071 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 13 20:02:36.674449 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.674436 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 13 20:02:36.674753 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.674736 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 13 20:02:36.675168 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.675151 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 13 20:02:36.675168 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.675164 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 13 20:02:36.675269 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.675167 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 13 20:02:36.687146 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.686797 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl"] Sep 13 20:02:36.687585 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.687567 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86c6dbdcb8-7qsmg"] Sep 13 20:02:36.688886 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.688865 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5"] Sep 13 20:02:36.689739 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.689719 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz"] Sep 13 20:02:36.699016 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.698996 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9"] Sep 13 20:02:36.725654 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725624 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/91f08fdb-d699-4ac6-b31a-705cacd93db1-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:36.725654 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725652 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.725884 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725679 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aac11b22-2b23-4f02-8280-e4fda90b474e-config\") pod \"service-ca-operator-cf7c776b7-s2gkl\" (UID: \"aac11b22-2b23-4f02-8280-e4fda90b474e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.725884 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725723 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.725884 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725762 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpzmj\" (UniqueName: \"kubernetes.io/projected/91f08fdb-d699-4ac6-b31a-705cacd93db1-kube-api-access-fpzmj\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:36.725884 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725794 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:36.725884 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725827 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl8dd\" (UniqueName: \"kubernetes.io/projected/d5af9e8a-b292-4aff-9a30-3363c02858ab-kube-api-access-wl8dd\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:36.725884 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725845 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-nq7dz\" (UID: \"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.725884 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725863 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-stats-auth\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.726216 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725916 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ggn9\" (UniqueName: \"kubernetes.io/projected/aac11b22-2b23-4f02-8280-e4fda90b474e-kube-api-access-4ggn9\") pod \"service-ca-operator-cf7c776b7-s2gkl\" (UID: \"aac11b22-2b23-4f02-8280-e4fda90b474e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.726216 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.725969 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aac11b22-2b23-4f02-8280-e4fda90b474e-serving-cert\") pod \"service-ca-operator-cf7c776b7-s2gkl\" (UID: \"aac11b22-2b23-4f02-8280-e4fda90b474e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.726216 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.726022 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-default-certificate\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.726216 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.726046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4dhz\" (UniqueName: \"kubernetes.io/projected/7704f8cb-d331-48b5-9a17-dde4d3d33af5-kube-api-access-c4dhz\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.726216 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.726070 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-nq7dz\" (UID: \"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.726216 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.726099 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttv79\" (UniqueName: \"kubernetes.io/projected/e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6-kube-api-access-ttv79\") pod \"kube-storage-version-migrator-operator-6c8f84f897-nq7dz\" (UID: \"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.726216 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.726125 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:36.826912 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.826880 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ggn9\" (UniqueName: \"kubernetes.io/projected/aac11b22-2b23-4f02-8280-e4fda90b474e-kube-api-access-4ggn9\") pod \"service-ca-operator-cf7c776b7-s2gkl\" (UID: \"aac11b22-2b23-4f02-8280-e4fda90b474e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.826912 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.826915 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aac11b22-2b23-4f02-8280-e4fda90b474e-serving-cert\") pod \"service-ca-operator-cf7c776b7-s2gkl\" (UID: \"aac11b22-2b23-4f02-8280-e4fda90b474e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.827116 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.826948 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-default-certificate\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.827116 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827063 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4dhz\" (UniqueName: \"kubernetes.io/projected/7704f8cb-d331-48b5-9a17-dde4d3d33af5-kube-api-access-c4dhz\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.827116 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827096 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-nq7dz\" (UID: \"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.827244 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827131 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttv79\" (UniqueName: \"kubernetes.io/projected/e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6-kube-api-access-ttv79\") pod \"kube-storage-version-migrator-operator-6c8f84f897-nq7dz\" (UID: \"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.827244 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827161 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:36.827244 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827214 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/91f08fdb-d699-4ac6-b31a-705cacd93db1-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:36.827393 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827261 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.827393 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827319 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aac11b22-2b23-4f02-8280-e4fda90b474e-config\") pod \"service-ca-operator-cf7c776b7-s2gkl\" (UID: \"aac11b22-2b23-4f02-8280-e4fda90b474e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.827393 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827351 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.827535 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827394 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpzmj\" (UniqueName: \"kubernetes.io/projected/91f08fdb-d699-4ac6-b31a-705cacd93db1-kube-api-access-fpzmj\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:36.827535 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:36.827323 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:36.827535 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827439 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:36.827535 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:36.827466 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls podName:91f08fdb-d699-4ac6-b31a-705cacd93db1 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:37.32744791 +0000 UTC m=+264.440595979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zc2h9" (UID: "91f08fdb-d699-4ac6-b31a-705cacd93db1") : secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:36.827535 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl8dd\" (UniqueName: \"kubernetes.io/projected/d5af9e8a-b292-4aff-9a30-3363c02858ab-kube-api-access-wl8dd\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:36.827535 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-nq7dz\" (UID: \"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.827535 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:36.827531 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:02:36.827909 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827554 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-stats-auth\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.827909 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:36.827582 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls podName:d5af9e8a-b292-4aff-9a30-3363c02858ab nodeName:}" failed. No retries permitted until 2026-09-13 20:02:37.327565817 +0000 UTC m=+264.440713879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8z4p5" (UID: "d5af9e8a-b292-4aff-9a30-3363c02858ab") : secret "samples-operator-tls" not found Sep 13 20:02:36.827909 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:36.827696 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:37.327685427 +0000 UTC m=+264.440833489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : configmap references non-existent config key: service-ca.crt Sep 13 20:02:36.828068 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827930 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aac11b22-2b23-4f02-8280-e4fda90b474e-config\") pod \"service-ca-operator-cf7c776b7-s2gkl\" (UID: \"aac11b22-2b23-4f02-8280-e4fda90b474e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.828068 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:36.827397 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 13 20:02:36.828068 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.827981 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/91f08fdb-d699-4ac6-b31a-705cacd93db1-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:36.828068 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:36.828017 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:37.328001105 +0000 UTC m=+264.441149182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : secret "router-metrics-certs-default" not found Sep 13 20:02:36.828406 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.828389 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-nq7dz\" (UID: \"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.829786 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.829765 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aac11b22-2b23-4f02-8280-e4fda90b474e-serving-cert\") pod \"service-ca-operator-cf7c776b7-s2gkl\" (UID: \"aac11b22-2b23-4f02-8280-e4fda90b474e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.829974 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.829953 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-nq7dz\" (UID: \"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.830110 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.830094 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-stats-auth\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.830153 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.830140 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-default-certificate\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.834792 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.834767 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4dhz\" (UniqueName: \"kubernetes.io/projected/7704f8cb-d331-48b5-9a17-dde4d3d33af5-kube-api-access-c4dhz\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:36.835865 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.835843 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpzmj\" (UniqueName: \"kubernetes.io/projected/91f08fdb-d699-4ac6-b31a-705cacd93db1-kube-api-access-fpzmj\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:36.836371 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.836316 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ggn9\" (UniqueName: \"kubernetes.io/projected/aac11b22-2b23-4f02-8280-e4fda90b474e-kube-api-access-4ggn9\") pod \"service-ca-operator-cf7c776b7-s2gkl\" (UID: \"aac11b22-2b23-4f02-8280-e4fda90b474e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.836506 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.836486 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttv79\" (UniqueName: \"kubernetes.io/projected/e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6-kube-api-access-ttv79\") pod \"kube-storage-version-migrator-operator-6c8f84f897-nq7dz\" (UID: \"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:36.837115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.837099 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl8dd\" (UniqueName: \"kubernetes.io/projected/d5af9e8a-b292-4aff-9a30-3363c02858ab-kube-api-access-wl8dd\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:36.974485 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.974401 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" Sep 13 20:02:36.991563 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:36.991533 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" Sep 13 20:02:37.244895 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:37.244353 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl"] Sep 13 20:02:37.249770 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:02:37.249727 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac11b22_2b23_4f02_8280_e4fda90b474e.slice/crio-3364eb4975c6ca9a5fe269f73a3e188443710effe3138480f7f4c86d83986f9b WatchSource:0}: Error finding container 3364eb4975c6ca9a5fe269f73a3e188443710effe3138480f7f4c86d83986f9b: Status 404 returned error can't find the container with id 3364eb4975c6ca9a5fe269f73a3e188443710effe3138480f7f4c86d83986f9b Sep 13 20:02:37.264007 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:37.263976 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz"] Sep 13 20:02:37.266951 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:02:37.266925 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b8cef0_b6ab_4c71_b0e4_dd9f14d46de6.slice/crio-865b0900037bcf7100449c0d8813067069df86578fa5e6f42e02cb70fe78a8c1 WatchSource:0}: Error finding container 865b0900037bcf7100449c0d8813067069df86578fa5e6f42e02cb70fe78a8c1: Status 404 returned error can't find the container with id 865b0900037bcf7100449c0d8813067069df86578fa5e6f42e02cb70fe78a8c1 Sep 13 20:02:37.331722 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:37.331681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:37.331924 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:37.331742 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:37.331924 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:37.331790 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:37.331924 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:37.331857 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:37.331924 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:37.331879 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:37.331924 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:37.331898 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 13 20:02:37.332111 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:37.331962 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:02:37.332111 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:37.331965 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls podName:91f08fdb-d699-4ac6-b31a-705cacd93db1 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:38.331945393 +0000 UTC m=+265.445093474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zc2h9" (UID: "91f08fdb-d699-4ac6-b31a-705cacd93db1") : secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:37.332111 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:37.332008 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:38.331997562 +0000 UTC m=+265.445145638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : secret "router-metrics-certs-default" not found Sep 13 20:02:37.332111 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:37.332022 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:38.332013498 +0000 UTC m=+265.445161559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : configmap references non-existent config key: service-ca.crt Sep 13 20:02:37.332111 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:37.332034 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls podName:d5af9e8a-b292-4aff-9a30-3363c02858ab nodeName:}" failed. No retries permitted until 2026-09-13 20:02:38.332027198 +0000 UTC m=+265.445175260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8z4p5" (UID: "d5af9e8a-b292-4aff-9a30-3363c02858ab") : secret "samples-operator-tls" not found Sep 13 20:02:38.197830 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:38.197778 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" event={"ID":"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6","Type":"ContainerStarted","Data":"865b0900037bcf7100449c0d8813067069df86578fa5e6f42e02cb70fe78a8c1"} Sep 13 20:02:38.199320 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:38.199244 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" event={"ID":"aac11b22-2b23-4f02-8280-e4fda90b474e","Type":"ContainerStarted","Data":"3364eb4975c6ca9a5fe269f73a3e188443710effe3138480f7f4c86d83986f9b"} Sep 13 20:02:38.338713 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:38.338671 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:38.338898 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:38.338789 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:38.338957 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:38.338897 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:38.339008 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:38.338952 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:02:38.339045 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:38.339019 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls podName:d5af9e8a-b292-4aff-9a30-3363c02858ab nodeName:}" failed. No retries permitted until 2026-09-13 20:02:40.33899986 +0000 UTC m=+267.452147941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8z4p5" (UID: "d5af9e8a-b292-4aff-9a30-3363c02858ab") : secret "samples-operator-tls" not found Sep 13 20:02:38.339045 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:38.339037 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:40.339027908 +0000 UTC m=+267.452175983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : configmap references non-existent config key: service-ca.crt Sep 13 20:02:38.339045 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:38.338956 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:38.339196 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:38.339039 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:38.339196 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:38.339118 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls podName:91f08fdb-d699-4ac6-b31a-705cacd93db1 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:40.339106339 +0000 UTC m=+267.452254405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zc2h9" (UID: "91f08fdb-d699-4ac6-b31a-705cacd93db1") : secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:38.339196 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:38.339065 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 13 20:02:38.339196 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:38.339152 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:40.33914482 +0000 UTC m=+267.452292886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : secret "router-metrics-certs-default" not found Sep 13 20:02:40.206529 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.206486 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" event={"ID":"aac11b22-2b23-4f02-8280-e4fda90b474e","Type":"ContainerStarted","Data":"9231c964314dd3c2661c43e0118a5390510c6fa9ff6d6c3925aa86d4f76fc19e"} Sep 13 20:02:40.208028 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.208001 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" event={"ID":"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6","Type":"ContainerStarted","Data":"011fbd60c2c6c691e9581adf24dfe5706255acf35f8d9dfb4278c4f20beb42f9"} Sep 13 20:02:40.222889 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.222835 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" podStartSLOduration=1.7679408269999999 podStartE2EDuration="4.222802005s" totalImagesPullingTime="2.454861178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:02:40.222429056 +0000 UTC m=+267.335577129" watchObservedRunningTime="2026-09-13 20:02:40.222802005 +0000 UTC m=+267.335950088" Sep 13 20:02:40.236407 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.236250 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" podStartSLOduration=1.798593884 podStartE2EDuration="4.236226271s" totalImagesPullingTime="2.437632387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:02:40.235947482 +0000 UTC m=+267.349095568" watchObservedRunningTime="2026-09-13 20:02:40.236226271 +0000 UTC m=+267.349374355" Sep 13 20:02:40.356480 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.356447 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:40.356665 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.356502 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:40.356665 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.356540 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:40.356665 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.356572 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:40.356665 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:40.356601 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 13 20:02:40.356665 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:40.356665 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:44.35664859 +0000 UTC m=+271.469796661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : secret "router-metrics-certs-default" not found Sep 13 20:02:40.356940 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:40.356667 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:40.356940 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:40.356688 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:44.356671501 +0000 UTC m=+271.469819587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : configmap references non-existent config key: service-ca.crt Sep 13 20:02:40.356940 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:40.356726 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls podName:91f08fdb-d699-4ac6-b31a-705cacd93db1 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:44.356711793 +0000 UTC m=+271.469859859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zc2h9" (UID: "91f08fdb-d699-4ac6-b31a-705cacd93db1") : secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:40.356940 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:40.356672 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:02:40.356940 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:40.356770 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls podName:d5af9e8a-b292-4aff-9a30-3363c02858ab nodeName:}" failed. No retries permitted until 2026-09-13 20:02:44.356761458 +0000 UTC m=+271.469909522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8z4p5" (UID: "d5af9e8a-b292-4aff-9a30-3363c02858ab") : secret "samples-operator-tls" not found Sep 13 20:02:40.933994 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.933957 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m74g8"] Sep 13 20:02:40.936106 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.936081 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:40.938468 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.938424 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 13 20:02:40.938468 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.938441 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 13 20:02:40.939581 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.939557 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 13 20:02:40.939685 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.939566 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 13 20:02:40.939685 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.939610 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dlf6m\"" Sep 13 20:02:40.949490 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:40.949460 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m74g8"] Sep 13 20:02:41.062419 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.062381 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31c2b737-47a9-48ab-a8e5-df78d3548ec7-data-volume\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.062617 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.062435 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31c2b737-47a9-48ab-a8e5-df78d3548ec7-crio-socket\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.062617 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.062548 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.062617 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.062589 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54n2q\" (UniqueName: \"kubernetes.io/projected/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-api-access-54n2q\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.062739 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.062629 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.163828 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.163768 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31c2b737-47a9-48ab-a8e5-df78d3548ec7-data-volume\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.163996 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.163948 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31c2b737-47a9-48ab-a8e5-df78d3548ec7-crio-socket\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.164056 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.164044 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31c2b737-47a9-48ab-a8e5-df78d3548ec7-crio-socket\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.164092 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.164072 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.164150 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.164135 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54n2q\" (UniqueName: \"kubernetes.io/projected/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-api-access-54n2q\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.164196 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.164182 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.164231 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.164191 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31c2b737-47a9-48ab-a8e5-df78d3548ec7-data-volume\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.164231 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:41.164217 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:02:41.164292 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:41.164275 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:41.664256065 +0000 UTC m=+268.777404156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : secret "insights-runtime-extractor-tls" not found Sep 13 20:02:41.164292 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:41.164278 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:02:41.164361 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:41.164330 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:41.664315504 +0000 UTC m=+268.777463565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : configmap "kube-rbac-proxy" not found Sep 13 20:02:41.172305 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.172276 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54n2q\" (UniqueName: \"kubernetes.io/projected/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-api-access-54n2q\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.669341 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.669302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.669722 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:41.669380 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:41.669722 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:41.669459 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:02:41.669722 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:41.669473 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:02:41.669722 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:41.669527 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:42.669513271 +0000 UTC m=+269.782661483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : configmap "kube-rbac-proxy" not found Sep 13 20:02:41.669722 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:41.669543 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:42.669536811 +0000 UTC m=+269.782684871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : secret "insights-runtime-extractor-tls" not found Sep 13 20:02:42.680103 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:42.680059 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:42.680479 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:42.680183 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:02:42.680479 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:42.680199 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:42.680479 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:42.680267 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:44.680250053 +0000 UTC m=+271.793398115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : configmap "kube-rbac-proxy" not found Sep 13 20:02:42.680479 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:42.680353 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:02:42.680479 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:42.680415 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:44.680398733 +0000 UTC m=+271.793546810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : secret "insights-runtime-extractor-tls" not found Sep 13 20:02:43.535983 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.535955 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-vgg6l"] Sep 13 20:02:43.538055 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.538035 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.540545 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.540527 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 13 20:02:43.540645 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.540529 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 13 20:02:43.540645 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.540574 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 13 20:02:43.541848 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.541831 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rrjrf\"" Sep 13 20:02:43.541947 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.541878 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 13 20:02:43.545967 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.545944 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-vgg6l"] Sep 13 20:02:43.587659 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.587623 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ce99925-2340-4268-b7a6-b1a8ceaca78e-signing-key\") pod \"service-ca-568869fdc5-vgg6l\" (UID: \"2ce99925-2340-4268-b7a6-b1a8ceaca78e\") " pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.587844 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.587805 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6wkj\" (UniqueName: \"kubernetes.io/projected/2ce99925-2340-4268-b7a6-b1a8ceaca78e-kube-api-access-v6wkj\") pod \"service-ca-568869fdc5-vgg6l\" (UID: \"2ce99925-2340-4268-b7a6-b1a8ceaca78e\") " pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.587885 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.587867 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ce99925-2340-4268-b7a6-b1a8ceaca78e-signing-cabundle\") pod \"service-ca-568869fdc5-vgg6l\" (UID: \"2ce99925-2340-4268-b7a6-b1a8ceaca78e\") " pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.688250 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.688219 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6wkj\" (UniqueName: \"kubernetes.io/projected/2ce99925-2340-4268-b7a6-b1a8ceaca78e-kube-api-access-v6wkj\") pod \"service-ca-568869fdc5-vgg6l\" (UID: \"2ce99925-2340-4268-b7a6-b1a8ceaca78e\") " pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.688661 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.688269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ce99925-2340-4268-b7a6-b1a8ceaca78e-signing-cabundle\") pod \"service-ca-568869fdc5-vgg6l\" (UID: \"2ce99925-2340-4268-b7a6-b1a8ceaca78e\") " pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.688661 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.688299 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ce99925-2340-4268-b7a6-b1a8ceaca78e-signing-key\") pod \"service-ca-568869fdc5-vgg6l\" (UID: \"2ce99925-2340-4268-b7a6-b1a8ceaca78e\") " pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.689038 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.689017 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ce99925-2340-4268-b7a6-b1a8ceaca78e-signing-cabundle\") pod \"service-ca-568869fdc5-vgg6l\" (UID: \"2ce99925-2340-4268-b7a6-b1a8ceaca78e\") " pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.690639 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.690621 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ce99925-2340-4268-b7a6-b1a8ceaca78e-signing-key\") pod \"service-ca-568869fdc5-vgg6l\" (UID: \"2ce99925-2340-4268-b7a6-b1a8ceaca78e\") " pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.698613 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.698588 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6wkj\" (UniqueName: \"kubernetes.io/projected/2ce99925-2340-4268-b7a6-b1a8ceaca78e-kube-api-access-v6wkj\") pod \"service-ca-568869fdc5-vgg6l\" (UID: \"2ce99925-2340-4268-b7a6-b1a8ceaca78e\") " pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:43.702741 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.702719 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ncgpc_a2b5801b-42a5-4419-841a-6411b1c69ffd/dns-node-resolver/0.log" Sep 13 20:02:43.847434 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:43.847336 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" Sep 13 20:02:44.115728 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.115639 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-vgg6l"] Sep 13 20:02:44.118821 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:02:44.118779 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce99925_2340_4268_b7a6_b1a8ceaca78e.slice/crio-5451887d277a14196857d51ed4273a4d59464ae3b788f450c7f5a96d7a1b52ad WatchSource:0}: Error finding container 5451887d277a14196857d51ed4273a4d59464ae3b788f450c7f5a96d7a1b52ad: Status 404 returned error can't find the container with id 5451887d277a14196857d51ed4273a4d59464ae3b788f450c7f5a96d7a1b52ad Sep 13 20:02:44.220596 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.220557 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" event={"ID":"2ce99925-2340-4268-b7a6-b1a8ceaca78e","Type":"ContainerStarted","Data":"8b41bda7c9dff8fbe9ca95aabad4f4ad68cc16b36ec7498f829aec71c68faede"} Sep 13 20:02:44.220596 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.220604 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" event={"ID":"2ce99925-2340-4268-b7a6-b1a8ceaca78e","Type":"ContainerStarted","Data":"5451887d277a14196857d51ed4273a4d59464ae3b788f450c7f5a96d7a1b52ad"} Sep 13 20:02:44.240208 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.240154 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-vgg6l" podStartSLOduration=1.240136263 podStartE2EDuration="1.240136263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:02:44.239532254 +0000 UTC m=+271.352680338" watchObservedRunningTime="2026-09-13 20:02:44.240136263 +0000 UTC m=+271.353284346" Sep 13 20:02:44.393874 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.393790 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:44.393874 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.393868 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:44.394098 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.393922 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:44.394098 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.393943 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 13 20:02:44.394098 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.394005 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:52.393986823 +0000 UTC m=+279.507134889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : secret "router-metrics-certs-default" not found Sep 13 20:02:44.394098 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.394042 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:02:44.394098 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.394044 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle podName:7704f8cb-d331-48b5-9a17-dde4d3d33af5 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:52.394022934 +0000 UTC m=+279.507171001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle") pod "router-default-86c6dbdcb8-7qsmg" (UID: "7704f8cb-d331-48b5-9a17-dde4d3d33af5") : configmap references non-existent config key: service-ca.crt Sep 13 20:02:44.394098 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.394075 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls podName:d5af9e8a-b292-4aff-9a30-3363c02858ab nodeName:}" failed. No retries permitted until 2026-09-13 20:02:52.394065433 +0000 UTC m=+279.507213524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8z4p5" (UID: "d5af9e8a-b292-4aff-9a30-3363c02858ab") : secret "samples-operator-tls" not found Sep 13 20:02:44.394098 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.394093 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:44.394325 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.394181 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:44.394325 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.394219 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls podName:91f08fdb-d699-4ac6-b31a-705cacd93db1 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:52.394209408 +0000 UTC m=+279.507357475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-zc2h9" (UID: "91f08fdb-d699-4ac6-b31a-705cacd93db1") : secret "cluster-monitoring-operator-tls" not found Sep 13 20:02:44.696894 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.696797 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:44.696894 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.696886 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:44.697287 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.696963 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:02:44.697287 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.696969 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:02:44.697287 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.697017 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:48.697003728 +0000 UTC m=+275.810151809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : configmap "kube-rbac-proxy" not found Sep 13 20:02:44.697287 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:44.697032 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:48.697026017 +0000 UTC m=+275.810174077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : secret "insights-runtime-extractor-tls" not found Sep 13 20:02:44.703854 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:44.703833 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7nqq_36d1e385-0377-4ed8-912d-2c5fdc1e7be6/node-ca/0.log" Sep 13 20:02:45.703087 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:45.703056 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgjt2_3b873e7a-1282-4602-9959-9208c4de4d7e/serve-healthcheck-canary/0.log" Sep 13 20:02:46.303624 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:46.303597 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-nq7dz_e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6/kube-storage-version-migrator-operator/0.log" Sep 13 20:02:48.729561 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:48.729515 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:48.729994 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:48.729592 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:48.729994 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:48.729687 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:02:48.729994 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:48.729690 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:02:48.729994 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:48.729751 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:56.729736613 +0000 UTC m=+283.842884687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : configmap "kube-rbac-proxy" not found Sep 13 20:02:48.729994 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:48.729764 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls podName:31c2b737-47a9-48ab-a8e5-df78d3548ec7 nodeName:}" failed. No retries permitted until 2026-09-13 20:02:56.729758224 +0000 UTC m=+283.842906284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m74g8" (UID: "31c2b737-47a9-48ab-a8e5-df78d3548ec7") : secret "insights-runtime-extractor-tls" not found Sep 13 20:02:52.464930 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.464855 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:52.465379 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.465053 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:52.465379 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.465105 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:52.465379 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.465172 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:52.465780 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.465755 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7704f8cb-d331-48b5-9a17-dde4d3d33af5-service-ca-bundle\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:52.467463 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.467435 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7704f8cb-d331-48b5-9a17-dde4d3d33af5-metrics-certs\") pod \"router-default-86c6dbdcb8-7qsmg\" (UID: \"7704f8cb-d331-48b5-9a17-dde4d3d33af5\") " pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:52.467566 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.467510 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91f08fdb-d699-4ac6-b31a-705cacd93db1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-zc2h9\" (UID: \"91f08fdb-d699-4ac6-b31a-705cacd93db1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:52.467566 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.467509 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5af9e8a-b292-4aff-9a30-3363c02858ab-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8z4p5\" (UID: \"d5af9e8a-b292-4aff-9a30-3363c02858ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:52.579390 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.579357 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" Sep 13 20:02:52.584158 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.584141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" Sep 13 20:02:52.596751 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.596726 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:52.852895 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.852873 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5"] Sep 13 20:02:52.877236 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.877216 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9"] Sep 13 20:02:52.879449 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:52.879422 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86c6dbdcb8-7qsmg"] Sep 13 20:02:52.882924 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:02:52.882896 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f08fdb_d699_4ac6_b31a_705cacd93db1.slice/crio-88fc79eb9e8c0e8b89c9efee99c9c703d256f913a534c6717d1f6d90633cdf03 WatchSource:0}: Error finding container 88fc79eb9e8c0e8b89c9efee99c9c703d256f913a534c6717d1f6d90633cdf03: Status 404 returned error can't find the container with id 88fc79eb9e8c0e8b89c9efee99c9c703d256f913a534c6717d1f6d90633cdf03 Sep 13 20:02:52.883197 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:02:52.883175 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7704f8cb_d331_48b5_9a17_dde4d3d33af5.slice/crio-fd5c3c8aef99696a06c16b7bbbc50f9da66338a98ed636db839031e27a394d84 WatchSource:0}: Error finding container fd5c3c8aef99696a06c16b7bbbc50f9da66338a98ed636db839031e27a394d84: Status 404 returned error can't find the container with id fd5c3c8aef99696a06c16b7bbbc50f9da66338a98ed636db839031e27a394d84 Sep 13 20:02:53.250427 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:53.250335 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" event={"ID":"d5af9e8a-b292-4aff-9a30-3363c02858ab","Type":"ContainerStarted","Data":"7cef4f5e8d362baa71a7f78d38183940250733aedd8c54eaa151999df6b57ed8"} Sep 13 20:02:53.251788 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:53.251759 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" event={"ID":"7704f8cb-d331-48b5-9a17-dde4d3d33af5","Type":"ContainerStarted","Data":"b4ee3dbdcc40fa3fd1c895d48dfcc160f4374febd65b4f644fc2edef4d745c05"} Sep 13 20:02:53.251921 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:53.251806 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" event={"ID":"7704f8cb-d331-48b5-9a17-dde4d3d33af5","Type":"ContainerStarted","Data":"fd5c3c8aef99696a06c16b7bbbc50f9da66338a98ed636db839031e27a394d84"} Sep 13 20:02:53.252897 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:53.252877 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" event={"ID":"91f08fdb-d699-4ac6-b31a-705cacd93db1","Type":"ContainerStarted","Data":"88fc79eb9e8c0e8b89c9efee99c9c703d256f913a534c6717d1f6d90633cdf03"} Sep 13 20:02:53.268467 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:53.268417 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" podStartSLOduration=17.268402582 podStartE2EDuration="17.268402582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:02:53.268286379 +0000 UTC m=+280.381434481" watchObservedRunningTime="2026-09-13 20:02:53.268402582 +0000 UTC m=+280.381550667" Sep 13 20:02:53.597766 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:53.597733 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:53.601365 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:53.601341 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:53.940975 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:53.940887 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" podUID="28b67391-3565-4995-88db-bfcf87c81c1f" Sep 13 20:02:53.940975 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:53.940887 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f9s98" podUID="778172bd-98e3-4ca4-a15f-12b06c94ae66" Sep 13 20:02:53.940975 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:02:53.940969 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" podUID="e269525d-e500-44de-b654-b3a51ff70610" Sep 13 20:02:54.256794 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:54.256722 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:02:54.256968 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:54.256727 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 20:02:54.256968 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:54.256725 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9s98" Sep 13 20:02:54.257267 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:54.257235 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:54.258386 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:54.258366 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86c6dbdcb8-7qsmg" Sep 13 20:02:55.262634 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:55.262588 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" event={"ID":"d5af9e8a-b292-4aff-9a30-3363c02858ab","Type":"ContainerStarted","Data":"e3eee5accf15f19d472a50d1008cdde480f2b933b66f61a8c885e8f10cc67a5c"} Sep 13 20:02:55.263140 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:55.262665 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" event={"ID":"d5af9e8a-b292-4aff-9a30-3363c02858ab","Type":"ContainerStarted","Data":"a092b779d9c2f748f115f2619fb11057124e9983abce5dd7c283da6582e4c664"} Sep 13 20:02:55.278572 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:55.278526 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8z4p5" podStartSLOduration=17.501880401 podStartE2EDuration="19.278510218s" totalImagesPullingTime="1.776629817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:02:55.277309723 +0000 UTC m=+282.390457822" watchObservedRunningTime="2026-09-13 20:02:55.278510218 +0000 UTC m=+282.391658301" Sep 13 20:02:56.266933 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:56.266899 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" event={"ID":"91f08fdb-d699-4ac6-b31a-705cacd93db1","Type":"ContainerStarted","Data":"6da3fb5e5e109f2ffe6e21dd6adecccf318f8f4fa42a5686aeb4d029bd453ab2"} Sep 13 20:02:56.281538 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:56.281488 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-zc2h9" podStartSLOduration=17.746753493 podStartE2EDuration="20.281471764s" totalImagesPullingTime="2.534718271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:02:56.280952846 +0000 UTC m=+283.394100930" watchObservedRunningTime="2026-09-13 20:02:56.281471764 +0000 UTC m=+283.394619848" Sep 13 20:02:56.801830 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:56.801775 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:56.802004 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:56.801924 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:56.802428 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:56.802398 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31c2b737-47a9-48ab-a8e5-df78d3548ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:56.804177 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:56.804151 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31c2b737-47a9-48ab-a8e5-df78d3548ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m74g8\" (UID: \"31c2b737-47a9-48ab-a8e5-df78d3548ec7\") " pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:56.845295 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:56.845269 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m74g8" Sep 13 20:02:57.112779 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.112700 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m74g8"] Sep 13 20:02:57.115683 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:02:57.115660 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c2b737_47a9_48ab_a8e5_df78d3548ec7.slice/crio-101b92c91e9e2a156e4fcfb6d509829baed6f6a8a20a7143a83052dd53bfc6e9 WatchSource:0}: Error finding container 101b92c91e9e2a156e4fcfb6d509829baed6f6a8a20a7143a83052dd53bfc6e9: Status 404 returned error can't find the container with id 101b92c91e9e2a156e4fcfb6d509829baed6f6a8a20a7143a83052dd53bfc6e9 Sep 13 20:02:57.205074 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.205042 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 20:02:57.205221 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.205093 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:02:57.205221 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.205175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 20:02:57.207297 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.207273 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778172bd-98e3-4ca4-a15f-12b06c94ae66-metrics-tls\") pod \"dns-default-f9s98\" (UID: \"778172bd-98e3-4ca4-a15f-12b06c94ae66\") " pod="openshift-dns/dns-default-f9s98" Sep 13 20:02:57.207529 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.207507 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28b67391-3565-4995-88db-bfcf87c81c1f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-l7zs5\" (UID: \"28b67391-3565-4995-88db-bfcf87c81c1f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 20:02:57.207571 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.207507 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"image-registry-6d46487cf9-z4l8j\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:02:57.260172 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.260152 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7xmgm\"" Sep 13 20:02:57.260265 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.260154 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pm8n4\"" Sep 13 20:02:57.260265 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.260154 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fshcc\"" Sep 13 20:02:57.267742 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.267717 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" Sep 13 20:02:57.268078 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.267745 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:02:57.268078 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.267766 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9s98" Sep 13 20:02:57.271162 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.271136 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m74g8" event={"ID":"31c2b737-47a9-48ab-a8e5-df78d3548ec7","Type":"ContainerStarted","Data":"59bcdcb8665a186e33ff13ed57ddd329e4950c97916e3fbdd69f7ca62d3c3168"} Sep 13 20:02:57.271243 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.271204 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m74g8" event={"ID":"31c2b737-47a9-48ab-a8e5-df78d3548ec7","Type":"ContainerStarted","Data":"101b92c91e9e2a156e4fcfb6d509829baed6f6a8a20a7143a83052dd53bfc6e9"} Sep 13 20:02:57.537881 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.537851 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5"] Sep 13 20:02:57.540570 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:02:57.540546 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b67391_3565_4995_88db_bfcf87c81c1f.slice/crio-0505d31d7e548a6f9785461a55e8a2e6f1ddb9ed1c11584d956ea344648d656c WatchSource:0}: Error finding container 0505d31d7e548a6f9785461a55e8a2e6f1ddb9ed1c11584d956ea344648d656c: Status 404 returned error can't find the container with id 0505d31d7e548a6f9785461a55e8a2e6f1ddb9ed1c11584d956ea344648d656c Sep 13 20:02:57.560539 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.560507 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f9s98"] Sep 13 20:02:57.562470 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:57.562451 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d46487cf9-z4l8j"] Sep 13 20:02:57.564338 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:02:57.564314 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778172bd_98e3_4ca4_a15f_12b06c94ae66.slice/crio-475c9102610f7630dd066dfdd1df65cb3f5d1163ca3715e3ec3dbcfa99fc98a7 WatchSource:0}: Error finding container 475c9102610f7630dd066dfdd1df65cb3f5d1163ca3715e3ec3dbcfa99fc98a7: Status 404 returned error can't find the container with id 475c9102610f7630dd066dfdd1df65cb3f5d1163ca3715e3ec3dbcfa99fc98a7 Sep 13 20:02:57.565507 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:02:57.565489 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode269525d_e500_44de_b654_b3a51ff70610.slice/crio-c42a6be612961b5e59e9cd265ea2d1b229cf6adfab7037b9361807fd3edcf69d WatchSource:0}: Error finding container c42a6be612961b5e59e9cd265ea2d1b229cf6adfab7037b9361807fd3edcf69d: Status 404 returned error can't find the container with id c42a6be612961b5e59e9cd265ea2d1b229cf6adfab7037b9361807fd3edcf69d Sep 13 20:02:58.277122 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:58.277036 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9s98" event={"ID":"778172bd-98e3-4ca4-a15f-12b06c94ae66","Type":"ContainerStarted","Data":"475c9102610f7630dd066dfdd1df65cb3f5d1163ca3715e3ec3dbcfa99fc98a7"} Sep 13 20:02:58.279011 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:58.278981 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m74g8" event={"ID":"31c2b737-47a9-48ab-a8e5-df78d3548ec7","Type":"ContainerStarted","Data":"686f2de7e44df54788808ad88b5f14f317cd56da0b5a6a7b3a2c678292ec72b4"} Sep 13 20:02:58.280718 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:58.280696 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" event={"ID":"e269525d-e500-44de-b654-b3a51ff70610","Type":"ContainerStarted","Data":"574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0"} Sep 13 20:02:58.280862 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:58.280732 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" event={"ID":"e269525d-e500-44de-b654-b3a51ff70610","Type":"ContainerStarted","Data":"c42a6be612961b5e59e9cd265ea2d1b229cf6adfab7037b9361807fd3edcf69d"} Sep 13 20:02:58.280862 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:58.280759 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:02:58.282050 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:58.282027 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" event={"ID":"28b67391-3565-4995-88db-bfcf87c81c1f","Type":"ContainerStarted","Data":"0505d31d7e548a6f9785461a55e8a2e6f1ddb9ed1c11584d956ea344648d656c"} Sep 13 20:02:58.300349 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:58.300304 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" podStartSLOduration=284.300292038 podStartE2EDuration="4m44.300292038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:02:58.298769075 +0000 UTC m=+285.411917179" watchObservedRunningTime="2026-09-13 20:02:58.300292038 +0000 UTC m=+285.413440121" Sep 13 20:02:59.287914 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:59.287873 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" event={"ID":"28b67391-3565-4995-88db-bfcf87c81c1f","Type":"ContainerStarted","Data":"b2e82a8c7293b015559bd8b1486d7871cd30ebdfbc51cb444ffd0194c01e7689"} Sep 13 20:02:59.302283 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:02:59.302226 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-l7zs5" podStartSLOduration=261.00307441 podStartE2EDuration="4m22.302205356s" totalImagesPullingTime="1.299130946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:02:59.300612876 +0000 UTC m=+286.413760976" watchObservedRunningTime="2026-09-13 20:02:59.302205356 +0000 UTC m=+286.415353440" Sep 13 20:03:00.292877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:00.292842 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9s98" event={"ID":"778172bd-98e3-4ca4-a15f-12b06c94ae66","Type":"ContainerStarted","Data":"0877b444de509f6c7cfda07cf570014b4f8a7da98012ce6c6e53c563b41f17ba"} Sep 13 20:03:00.293314 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:00.292938 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9s98" event={"ID":"778172bd-98e3-4ca4-a15f-12b06c94ae66","Type":"ContainerStarted","Data":"ba2feed29ff92a67586f9b76c0f7d272cb70543cedb35602dd1f34aaa98edbf5"} Sep 13 20:03:00.293314 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:00.292973 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f9s98" Sep 13 20:03:00.294837 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:00.294801 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m74g8" event={"ID":"31c2b737-47a9-48ab-a8e5-df78d3548ec7","Type":"ContainerStarted","Data":"105d0325a19fe7c346f6936c6c24d2ee7f28fda9b1a5ce8cc99fa510ec0d1e68"} Sep 13 20:03:00.308713 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:00.308670 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f9s98" podStartSLOduration=251.072614472 podStartE2EDuration="4m13.308658108s" totalImagesPullingTime="2.236043636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:03:00.307088147 +0000 UTC m=+287.420236230" watchObservedRunningTime="2026-09-13 20:03:00.308658108 +0000 UTC m=+287.421806214" Sep 13 20:03:00.321924 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:00.321886 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m74g8" podStartSLOduration=17.74866472 podStartE2EDuration="20.321873579s" totalImagesPullingTime="2.573208859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:02:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:03:00.320662354 +0000 UTC m=+287.433810458" watchObservedRunningTime="2026-09-13 20:03:00.321873579 +0000 UTC m=+287.435021661" Sep 13 20:03:04.403716 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:03:04.403667 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7lwvg" podUID="8579a980-87c8-459e-90c7-d81ac524a9e6" Sep 13 20:03:05.903938 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:05.903908 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj"] Sep 13 20:03:05.906756 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:05.906732 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" Sep 13 20:03:05.909742 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:05.909717 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hlfq9\"" Sep 13 20:03:05.910659 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:05.910637 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 13 20:03:05.919340 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:05.919317 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj"] Sep 13 20:03:06.071490 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:06.071456 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ca4b6a9d-f71e-4599-984c-aea6c5828491-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-tvgwj\" (UID: \"ca4b6a9d-f71e-4599-984c-aea6c5828491\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" Sep 13 20:03:06.172252 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:06.172169 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ca4b6a9d-f71e-4599-984c-aea6c5828491-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-tvgwj\" (UID: \"ca4b6a9d-f71e-4599-984c-aea6c5828491\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" Sep 13 20:03:06.174620 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:06.174602 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ca4b6a9d-f71e-4599-984c-aea6c5828491-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-tvgwj\" (UID: \"ca4b6a9d-f71e-4599-984c-aea6c5828491\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" Sep 13 20:03:06.216767 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:06.216739 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" Sep 13 20:03:06.483771 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:06.483697 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj"] Sep 13 20:03:06.486795 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:03:06.486763 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4b6a9d_f71e_4599_984c_aea6c5828491.slice/crio-09819b785400265f264433cd2fbadfd13b9e4810d987446e415267e09c739cad WatchSource:0}: Error finding container 09819b785400265f264433cd2fbadfd13b9e4810d987446e415267e09c739cad: Status 404 returned error can't find the container with id 09819b785400265f264433cd2fbadfd13b9e4810d987446e415267e09c739cad Sep 13 20:03:07.320313 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:07.320272 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" event={"ID":"ca4b6a9d-f71e-4599-984c-aea6c5828491","Type":"ContainerStarted","Data":"09819b785400265f264433cd2fbadfd13b9e4810d987446e415267e09c739cad"} Sep 13 20:03:08.325272 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.325236 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" event={"ID":"ca4b6a9d-f71e-4599-984c-aea6c5828491","Type":"ContainerStarted","Data":"6637b439efe0ebfdd35c6bb9b4c909a526e04091e35872ea835061d89ba02d80"} Sep 13 20:03:08.325639 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.325437 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" Sep 13 20:03:08.329887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.329865 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" Sep 13 20:03:08.340580 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.340541 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-tvgwj" podStartSLOduration=2.213699486 podStartE2EDuration="3.340529489s" totalImagesPullingTime="1.126830003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:03:08.339275948 +0000 UTC m=+295.452424046" watchObservedRunningTime="2026-09-13 20:03:08.340529489 +0000 UTC m=+295.453677569" Sep 13 20:03:08.923364 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.923333 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2"] Sep 13 20:03:08.926557 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.926541 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:08.930152 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.930121 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 13 20:03:08.930152 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.930129 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 13 20:03:08.930323 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.930133 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2qdcv\"" Sep 13 20:03:08.930323 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.930137 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 13 20:03:08.936297 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:08.936274 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2"] Sep 13 20:03:09.096118 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.096081 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt78h\" (UniqueName: \"kubernetes.io/projected/764f2657-ce85-47b0-8aa6-e4794046d9b6-kube-api-access-zt78h\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.096118 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.096117 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/764f2657-ce85-47b0-8aa6-e4794046d9b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.096303 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.096136 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/764f2657-ce85-47b0-8aa6-e4794046d9b6-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.096303 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.096173 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/764f2657-ce85-47b0-8aa6-e4794046d9b6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.197254 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.197170 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt78h\" (UniqueName: \"kubernetes.io/projected/764f2657-ce85-47b0-8aa6-e4794046d9b6-kube-api-access-zt78h\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.197254 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.197207 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/764f2657-ce85-47b0-8aa6-e4794046d9b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.197254 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.197234 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/764f2657-ce85-47b0-8aa6-e4794046d9b6-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.197458 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.197272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/764f2657-ce85-47b0-8aa6-e4794046d9b6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.198014 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.197993 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/764f2657-ce85-47b0-8aa6-e4794046d9b6-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.199736 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.199703 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/764f2657-ce85-47b0-8aa6-e4794046d9b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.199874 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.199806 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/764f2657-ce85-47b0-8aa6-e4794046d9b6-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.204423 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.204393 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt78h\" (UniqueName: \"kubernetes.io/projected/764f2657-ce85-47b0-8aa6-e4794046d9b6-kube-api-access-zt78h\") pod \"prometheus-operator-68bcd7f987-x9ld2\" (UID: \"764f2657-ce85-47b0-8aa6-e4794046d9b6\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.235477 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.235444 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" Sep 13 20:03:09.504024 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:09.503953 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2"] Sep 13 20:03:09.506754 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:03:09.506726 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764f2657_ce85_47b0_8aa6_e4794046d9b6.slice/crio-21374f8f902bd38452c4acf6e00db948d85dc5ba34874cc475a89b45c0839f38 WatchSource:0}: Error finding container 21374f8f902bd38452c4acf6e00db948d85dc5ba34874cc475a89b45c0839f38: Status 404 returned error can't find the container with id 21374f8f902bd38452c4acf6e00db948d85dc5ba34874cc475a89b45c0839f38 Sep 13 20:03:10.301047 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:10.301008 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f9s98" Sep 13 20:03:10.335031 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:10.334956 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" event={"ID":"764f2657-ce85-47b0-8aa6-e4794046d9b6","Type":"ContainerStarted","Data":"21374f8f902bd38452c4acf6e00db948d85dc5ba34874cc475a89b45c0839f38"} Sep 13 20:03:11.340113 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:11.340078 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" event={"ID":"764f2657-ce85-47b0-8aa6-e4794046d9b6","Type":"ContainerStarted","Data":"3757afd4aec18cc8491aaf3b3f9df1c62b283467aa676d34d9e3a84d5cceca9c"} Sep 13 20:03:11.340515 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:11.340130 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" event={"ID":"764f2657-ce85-47b0-8aa6-e4794046d9b6","Type":"ContainerStarted","Data":"411b1519b4fe7810657b9de4bce8b065ef4ccd94f52fb6a0696e662650c4b5f2"} Sep 13 20:03:11.355498 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:11.355457 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-x9ld2" podStartSLOduration=1.971615292 podStartE2EDuration="3.35544394s" totalImagesPullingTime="1.383828648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:03:11.354433051 +0000 UTC m=+298.467581146" watchObservedRunningTime="2026-09-13 20:03:11.35544394 +0000 UTC m=+298.468592023" Sep 13 20:03:13.262355 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.262318 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf"] Sep 13 20:03:13.292005 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.291979 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bb48t"] Sep 13 20:03:13.292170 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.292086 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.294429 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.294353 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 13 20:03:13.294579 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.294477 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 13 20:03:13.294641 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.294597 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lm25c\"" Sep 13 20:03:13.307858 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.307799 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf"] Sep 13 20:03:13.307982 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.307959 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.310725 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.310706 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qnhnl\"" Sep 13 20:03:13.311296 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.311276 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 13 20:03:13.311529 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.311514 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 13 20:03:13.311781 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.310723 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 13 20:03:13.347706 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.347680 2569 kubelet.go:1648] "Image garbage collection succeeded" Sep 13 20:03:13.428927 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.428768 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9989315-f368-48e8-b412-30d3fc3ddc8b-root\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.428927 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.428835 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9989315-f368-48e8-b412-30d3fc3ddc8b-metrics-client-ca\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.428927 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.428864 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9989315-f368-48e8-b412-30d3fc3ddc8b-sys\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.428927 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.428897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e3ed14f-33db-4329-a030-eab21d26f46f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.428930 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e3ed14f-33db-4329-a030-eab21d26f46f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.429017 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp944\" (UniqueName: \"kubernetes.io/projected/3e3ed14f-33db-4329-a030-eab21d26f46f-kube-api-access-dp944\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.429043 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.429075 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e3ed14f-33db-4329-a030-eab21d26f46f-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.429128 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-wtmp\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.429160 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-tls\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.429189 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-accelerators-collector-config\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.429206 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf45m\" (UniqueName: \"kubernetes.io/projected/b9989315-f368-48e8-b412-30d3fc3ddc8b-kube-api-access-kf45m\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.429222 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-textfile\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530505 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp944\" (UniqueName: \"kubernetes.io/projected/3e3ed14f-33db-4329-a030-eab21d26f46f-kube-api-access-dp944\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530539 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530567 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e3ed14f-33db-4329-a030-eab21d26f46f-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530597 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-wtmp\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-tls\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.564887 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530661 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-accelerators-collector-config\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530707 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf45m\" (UniqueName: \"kubernetes.io/projected/b9989315-f368-48e8-b412-30d3fc3ddc8b-kube-api-access-kf45m\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530781 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-wtmp\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530846 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-textfile\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530885 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9989315-f368-48e8-b412-30d3fc3ddc8b-root\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530919 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9989315-f368-48e8-b412-30d3fc3ddc8b-metrics-client-ca\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530941 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9989315-f368-48e8-b412-30d3fc3ddc8b-sys\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.530973 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e3ed14f-33db-4329-a030-eab21d26f46f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.531006 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e3ed14f-33db-4329-a030-eab21d26f46f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:03:13.531138 2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:03:13.531195 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e3ed14f-33db-4329-a030-eab21d26f46f-openshift-state-metrics-tls podName:3e3ed14f-33db-4329-a030-eab21d26f46f nodeName:}" failed. No retries permitted until 2026-09-13 20:03:14.031177682 +0000 UTC m=+301.144325760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3e3ed14f-33db-4329-a030-eab21d26f46f-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-s6rgf" (UID: "3e3ed14f-33db-4329-a030-eab21d26f46f") : secret "openshift-state-metrics-tls" not found Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.531250 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9989315-f368-48e8-b412-30d3fc3ddc8b-sys\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.531264 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-textfile\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.531325 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9989315-f368-48e8-b412-30d3fc3ddc8b-root\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.531496 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-accelerators-collector-config\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.531584 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9989315-f368-48e8-b412-30d3fc3ddc8b-metrics-client-ca\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565430 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.531617 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e3ed14f-33db-4329-a030-eab21d26f46f-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.565939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.533151 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.533393 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9989315-f368-48e8-b412-30d3fc3ddc8b-node-exporter-tls\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.565939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.533457 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e3ed14f-33db-4329-a030-eab21d26f46f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.565939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.541703 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp944\" (UniqueName: \"kubernetes.io/projected/3e3ed14f-33db-4329-a030-eab21d26f46f-kube-api-access-dp944\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:13.565939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.541703 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf45m\" (UniqueName: \"kubernetes.io/projected/b9989315-f368-48e8-b412-30d3fc3ddc8b-kube-api-access-kf45m\") pod \"node-exporter-bb48t\" (UID: \"b9989315-f368-48e8-b412-30d3fc3ddc8b\") " pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.620857 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:13.620799 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bb48t" Sep 13 20:03:13.644206 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:03:13.644178 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9989315_f368_48e8_b412_30d3fc3ddc8b.slice/crio-f0056d3734b314fbc1b75770d12e8b09b503a62fbf4dbdb89bfffd93f618271b WatchSource:0}: Error finding container f0056d3734b314fbc1b75770d12e8b09b503a62fbf4dbdb89bfffd93f618271b: Status 404 returned error can't find the container with id f0056d3734b314fbc1b75770d12e8b09b503a62fbf4dbdb89bfffd93f618271b Sep 13 20:03:14.035878 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.035843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e3ed14f-33db-4329-a030-eab21d26f46f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:14.038237 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.038214 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e3ed14f-33db-4329-a030-eab21d26f46f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-s6rgf\" (UID: \"3e3ed14f-33db-4329-a030-eab21d26f46f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:14.203346 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.203307 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" Sep 13 20:03:14.326929 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.326847 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:03:14.331895 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.331872 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.334185 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.334162 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 13 20:03:14.334393 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.334375 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 13 20:03:14.334463 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.334430 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9fl4q\"" Sep 13 20:03:14.334586 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.334375 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 13 20:03:14.334740 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.334701 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 13 20:03:14.334800 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.334769 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 13 20:03:14.334913 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.334899 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 13 20:03:14.335080 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.335060 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 13 20:03:14.335154 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.335088 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 13 20:03:14.335241 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.335216 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 13 20:03:14.343997 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.343972 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:03:14.353587 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.353512 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bb48t" event={"ID":"b9989315-f368-48e8-b412-30d3fc3ddc8b","Type":"ContainerStarted","Data":"f0056d3734b314fbc1b75770d12e8b09b503a62fbf4dbdb89bfffd93f618271b"} Sep 13 20:03:14.439869 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.439800 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-out\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440033 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.439878 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-web-config\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440033 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.439908 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440033 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.439940 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440033 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.439971 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440252 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.440037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440252 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.440065 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440252 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.440091 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzld9\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-kube-api-access-kzld9\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440252 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.440121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-volume\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440252 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.440148 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440252 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.440167 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440252 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.440188 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.440252 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.440203 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.494320 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.494281 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf"] Sep 13 20:03:14.541148 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541110 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-volume\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541288 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541158 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541288 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541189 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541288 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541222 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541288 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541248 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541438 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541293 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-out\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541438 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-web-config\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541438 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541352 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541438 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541381 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541438 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541410 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541603 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541479 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541603 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541510 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.541603 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.541538 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzld9\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-kube-api-access-kzld9\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.542829 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:03:14.542500 2569 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 13 20:03:14.542829 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:03:14.542582 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-main-tls podName:80d56eec-c3ff-4411-95a4-0c1fd6781045 nodeName:}" failed. No retries permitted until 2026-09-13 20:03:15.042559511 +0000 UTC m=+302.155707596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045") : secret "alertmanager-main-tls" not found Sep 13 20:03:14.544374 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.543299 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.544374 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:03:14.543523 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-trusted-ca-bundle podName:80d56eec-c3ff-4411-95a4-0c1fd6781045 nodeName:}" failed. No retries permitted until 2026-09-13 20:03:15.043502531 +0000 UTC m=+302.156650595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045") : configmap references non-existent config key: ca-bundle.crt Sep 13 20:03:14.545746 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.545082 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.546266 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.546188 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.546266 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.546190 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.548672 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.548649 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.549639 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.549616 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-web-config\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.550332 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.549852 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-out\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.550332 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.550221 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.550566 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.550516 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzld9\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-kube-api-access-kzld9\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.550566 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.550560 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-volume\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.551469 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.551427 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:14.626252 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:03:14.626178 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3ed14f_33db_4329_a030_eab21d26f46f.slice/crio-323ec1e27b0f0d58bd3a43492833b159255f8c892c95f4081595c6e5f8c8bb36 WatchSource:0}: Error finding container 323ec1e27b0f0d58bd3a43492833b159255f8c892c95f4081595c6e5f8c8bb36: Status 404 returned error can't find the container with id 323ec1e27b0f0d58bd3a43492833b159255f8c892c95f4081595c6e5f8c8bb36 Sep 13 20:03:14.781727 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:14.781707 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:03:15.046475 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.046444 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:15.046693 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.046524 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:15.047286 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.047246 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:15.049056 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.049031 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:15.244080 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.244041 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:03:15.358966 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.358931 2569 generic.go:356] "Generic (PLEG): container finished" podID="b9989315-f368-48e8-b412-30d3fc3ddc8b" containerID="54576f4630c72927ad127d2f88e2a22c11300267ca854880ae4bfc13e37af655" exitCode=0 Sep 13 20:03:15.359405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.359008 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bb48t" event={"ID":"b9989315-f368-48e8-b412-30d3fc3ddc8b","Type":"ContainerDied","Data":"54576f4630c72927ad127d2f88e2a22c11300267ca854880ae4bfc13e37af655"} Sep 13 20:03:15.360842 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.360802 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" event={"ID":"3e3ed14f-33db-4329-a030-eab21d26f46f","Type":"ContainerStarted","Data":"4a53c2f276d3c4803967805fa45578dec60cedc5c06f4270947a6798d2e394c3"} Sep 13 20:03:15.360930 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.360867 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" event={"ID":"3e3ed14f-33db-4329-a030-eab21d26f46f","Type":"ContainerStarted","Data":"2d66a690c33e1e9b9552d10e87587cca323c31b3642fc1caf4e34682e53f97e2"} Sep 13 20:03:15.360930 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.360886 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" event={"ID":"3e3ed14f-33db-4329-a030-eab21d26f46f","Type":"ContainerStarted","Data":"323ec1e27b0f0d58bd3a43492833b159255f8c892c95f4081595c6e5f8c8bb36"} Sep 13 20:03:15.527944 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:15.527918 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:03:15.572864 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:03:15.572786 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d56eec_c3ff_4411_95a4_0c1fd6781045.slice/crio-79bc7feedb1db8143e1ec667d1ccbe1bef79b466c5eb89704c6ea7f6dc85a4ae WatchSource:0}: Error finding container 79bc7feedb1db8143e1ec667d1ccbe1bef79b466c5eb89704c6ea7f6dc85a4ae: Status 404 returned error can't find the container with id 79bc7feedb1db8143e1ec667d1ccbe1bef79b466c5eb89704c6ea7f6dc85a4ae Sep 13 20:03:16.366785 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:16.366749 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bb48t" event={"ID":"b9989315-f368-48e8-b412-30d3fc3ddc8b","Type":"ContainerStarted","Data":"4d1626591accec4e010bccfd21a80edd1ec3f3c37ece6973029a6a2af7174514"} Sep 13 20:03:16.367254 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:16.366802 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bb48t" event={"ID":"b9989315-f368-48e8-b412-30d3fc3ddc8b","Type":"ContainerStarted","Data":"3b1ae0334e8ed97c2b977b1d913cb045d6fdd98cc78930a7f3de22dcaf9bb512"} Sep 13 20:03:16.369046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:16.369018 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" event={"ID":"3e3ed14f-33db-4329-a030-eab21d26f46f","Type":"ContainerStarted","Data":"78a97077f9d6a678d1859e9d1ac587931c53e86d17111d75c988c70160b97ad2"} Sep 13 20:03:16.370467 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:16.370448 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerStarted","Data":"79bc7feedb1db8143e1ec667d1ccbe1bef79b466c5eb89704c6ea7f6dc85a4ae"} Sep 13 20:03:16.384297 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:16.384251 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bb48t" podStartSLOduration=2.2952698480000002 podStartE2EDuration="3.384238103s" totalImagesPullingTime="1.015102925s" totalInitContainerRuntime="73.86533ms" isStatefulPod=true podCreationTimestamp="2026-09-13 20:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:03:16.382692716 +0000 UTC m=+303.495840799" watchObservedRunningTime="2026-09-13 20:03:16.384238103 +0000 UTC m=+303.497386189" Sep 13 20:03:16.402999 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:16.402924 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-s6rgf" podStartSLOduration=2.566444222 podStartE2EDuration="3.402906173s" totalImagesPullingTime="836.461951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:03:16.402346454 +0000 UTC m=+303.515494562" watchObservedRunningTime="2026-09-13 20:03:16.402906173 +0000 UTC m=+303.516054257" Sep 13 20:03:17.272886 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:17.272854 2569 patch_prober.go:28] interesting pod/image-registry-6d46487cf9-z4l8j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 13 20:03:17.273045 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:17.272903 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" podUID="e269525d-e500-44de-b654-b3a51ff70610" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 13 20:03:17.375960 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:17.375929 2569 generic.go:356] "Generic (PLEG): container finished" podID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerID="f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b" exitCode=0 Sep 13 20:03:17.376354 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:17.376022 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerDied","Data":"f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b"} Sep 13 20:03:18.402282 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:18.402253 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 20:03:19.294129 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.294095 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:03:19.388267 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.388060 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerStarted","Data":"4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9"} Sep 13 20:03:19.388267 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.388143 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerStarted","Data":"d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553"} Sep 13 20:03:19.388267 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.388180 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerStarted","Data":"9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270"} Sep 13 20:03:19.388267 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.388214 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerStarted","Data":"2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45"} Sep 13 20:03:19.445856 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.445804 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:03:19.450555 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.450523 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.453115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.453086 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 13 20:03:19.453115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.453106 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 13 20:03:19.453311 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.453124 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 13 20:03:19.453410 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.453393 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 13 20:03:19.454176 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.454153 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 13 20:03:19.454371 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.454353 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 13 20:03:19.454577 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.454561 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 13 20:03:19.454746 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.454731 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 13 20:03:19.454943 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.454926 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-772s7\"" Sep 13 20:03:19.455912 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.455824 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 13 20:03:19.456103 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.456013 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 13 20:03:19.456103 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.456096 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 13 20:03:19.456250 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.456228 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 13 20:03:19.456461 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.456445 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 13 20:03:19.456546 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.456527 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-di41kii73em3t\"" Sep 13 20:03:19.457694 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.457675 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 13 20:03:19.461328 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.461302 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 13 20:03:19.465040 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.465013 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:03:19.486277 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486231 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486277 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486278 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486504 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486301 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486504 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486329 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486504 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486352 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486504 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486379 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486504 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486403 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486504 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486445 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486504 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486475 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486507 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7twmm\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-kube-api-access-7twmm\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486532 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486584 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-web-config\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486610 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486646 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486672 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486705 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config-out\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486743 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486763 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486787 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.486843 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.486824 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588234 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588150 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588234 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588193 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588234 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588213 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7twmm\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-kube-api-access-7twmm\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588240 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588284 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-web-config\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588301 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588332 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588388 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588440 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config-out\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588484 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588508 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.588930 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.588532 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589119 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589097 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589279 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589153 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589354 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589412 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589449 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589477 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589483 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589534 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589565 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589589 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589621 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.589761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.589646 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.590310 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.590153 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.590310 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.590254 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.590547 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.590526 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593556 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.591144 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config-out\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593556 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.592085 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593556 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.592239 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593556 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.592653 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593556 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.593030 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593556 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.593433 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593556 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.593509 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593556 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.593552 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593982 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.593836 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593982 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.593877 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-web-config\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.593982 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.593887 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.594075 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.593994 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.599000 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.598980 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7twmm\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-kube-api-access-7twmm\") pod \"prometheus-k8s-0\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:19.762562 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:19.762356 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:20.048180 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:20.048151 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:03:20.145843 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:03:20.145785 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69ebef8_dc86_4f1b_b7aa_910ee12e363a.slice/crio-298f48ae9f8c06a54373f84f59c6651f2a23e9a7d3df17593391d6d956740f0a WatchSource:0}: Error finding container 298f48ae9f8c06a54373f84f59c6651f2a23e9a7d3df17593391d6d956740f0a: Status 404 returned error can't find the container with id 298f48ae9f8c06a54373f84f59c6651f2a23e9a7d3df17593391d6d956740f0a Sep 13 20:03:20.395561 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:20.395470 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerStarted","Data":"8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2"} Sep 13 20:03:20.395561 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:20.395548 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerStarted","Data":"492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374"} Sep 13 20:03:20.397061 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:20.397037 2569 generic.go:356] "Generic (PLEG): container finished" podID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerID="0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75" exitCode=0 Sep 13 20:03:20.397176 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:20.397069 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerDied","Data":"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75"} Sep 13 20:03:20.397176 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:20.397110 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerStarted","Data":"298f48ae9f8c06a54373f84f59c6651f2a23e9a7d3df17593391d6d956740f0a"} Sep 13 20:03:20.419990 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:20.419945 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7256326680000003 podStartE2EDuration="6.419930439s" totalImagesPullingTime="3.679898036s" totalInitContainerRuntime="14.399735ms" isStatefulPod=false podCreationTimestamp="2026-09-13 20:03:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:03:20.417839285 +0000 UTC m=+307.530987388" watchObservedRunningTime="2026-09-13 20:03:20.419930439 +0000 UTC m=+307.533078522" Sep 13 20:03:24.427110 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:24.426842 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerStarted","Data":"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250"} Sep 13 20:03:24.427110 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:24.426984 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerStarted","Data":"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b"} Sep 13 20:03:26.438341 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:26.438252 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerStarted","Data":"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10"} Sep 13 20:03:26.438341 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:26.438318 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerStarted","Data":"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c"} Sep 13 20:03:26.438725 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:26.438343 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerStarted","Data":"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734"} Sep 13 20:03:26.438725 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:26.438368 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerStarted","Data":"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44"} Sep 13 20:03:26.465095 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:26.465035 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.206811004 podStartE2EDuration="7.465010838s" totalImagesPullingTime="5.240524645s" totalInitContainerRuntime="17.675189ms" isStatefulPod=false podCreationTimestamp="2026-09-13 20:03:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:03:26.462780488 +0000 UTC m=+313.575928570" watchObservedRunningTime="2026-09-13 20:03:26.465010838 +0000 UTC m=+313.578158922" Sep 13 20:03:28.491145 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:28.491105 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d46487cf9-z4l8j"] Sep 13 20:03:29.763136 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:29.763090 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:03:50.535251 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:50.535220 2569 generic.go:356] "Generic (PLEG): container finished" podID="e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6" containerID="011fbd60c2c6c691e9581adf24dfe5706255acf35f8d9dfb4278c4f20beb42f9" exitCode=0 Sep 13 20:03:50.535615 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:50.535283 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" event={"ID":"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6","Type":"ContainerDied","Data":"011fbd60c2c6c691e9581adf24dfe5706255acf35f8d9dfb4278c4f20beb42f9"} Sep 13 20:03:50.535615 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:50.535607 2569 scope.go:117] "RemoveContainer" containerID="011fbd60c2c6c691e9581adf24dfe5706255acf35f8d9dfb4278c4f20beb42f9" Sep 13 20:03:51.541103 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:51.541070 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-nq7dz" event={"ID":"e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6","Type":"ContainerStarted","Data":"d852d1646255731b745e6c9baba0e4e2a2354d21d577c429683db5f3076f16ac"} Sep 13 20:03:53.510675 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.510612 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" podUID="e269525d-e500-44de-b654-b3a51ff70610" containerName="registry" containerID="cri-o://574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0" gracePeriod=30 Sep 13 20:03:53.785696 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.785667 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:03:53.906051 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906015 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-bound-sa-token\") pod \"e269525d-e500-44de-b654-b3a51ff70610\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " Sep 13 20:03:53.906051 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906061 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-image-registry-private-configuration\") pod \"e269525d-e500-44de-b654-b3a51ff70610\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " Sep 13 20:03:53.906284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906082 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-registry-certificates\") pod \"e269525d-e500-44de-b654-b3a51ff70610\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " Sep 13 20:03:53.906284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906100 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") pod \"e269525d-e500-44de-b654-b3a51ff70610\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " Sep 13 20:03:53.906284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906140 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e269525d-e500-44de-b654-b3a51ff70610-ca-trust-extracted\") pod \"e269525d-e500-44de-b654-b3a51ff70610\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " Sep 13 20:03:53.906284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906163 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqd85\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-kube-api-access-xqd85\") pod \"e269525d-e500-44de-b654-b3a51ff70610\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " Sep 13 20:03:53.906284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906179 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-installation-pull-secrets\") pod \"e269525d-e500-44de-b654-b3a51ff70610\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " Sep 13 20:03:53.906284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906198 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-trusted-ca\") pod \"e269525d-e500-44de-b654-b3a51ff70610\" (UID: \"e269525d-e500-44de-b654-b3a51ff70610\") " Sep 13 20:03:53.906577 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906462 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e269525d-e500-44de-b654-b3a51ff70610" (UID: "e269525d-e500-44de-b654-b3a51ff70610"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:03:53.906721 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.906696 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e269525d-e500-44de-b654-b3a51ff70610" (UID: "e269525d-e500-44de-b654-b3a51ff70610"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:03:53.908746 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.908707 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-kube-api-access-xqd85" (OuterVolumeSpecName: "kube-api-access-xqd85") pod "e269525d-e500-44de-b654-b3a51ff70610" (UID: "e269525d-e500-44de-b654-b3a51ff70610"). InnerVolumeSpecName "kube-api-access-xqd85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:03:53.908746 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.908726 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e269525d-e500-44de-b654-b3a51ff70610" (UID: "e269525d-e500-44de-b654-b3a51ff70610"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:03:53.908957 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.908915 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e269525d-e500-44de-b654-b3a51ff70610" (UID: "e269525d-e500-44de-b654-b3a51ff70610"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:03:53.908998 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.908950 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e269525d-e500-44de-b654-b3a51ff70610" (UID: "e269525d-e500-44de-b654-b3a51ff70610"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:03:53.909084 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.909063 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e269525d-e500-44de-b654-b3a51ff70610" (UID: "e269525d-e500-44de-b654-b3a51ff70610"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:03:53.915281 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:53.915249 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e269525d-e500-44de-b654-b3a51ff70610-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e269525d-e500-44de-b654-b3a51ff70610" (UID: "e269525d-e500-44de-b654-b3a51ff70610"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:03:54.007639 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.007599 2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-image-registry-private-configuration\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:03:54.007639 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.007634 2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-registry-certificates\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:03:54.007639 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.007649 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-registry-tls\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:03:54.007903 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.007658 2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e269525d-e500-44de-b654-b3a51ff70610-ca-trust-extracted\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:03:54.007903 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.007667 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqd85\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-kube-api-access-xqd85\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:03:54.007903 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.007676 2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e269525d-e500-44de-b654-b3a51ff70610-installation-pull-secrets\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:03:54.007903 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.007685 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e269525d-e500-44de-b654-b3a51ff70610-trusted-ca\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:03:54.007903 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.007692 2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e269525d-e500-44de-b654-b3a51ff70610-bound-sa-token\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:03:54.558825 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.558780 2569 generic.go:356] "Generic (PLEG): container finished" podID="e269525d-e500-44de-b654-b3a51ff70610" containerID="574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0" exitCode=0 Sep 13 20:03:54.559277 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.558836 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" event={"ID":"e269525d-e500-44de-b654-b3a51ff70610","Type":"ContainerDied","Data":"574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0"} Sep 13 20:03:54.559277 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.558858 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" Sep 13 20:03:54.559277 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.558899 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d46487cf9-z4l8j" event={"ID":"e269525d-e500-44de-b654-b3a51ff70610","Type":"ContainerDied","Data":"c42a6be612961b5e59e9cd265ea2d1b229cf6adfab7037b9361807fd3edcf69d"} Sep 13 20:03:54.559277 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.558928 2569 scope.go:117] "RemoveContainer" containerID="574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0" Sep 13 20:03:54.567981 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.567963 2569 scope.go:117] "RemoveContainer" containerID="574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0" Sep 13 20:03:54.568263 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:03:54.568243 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0\": container with ID starting with 574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0 not found: ID does not exist" containerID="574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0" Sep 13 20:03:54.568313 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.568278 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0"} err="failed to get container status \"574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0\": rpc error: code = NotFound desc = could not find container \"574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0\": container with ID starting with 574b00f872b03a4b253a713ae2fe44e05eec54aee500cc68b23f2a993ba2c9f0 not found: ID does not exist" Sep 13 20:03:54.579296 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.579252 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d46487cf9-z4l8j"] Sep 13 20:03:54.582210 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:54.582180 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d46487cf9-z4l8j"] Sep 13 20:03:55.406853 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:03:55.406804 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e269525d-e500-44de-b654-b3a51ff70610" path="/var/lib/kubelet/pods/e269525d-e500-44de-b654-b3a51ff70610/volumes" Sep 13 20:04:05.610231 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:05.610198 2569 generic.go:356] "Generic (PLEG): container finished" podID="aac11b22-2b23-4f02-8280-e4fda90b474e" containerID="9231c964314dd3c2661c43e0118a5390510c6fa9ff6d6c3925aa86d4f76fc19e" exitCode=0 Sep 13 20:04:05.610589 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:05.610278 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" event={"ID":"aac11b22-2b23-4f02-8280-e4fda90b474e","Type":"ContainerDied","Data":"9231c964314dd3c2661c43e0118a5390510c6fa9ff6d6c3925aa86d4f76fc19e"} Sep 13 20:04:05.610648 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:05.610593 2569 scope.go:117] "RemoveContainer" containerID="9231c964314dd3c2661c43e0118a5390510c6fa9ff6d6c3925aa86d4f76fc19e" Sep 13 20:04:06.615499 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:06.615463 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-s2gkl" event={"ID":"aac11b22-2b23-4f02-8280-e4fda90b474e","Type":"ContainerStarted","Data":"5af33b200d5bf625512492841e10d6354bdbd5648291f8f8324d4431930fb847"} Sep 13 20:04:19.762884 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:19.762851 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:19.778513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:19.778485 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:20.695298 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:20.695270 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:27.309577 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:27.309526 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 20:04:27.311888 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:27.311864 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8579a980-87c8-459e-90c7-d81ac524a9e6-metrics-certs\") pod \"network-metrics-daemon-7lwvg\" (UID: \"8579a980-87c8-459e-90c7-d81ac524a9e6\") " pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 20:04:27.405381 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:27.405350 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hvn9g\"" Sep 13 20:04:27.413455 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:27.413415 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lwvg" Sep 13 20:04:27.680513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:27.680487 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7lwvg"] Sep 13 20:04:27.683037 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:04:27.683010 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8579a980_87c8_459e_90c7_d81ac524a9e6.slice/crio-089f2b0892d808d879c98cd25791cdb00b252033a6de726462b4928d5eda7521 WatchSource:0}: Error finding container 089f2b0892d808d879c98cd25791cdb00b252033a6de726462b4928d5eda7521: Status 404 returned error can't find the container with id 089f2b0892d808d879c98cd25791cdb00b252033a6de726462b4928d5eda7521 Sep 13 20:04:27.711159 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:27.711121 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lwvg" event={"ID":"8579a980-87c8-459e-90c7-d81ac524a9e6","Type":"ContainerStarted","Data":"089f2b0892d808d879c98cd25791cdb00b252033a6de726462b4928d5eda7521"} Sep 13 20:04:29.721984 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:29.721902 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lwvg" event={"ID":"8579a980-87c8-459e-90c7-d81ac524a9e6","Type":"ContainerStarted","Data":"8c131067eea395c5122d075b34589d0d8f80c8205b9ba059ddd9533fc276e9c4"} Sep 13 20:04:29.721984 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:29.721957 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lwvg" event={"ID":"8579a980-87c8-459e-90c7-d81ac524a9e6","Type":"ContainerStarted","Data":"acd62086b95b435bc2c18203417c523b964ab2eea54edff6faffc73b72c53cd0"} Sep 13 20:04:29.737733 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:29.737686 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7lwvg" podStartSLOduration=375.072172764 podStartE2EDuration="6m16.737673232s" totalImagesPullingTime="1.665500468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:04:29.736428952 +0000 UTC m=+376.849577049" watchObservedRunningTime="2026-09-13 20:04:29.737673232 +0000 UTC m=+376.850821340" Sep 13 20:04:33.475703 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.475667 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:04:33.476164 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.475978 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="alertmanager" containerID="cri-o://2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45" gracePeriod=120 Sep 13 20:04:33.476164 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.476036 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy-metric" containerID="cri-o://8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2" gracePeriod=120 Sep 13 20:04:33.476164 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.476083 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy-web" containerID="cri-o://d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553" gracePeriod=120 Sep 13 20:04:33.476164 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.476124 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy" containerID="cri-o://4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9" gracePeriod=120 Sep 13 20:04:33.476164 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.476115 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="prom-label-proxy" containerID="cri-o://492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374" gracePeriod=120 Sep 13 20:04:33.476164 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.476083 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="config-reloader" containerID="cri-o://9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270" gracePeriod=120 Sep 13 20:04:33.742558 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.742471 2569 generic.go:356] "Generic (PLEG): container finished" podID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerID="492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374" exitCode=0 Sep 13 20:04:33.742558 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.742502 2569 generic.go:356] "Generic (PLEG): container finished" podID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerID="4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9" exitCode=0 Sep 13 20:04:33.742558 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.742508 2569 generic.go:356] "Generic (PLEG): container finished" podID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerID="9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270" exitCode=0 Sep 13 20:04:33.742558 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.742514 2569 generic.go:356] "Generic (PLEG): container finished" podID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerID="2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45" exitCode=0 Sep 13 20:04:33.742558 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.742544 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerDied","Data":"492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374"} Sep 13 20:04:33.742834 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.742607 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerDied","Data":"4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9"} Sep 13 20:04:33.742834 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.742635 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerDied","Data":"9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270"} Sep 13 20:04:33.742834 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:33.742658 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerDied","Data":"2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45"} Sep 13 20:04:34.723800 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.723772 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:34.750248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.750216 2569 generic.go:356] "Generic (PLEG): container finished" podID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerID="8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2" exitCode=0 Sep 13 20:04:34.750248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.750243 2569 generic.go:356] "Generic (PLEG): container finished" podID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerID="d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553" exitCode=0 Sep 13 20:04:34.750441 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.750292 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:34.750441 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.750294 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerDied","Data":"8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2"} Sep 13 20:04:34.750441 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.750362 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerDied","Data":"d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553"} Sep 13 20:04:34.750441 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.750397 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d56eec-c3ff-4411-95a4-0c1fd6781045","Type":"ContainerDied","Data":"79bc7feedb1db8143e1ec667d1ccbe1bef79b466c5eb89704c6ea7f6dc85a4ae"} Sep 13 20:04:34.750441 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.750429 2569 scope.go:117] "RemoveContainer" containerID="492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374" Sep 13 20:04:34.759737 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.759712 2569 scope.go:117] "RemoveContainer" containerID="8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2" Sep 13 20:04:34.769060 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.768956 2569 scope.go:117] "RemoveContainer" containerID="4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9" Sep 13 20:04:34.778428 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.778402 2569 scope.go:117] "RemoveContainer" containerID="d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553" Sep 13 20:04:34.787095 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.787077 2569 scope.go:117] "RemoveContainer" containerID="9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270" Sep 13 20:04:34.795054 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.795030 2569 scope.go:117] "RemoveContainer" containerID="2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45" Sep 13 20:04:34.802457 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.802435 2569 scope.go:117] "RemoveContainer" containerID="f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b" Sep 13 20:04:34.809616 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.809596 2569 scope.go:117] "RemoveContainer" containerID="492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374" Sep 13 20:04:34.809921 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:34.809900 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374\": container with ID starting with 492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374 not found: ID does not exist" containerID="492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374" Sep 13 20:04:34.809993 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.809934 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374"} err="failed to get container status \"492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374\": rpc error: code = NotFound desc = could not find container \"492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374\": container with ID starting with 492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374 not found: ID does not exist" Sep 13 20:04:34.809993 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.809959 2569 scope.go:117] "RemoveContainer" containerID="8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2" Sep 13 20:04:34.810251 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:34.810234 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2\": container with ID starting with 8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2 not found: ID does not exist" containerID="8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2" Sep 13 20:04:34.810314 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.810260 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2"} err="failed to get container status \"8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2\": rpc error: code = NotFound desc = could not find container \"8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2\": container with ID starting with 8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2 not found: ID does not exist" Sep 13 20:04:34.810314 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.810282 2569 scope.go:117] "RemoveContainer" containerID="4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9" Sep 13 20:04:34.810539 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:34.810517 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9\": container with ID starting with 4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9 not found: ID does not exist" containerID="4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9" Sep 13 20:04:34.810584 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.810549 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9"} err="failed to get container status \"4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9\": rpc error: code = NotFound desc = could not find container \"4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9\": container with ID starting with 4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9 not found: ID does not exist" Sep 13 20:04:34.810584 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.810570 2569 scope.go:117] "RemoveContainer" containerID="d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553" Sep 13 20:04:34.810833 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:34.810796 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553\": container with ID starting with d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553 not found: ID does not exist" containerID="d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553" Sep 13 20:04:34.810912 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.810851 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553"} err="failed to get container status \"d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553\": rpc error: code = NotFound desc = could not find container \"d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553\": container with ID starting with d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553 not found: ID does not exist" Sep 13 20:04:34.810912 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.810873 2569 scope.go:117] "RemoveContainer" containerID="9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270" Sep 13 20:04:34.811145 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:34.811129 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270\": container with ID starting with 9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270 not found: ID does not exist" containerID="9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270" Sep 13 20:04:34.811186 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.811149 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270"} err="failed to get container status \"9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270\": rpc error: code = NotFound desc = could not find container \"9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270\": container with ID starting with 9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270 not found: ID does not exist" Sep 13 20:04:34.811186 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.811162 2569 scope.go:117] "RemoveContainer" containerID="2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45" Sep 13 20:04:34.811410 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:34.811393 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45\": container with ID starting with 2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45 not found: ID does not exist" containerID="2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45" Sep 13 20:04:34.811457 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.811415 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45"} err="failed to get container status \"2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45\": rpc error: code = NotFound desc = could not find container \"2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45\": container with ID starting with 2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45 not found: ID does not exist" Sep 13 20:04:34.811457 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.811429 2569 scope.go:117] "RemoveContainer" containerID="f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b" Sep 13 20:04:34.811631 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:34.811616 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b\": container with ID starting with f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b not found: ID does not exist" containerID="f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b" Sep 13 20:04:34.811665 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.811634 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b"} err="failed to get container status \"f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b\": rpc error: code = NotFound desc = could not find container \"f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b\": container with ID starting with f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b not found: ID does not exist" Sep 13 20:04:34.811665 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.811646 2569 scope.go:117] "RemoveContainer" containerID="492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374" Sep 13 20:04:34.811861 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.811845 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374"} err="failed to get container status \"492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374\": rpc error: code = NotFound desc = could not find container \"492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374\": container with ID starting with 492e027e806750585f67ed5748f05f1965478f56d9fea157654f70dd84e34374 not found: ID does not exist" Sep 13 20:04:34.811920 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.811861 2569 scope.go:117] "RemoveContainer" containerID="8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2" Sep 13 20:04:34.812093 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.812078 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2"} err="failed to get container status \"8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2\": rpc error: code = NotFound desc = could not find container \"8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2\": container with ID starting with 8c33a365eaba9439ec56318f6cc3548c7f954a10fb82783887fd741f0d6c1ce2 not found: ID does not exist" Sep 13 20:04:34.812093 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.812093 2569 scope.go:117] "RemoveContainer" containerID="4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9" Sep 13 20:04:34.812279 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.812265 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9"} err="failed to get container status \"4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9\": rpc error: code = NotFound desc = could not find container \"4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9\": container with ID starting with 4d15d902b9802a6df7e1d6e99d9201de72a2ccf8d323502149fd513db4b448e9 not found: ID does not exist" Sep 13 20:04:34.812329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.812279 2569 scope.go:117] "RemoveContainer" containerID="d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553" Sep 13 20:04:34.812533 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.812507 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553"} err="failed to get container status \"d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553\": rpc error: code = NotFound desc = could not find container \"d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553\": container with ID starting with d4d973e541cc5b068312cacd00ee2209091353dc970f9bd324a8da0550f5a553 not found: ID does not exist" Sep 13 20:04:34.812583 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.812536 2569 scope.go:117] "RemoveContainer" containerID="9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270" Sep 13 20:04:34.812783 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.812766 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270"} err="failed to get container status \"9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270\": rpc error: code = NotFound desc = could not find container \"9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270\": container with ID starting with 9204e6b7e15b5aab3f2947d4d0b304601d80435aad77880ae89095d87b94e270 not found: ID does not exist" Sep 13 20:04:34.812848 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.812784 2569 scope.go:117] "RemoveContainer" containerID="2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45" Sep 13 20:04:34.813021 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.813001 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45"} err="failed to get container status \"2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45\": rpc error: code = NotFound desc = could not find container \"2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45\": container with ID starting with 2fb3360040b5c092f0876c95d883ec399f2d74e444243daebe40fbec0868bf45 not found: ID does not exist" Sep 13 20:04:34.813021 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.813019 2569 scope.go:117] "RemoveContainer" containerID="f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b" Sep 13 20:04:34.813279 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.813257 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b"} err="failed to get container status \"f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b\": rpc error: code = NotFound desc = could not find container \"f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b\": container with ID starting with f6d15c88e8ca547fe588d359b835ec900f815b8029387e2269ca16228760c50b not found: ID does not exist" Sep 13 20:04:34.878754 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.878717 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-volume\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.878754 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.878760 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-tls-assets\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.878989 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.878807 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-metric\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.878989 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.878847 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-web-config\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.878989 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.878893 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-web\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.878989 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.878917 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzld9\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-kube-api-access-kzld9\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.878989 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.878947 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-main-db\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.878989 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.878978 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-cluster-tls-config\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.879296 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.879049 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-out\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.879296 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.879077 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-main-tls\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.879296 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.879113 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-trusted-ca-bundle\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.879296 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.879158 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.879296 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.879184 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-metrics-client-ca\") pod \"80d56eec-c3ff-4411-95a4-0c1fd6781045\" (UID: \"80d56eec-c3ff-4411-95a4-0c1fd6781045\") " Sep 13 20:04:34.879776 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.879746 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:04:34.880239 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.880038 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:04:34.880239 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.880209 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:04:34.881968 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.881934 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:04:34.882200 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.882170 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-volume" (OuterVolumeSpecName: "config-volume") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:34.882284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.882248 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:34.882765 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.882698 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:34.882765 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.882741 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:34.882765 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.882742 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-out" (OuterVolumeSpecName: "config-out") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:04:34.882952 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.882877 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:34.883238 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.883221 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-kube-api-access-kzld9" (OuterVolumeSpecName: "kube-api-access-kzld9") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "kube-api-access-kzld9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:04:34.887758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.887654 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:34.893027 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.893003 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-web-config" (OuterVolumeSpecName: "web-config") pod "80d56eec-c3ff-4411-95a4-0c1fd6781045" (UID: "80d56eec-c3ff-4411-95a4-0c1fd6781045"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:34.980619 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980574 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-web-config\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980619 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980616 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980629 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzld9\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-kube-api-access-kzld9\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980640 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-main-db\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980649 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-cluster-tls-config\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980657 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-out\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980665 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-main-tls\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980673 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980682 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980691 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d56eec-c3ff-4411-95a4-0c1fd6781045-metrics-client-ca\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980699 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-config-volume\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980707 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80d56eec-c3ff-4411-95a4-0c1fd6781045-tls-assets\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:34.980796 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:34.980714 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80d56eec-c3ff-4411-95a4-0c1fd6781045-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:35.073666 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.073631 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:04:35.079862 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.079834 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:04:35.103181 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103144 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:04:35.103441 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103428 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy-metric" Sep 13 20:04:35.103441 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103442 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy-metric" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103454 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103460 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103476 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="alertmanager" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103482 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="alertmanager" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103492 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="init-config-reloader" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103497 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="init-config-reloader" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103503 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy-web" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103508 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy-web" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103516 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="prom-label-proxy" Sep 13 20:04:35.103518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103521 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="prom-label-proxy" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103528 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e269525d-e500-44de-b654-b3a51ff70610" containerName="registry" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103533 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e269525d-e500-44de-b654-b3a51ff70610" containerName="registry" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103541 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="config-reloader" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103546 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="config-reloader" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103590 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="alertmanager" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103599 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy-web" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103605 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103610 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e269525d-e500-44de-b654-b3a51ff70610" containerName="registry" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103615 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="config-reloader" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103621 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="kube-rbac-proxy-metric" Sep 13 20:04:35.103840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.103625 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" containerName="prom-label-proxy" Sep 13 20:04:35.110604 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.110576 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.113156 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.113117 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 13 20:04:35.113156 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.113130 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 13 20:04:35.113345 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.113259 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 13 20:04:35.113345 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.113322 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 13 20:04:35.113453 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.113364 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 13 20:04:35.113453 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.113434 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9fl4q\"" Sep 13 20:04:35.113550 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.113465 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 13 20:04:35.113731 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.113718 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 13 20:04:35.113870 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.113731 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 13 20:04:35.117715 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.117687 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 13 20:04:35.119938 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.119914 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:04:35.283733 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.283695 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3606352-8a04-49dc-9098-ebeb08e03f0d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.283939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.283747 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.283939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.283778 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.283939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.283864 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3606352-8a04-49dc-9098-ebeb08e03f0d-config-out\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.283939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.283898 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.283939 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.283928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.284115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.283949 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-web-config\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.284115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.283971 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3606352-8a04-49dc-9098-ebeb08e03f0d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.284115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.283995 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3606352-8a04-49dc-9098-ebeb08e03f0d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.284115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.284030 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3606352-8a04-49dc-9098-ebeb08e03f0d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.284115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.284054 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.284115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.284082 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsnnb\" (UniqueName: \"kubernetes.io/projected/e3606352-8a04-49dc-9098-ebeb08e03f0d-kube-api-access-tsnnb\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.284115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.284111 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.384588 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384502 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3606352-8a04-49dc-9098-ebeb08e03f0d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.384588 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384543 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.384588 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384566 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.384877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384694 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3606352-8a04-49dc-9098-ebeb08e03f0d-config-out\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.384877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384744 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.384877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384785 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.384877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384836 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-web-config\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.384877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384870 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3606352-8a04-49dc-9098-ebeb08e03f0d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.385116 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3606352-8a04-49dc-9098-ebeb08e03f0d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.385116 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384937 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3606352-8a04-49dc-9098-ebeb08e03f0d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.385116 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384964 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.385116 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.384997 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsnnb\" (UniqueName: \"kubernetes.io/projected/e3606352-8a04-49dc-9098-ebeb08e03f0d-kube-api-access-tsnnb\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.385116 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.385039 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.385718 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.385690 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3606352-8a04-49dc-9098-ebeb08e03f0d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.387652 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.387517 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3606352-8a04-49dc-9098-ebeb08e03f0d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.388028 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.387833 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.388028 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.387957 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.388028 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.387977 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.388217 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.388077 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3606352-8a04-49dc-9098-ebeb08e03f0d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.388217 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.388122 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3606352-8a04-49dc-9098-ebeb08e03f0d-config-out\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.388217 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.388144 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.388217 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.388200 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.388427 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.388395 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3606352-8a04-49dc-9098-ebeb08e03f0d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.389046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.389027 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-web-config\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.389632 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.389613 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3606352-8a04-49dc-9098-ebeb08e03f0d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.394432 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.394402 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsnnb\" (UniqueName: \"kubernetes.io/projected/e3606352-8a04-49dc-9098-ebeb08e03f0d-kube-api-access-tsnnb\") pod \"alertmanager-main-0\" (UID: \"e3606352-8a04-49dc-9098-ebeb08e03f0d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.407049 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.407023 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80d56eec-c3ff-4411-95a4-0c1fd6781045" path="/var/lib/kubelet/pods/80d56eec-c3ff-4411-95a4-0c1fd6781045/volumes" Sep 13 20:04:35.421385 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.421359 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:04:35.703339 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.703315 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:04:35.755861 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:35.755827 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3606352-8a04-49dc-9098-ebeb08e03f0d","Type":"ContainerStarted","Data":"abb86d1e16402aec69cac3d6d560c1590e94b719e41f34eed704494fc4655bf7"} Sep 13 20:04:36.762868 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:36.762796 2569 generic.go:356] "Generic (PLEG): container finished" podID="e3606352-8a04-49dc-9098-ebeb08e03f0d" containerID="2ddffbd395dd205040fe151e72521e1461e039c60de2774106857012f90186b5" exitCode=0 Sep 13 20:04:36.763218 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:36.762881 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3606352-8a04-49dc-9098-ebeb08e03f0d","Type":"ContainerDied","Data":"2ddffbd395dd205040fe151e72521e1461e039c60de2774106857012f90186b5"} Sep 13 20:04:37.770757 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.770722 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3606352-8a04-49dc-9098-ebeb08e03f0d","Type":"ContainerStarted","Data":"7fe63068809c9398898c1b2847320079a45c610c7d1f7a7ee7e30da0e948d6a3"} Sep 13 20:04:37.771142 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.770788 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3606352-8a04-49dc-9098-ebeb08e03f0d","Type":"ContainerStarted","Data":"8daeee651053573d7f5acfecdd055f93b23eaf0a06ba76bd2d68d0ea20eef1a8"} Sep 13 20:04:37.771142 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.770848 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3606352-8a04-49dc-9098-ebeb08e03f0d","Type":"ContainerStarted","Data":"580d6835b376bd1ed8e18ff01e92cd512589931a3f23b6b02292cc91c6367eb8"} Sep 13 20:04:37.771142 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.770879 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3606352-8a04-49dc-9098-ebeb08e03f0d","Type":"ContainerStarted","Data":"4358b02b08f5a6612cbd6dde050a0269e2a6e6202d4d5ffa7b818488c07192c4"} Sep 13 20:04:37.771142 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.770904 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3606352-8a04-49dc-9098-ebeb08e03f0d","Type":"ContainerStarted","Data":"69b144419d0aee7ae35f5d0c62ea591ce5bc07a8bd121f4b27054ca14423ba02"} Sep 13 20:04:37.771142 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.770926 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3606352-8a04-49dc-9098-ebeb08e03f0d","Type":"ContainerStarted","Data":"c8bc2151863e4289e3afdc9c8892bb78b5f2ef3410f6dc2785d3354554ca828f"} Sep 13 20:04:37.775351 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.775323 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:04:37.776013 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.775652 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="prometheus" containerID="cri-o://c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" gracePeriod=600 Sep 13 20:04:37.776013 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.775674 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy" containerID="cri-o://c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" gracePeriod=600 Sep 13 20:04:37.776013 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.775825 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" gracePeriod=600 Sep 13 20:04:37.776013 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.775837 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy-web" containerID="cri-o://df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" gracePeriod=600 Sep 13 20:04:37.776013 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.775911 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="config-reloader" containerID="cri-o://c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" gracePeriod=600 Sep 13 20:04:37.776013 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.775923 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="thanos-sidecar" containerID="cri-o://31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" gracePeriod=600 Sep 13 20:04:37.797538 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:37.797473 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.782579224 podStartE2EDuration="2.79745195s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.872726ms" isStatefulPod=false podCreationTimestamp="2026-09-13 20:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:04:37.795123685 +0000 UTC m=+384.908271825" watchObservedRunningTime="2026-09-13 20:04:37.79745195 +0000 UTC m=+384.910600034" Sep 13 20:04:38.025760 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.025677 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:38.111699 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111664 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-thanos-prometheus-http-client-file\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.111699 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111703 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-db\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.111943 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111721 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-tls-assets\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.111943 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111745 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-1\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.111943 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111778 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-metrics-client-certs\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.111943 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111804 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-metrics-client-ca\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.111943 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111855 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-tls\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.111943 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111884 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-2\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.111943 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111906 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config-out\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.111943 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111941 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-0\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111969 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-kube-rbac-proxy\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.111998 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-serving-certs-ca-bundle\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112024 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-web-config\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112063 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112100 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-grpc-tls\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112112 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112130 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-trusted-ca-bundle\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112159 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112192 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112227 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-kubelet-serving-ca-bundle\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112258 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7twmm\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-kube-api-access-7twmm\") pod \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\" (UID: \"f69ebef8-dc86-4f1b-b7aa-910ee12e363a\") " Sep 13 20:04:38.112877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112382 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:04:38.112877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112499 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.112877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112514 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.112877 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112666 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:04:38.113066 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.112966 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:04:38.113841 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.113214 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:04:38.113989 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.113296 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:04:38.114529 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.114496 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:04:38.115403 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.115371 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:04:38.115782 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.115713 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:38.115782 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.115758 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:38.115936 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.115917 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:04:38.116120 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.116093 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:38.116615 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.116584 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config-out" (OuterVolumeSpecName: "config-out") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:04:38.116831 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.116788 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:38.117026 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.116994 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config" (OuterVolumeSpecName: "config") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:38.117111 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.117087 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:38.117567 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.117541 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:38.117670 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.117654 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:38.118367 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.118346 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-kube-api-access-7twmm" (OuterVolumeSpecName: "kube-api-access-7twmm") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "kube-api-access-7twmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:04:38.128180 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.128157 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-web-config" (OuterVolumeSpecName: "web-config") pod "f69ebef8-dc86-4f1b-b7aa-910ee12e363a" (UID: "f69ebef8-dc86-4f1b-b7aa-910ee12e363a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:04:38.213217 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213178 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213217 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213207 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-grpc-tls\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213217 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213218 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213217 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213227 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213238 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213247 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213255 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7twmm\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-kube-api-access-7twmm\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213265 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213273 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-db\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213281 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-tls-assets\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213289 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-metrics-client-certs\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213299 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-metrics-client-ca\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213307 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213317 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-config-out\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213325 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213334 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-secret-kube-rbac-proxy\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213343 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.213450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.213351 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f69ebef8-dc86-4f1b-b7aa-910ee12e363a-web-config\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:04:38.778664 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778631 2569 generic.go:356] "Generic (PLEG): container finished" podID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerID="dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" exitCode=0 Sep 13 20:04:38.778664 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778658 2569 generic.go:356] "Generic (PLEG): container finished" podID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerID="c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" exitCode=0 Sep 13 20:04:38.778664 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778666 2569 generic.go:356] "Generic (PLEG): container finished" podID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerID="df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" exitCode=0 Sep 13 20:04:38.778664 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778673 2569 generic.go:356] "Generic (PLEG): container finished" podID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerID="31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" exitCode=0 Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778682 2569 generic.go:356] "Generic (PLEG): container finished" podID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerID="c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" exitCode=0 Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778689 2569 generic.go:356] "Generic (PLEG): container finished" podID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerID="c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" exitCode=0 Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778709 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778710 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerDied","Data":"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10"} Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778787 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerDied","Data":"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c"} Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778836 2569 scope.go:117] "RemoveContainer" containerID="dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778846 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerDied","Data":"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734"} Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778889 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerDied","Data":"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44"} Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778932 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerDied","Data":"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250"} Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.778972 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerDied","Data":"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b"} Sep 13 20:04:38.779248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.779011 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f69ebef8-dc86-4f1b-b7aa-910ee12e363a","Type":"ContainerDied","Data":"298f48ae9f8c06a54373f84f59c6651f2a23e9a7d3df17593391d6d956740f0a"} Sep 13 20:04:38.787880 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.787768 2569 scope.go:117] "RemoveContainer" containerID="c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" Sep 13 20:04:38.794792 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.794775 2569 scope.go:117] "RemoveContainer" containerID="df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" Sep 13 20:04:38.801577 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.801557 2569 scope.go:117] "RemoveContainer" containerID="31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" Sep 13 20:04:38.803592 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.803567 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:04:38.807647 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.807626 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:04:38.809721 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.809706 2569 scope.go:117] "RemoveContainer" containerID="c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" Sep 13 20:04:38.816353 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.816339 2569 scope.go:117] "RemoveContainer" containerID="c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" Sep 13 20:04:38.823557 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.823529 2569 scope.go:117] "RemoveContainer" containerID="0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75" Sep 13 20:04:38.830097 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830074 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:04:38.830355 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830341 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy-web" Sep 13 20:04:38.830355 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830354 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy-web" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830366 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="thanos-sidecar" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830372 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="thanos-sidecar" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830379 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830384 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830406 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="init-config-reloader" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830412 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="init-config-reloader" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830418 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="prometheus" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830423 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="prometheus" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830431 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="config-reloader" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830436 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="config-reloader" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830444 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy-thanos" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830449 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy-thanos" Sep 13 20:04:38.830486 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830491 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy-web" Sep 13 20:04:38.830965 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830498 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="prometheus" Sep 13 20:04:38.830965 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830504 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy" Sep 13 20:04:38.830965 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830512 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="thanos-sidecar" Sep 13 20:04:38.830965 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830518 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="config-reloader" Sep 13 20:04:38.830965 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830524 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" containerName="kube-rbac-proxy-thanos" Sep 13 20:04:38.830965 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.830726 2569 scope.go:117] "RemoveContainer" containerID="dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" Sep 13 20:04:38.831204 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:38.831010 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": container with ID starting with dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10 not found: ID does not exist" containerID="dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" Sep 13 20:04:38.831204 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.831033 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10"} err="failed to get container status \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": rpc error: code = NotFound desc = could not find container \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": container with ID starting with dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10 not found: ID does not exist" Sep 13 20:04:38.831204 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.831049 2569 scope.go:117] "RemoveContainer" containerID="c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" Sep 13 20:04:38.831312 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:38.831262 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": container with ID starting with c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c not found: ID does not exist" containerID="c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" Sep 13 20:04:38.831312 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.831279 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c"} err="failed to get container status \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": rpc error: code = NotFound desc = could not find container \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": container with ID starting with c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c not found: ID does not exist" Sep 13 20:04:38.831312 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.831290 2569 scope.go:117] "RemoveContainer" containerID="df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" Sep 13 20:04:38.831498 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:38.831482 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": container with ID starting with df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734 not found: ID does not exist" containerID="df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" Sep 13 20:04:38.831544 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.831502 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734"} err="failed to get container status \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": rpc error: code = NotFound desc = could not find container \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": container with ID starting with df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734 not found: ID does not exist" Sep 13 20:04:38.831544 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.831514 2569 scope.go:117] "RemoveContainer" containerID="31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" Sep 13 20:04:38.831759 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:38.831743 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": container with ID starting with 31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44 not found: ID does not exist" containerID="31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" Sep 13 20:04:38.831798 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.831762 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44"} err="failed to get container status \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": rpc error: code = NotFound desc = could not find container \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": container with ID starting with 31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44 not found: ID does not exist" Sep 13 20:04:38.831798 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.831776 2569 scope.go:117] "RemoveContainer" containerID="c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" Sep 13 20:04:38.832022 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:38.832008 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": container with ID starting with c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250 not found: ID does not exist" containerID="c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" Sep 13 20:04:38.832064 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.832024 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250"} err="failed to get container status \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": rpc error: code = NotFound desc = could not find container \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": container with ID starting with c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250 not found: ID does not exist" Sep 13 20:04:38.832064 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.832035 2569 scope.go:117] "RemoveContainer" containerID="c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" Sep 13 20:04:38.832240 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:38.832224 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": container with ID starting with c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b not found: ID does not exist" containerID="c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" Sep 13 20:04:38.832277 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.832243 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b"} err="failed to get container status \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": rpc error: code = NotFound desc = could not find container \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": container with ID starting with c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b not found: ID does not exist" Sep 13 20:04:38.832277 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.832255 2569 scope.go:117] "RemoveContainer" containerID="0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75" Sep 13 20:04:38.832495 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:04:38.832479 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": container with ID starting with 0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75 not found: ID does not exist" containerID="0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75" Sep 13 20:04:38.832536 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.832497 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75"} err="failed to get container status \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": rpc error: code = NotFound desc = could not find container \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": container with ID starting with 0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75 not found: ID does not exist" Sep 13 20:04:38.832536 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.832508 2569 scope.go:117] "RemoveContainer" containerID="dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" Sep 13 20:04:38.832739 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.832722 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10"} err="failed to get container status \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": rpc error: code = NotFound desc = could not find container \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": container with ID starting with dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10 not found: ID does not exist" Sep 13 20:04:38.832739 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.832738 2569 scope.go:117] "RemoveContainer" containerID="c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" Sep 13 20:04:38.833006 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.832989 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c"} err="failed to get container status \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": rpc error: code = NotFound desc = could not find container \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": container with ID starting with c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c not found: ID does not exist" Sep 13 20:04:38.833006 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.833005 2569 scope.go:117] "RemoveContainer" containerID="df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" Sep 13 20:04:38.833267 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.833247 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734"} err="failed to get container status \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": rpc error: code = NotFound desc = could not find container \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": container with ID starting with df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734 not found: ID does not exist" Sep 13 20:04:38.833310 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.833269 2569 scope.go:117] "RemoveContainer" containerID="31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" Sep 13 20:04:38.833496 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.833479 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44"} err="failed to get container status \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": rpc error: code = NotFound desc = could not find container \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": container with ID starting with 31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44 not found: ID does not exist" Sep 13 20:04:38.833533 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.833496 2569 scope.go:117] "RemoveContainer" containerID="c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" Sep 13 20:04:38.833723 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.833706 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250"} err="failed to get container status \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": rpc error: code = NotFound desc = could not find container \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": container with ID starting with c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250 not found: ID does not exist" Sep 13 20:04:38.833768 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.833724 2569 scope.go:117] "RemoveContainer" containerID="c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" Sep 13 20:04:38.834006 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.833988 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b"} err="failed to get container status \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": rpc error: code = NotFound desc = could not find container \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": container with ID starting with c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b not found: ID does not exist" Sep 13 20:04:38.834070 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.834006 2569 scope.go:117] "RemoveContainer" containerID="0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75" Sep 13 20:04:38.834242 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.834222 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75"} err="failed to get container status \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": rpc error: code = NotFound desc = could not find container \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": container with ID starting with 0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75 not found: ID does not exist" Sep 13 20:04:38.834285 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.834244 2569 scope.go:117] "RemoveContainer" containerID="dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" Sep 13 20:04:38.834529 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.834512 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10"} err="failed to get container status \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": rpc error: code = NotFound desc = could not find container \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": container with ID starting with dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10 not found: ID does not exist" Sep 13 20:04:38.834591 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.834529 2569 scope.go:117] "RemoveContainer" containerID="c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" Sep 13 20:04:38.834751 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.834737 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c"} err="failed to get container status \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": rpc error: code = NotFound desc = could not find container \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": container with ID starting with c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c not found: ID does not exist" Sep 13 20:04:38.834793 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.834751 2569 scope.go:117] "RemoveContainer" containerID="df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" Sep 13 20:04:38.835013 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.834994 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734"} err="failed to get container status \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": rpc error: code = NotFound desc = could not find container \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": container with ID starting with df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734 not found: ID does not exist" Sep 13 20:04:38.835064 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.835013 2569 scope.go:117] "RemoveContainer" containerID="31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" Sep 13 20:04:38.835244 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.835226 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44"} err="failed to get container status \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": rpc error: code = NotFound desc = could not find container \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": container with ID starting with 31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44 not found: ID does not exist" Sep 13 20:04:38.835290 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.835245 2569 scope.go:117] "RemoveContainer" containerID="c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" Sep 13 20:04:38.835594 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.835574 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250"} err="failed to get container status \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": rpc error: code = NotFound desc = could not find container \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": container with ID starting with c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250 not found: ID does not exist" Sep 13 20:04:38.835683 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.835596 2569 scope.go:117] "RemoveContainer" containerID="c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" Sep 13 20:04:38.835892 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.835859 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b"} err="failed to get container status \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": rpc error: code = NotFound desc = could not find container \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": container with ID starting with c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b not found: ID does not exist" Sep 13 20:04:38.835892 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.835876 2569 scope.go:117] "RemoveContainer" containerID="0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75" Sep 13 20:04:38.836143 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.836125 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:38.836238 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.836138 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75"} err="failed to get container status \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": rpc error: code = NotFound desc = could not find container \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": container with ID starting with 0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75 not found: ID does not exist" Sep 13 20:04:38.836238 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.836158 2569 scope.go:117] "RemoveContainer" containerID="dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" Sep 13 20:04:38.836765 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.836439 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10"} err="failed to get container status \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": rpc error: code = NotFound desc = could not find container \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": container with ID starting with dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10 not found: ID does not exist" Sep 13 20:04:38.836765 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.836465 2569 scope.go:117] "RemoveContainer" containerID="c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" Sep 13 20:04:38.836947 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.836778 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c"} err="failed to get container status \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": rpc error: code = NotFound desc = could not find container \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": container with ID starting with c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c not found: ID does not exist" Sep 13 20:04:38.836947 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.836801 2569 scope.go:117] "RemoveContainer" containerID="df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" Sep 13 20:04:38.837062 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.837041 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734"} err="failed to get container status \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": rpc error: code = NotFound desc = could not find container \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": container with ID starting with df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734 not found: ID does not exist" Sep 13 20:04:38.837104 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.837066 2569 scope.go:117] "RemoveContainer" containerID="31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" Sep 13 20:04:38.837333 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.837317 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44"} err="failed to get container status \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": rpc error: code = NotFound desc = could not find container \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": container with ID starting with 31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44 not found: ID does not exist" Sep 13 20:04:38.837376 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.837333 2569 scope.go:117] "RemoveContainer" containerID="c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" Sep 13 20:04:38.837559 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.837544 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250"} err="failed to get container status \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": rpc error: code = NotFound desc = could not find container \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": container with ID starting with c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250 not found: ID does not exist" Sep 13 20:04:38.837598 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.837559 2569 scope.go:117] "RemoveContainer" containerID="c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" Sep 13 20:04:38.837791 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.837775 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b"} err="failed to get container status \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": rpc error: code = NotFound desc = could not find container \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": container with ID starting with c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b not found: ID does not exist" Sep 13 20:04:38.837854 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.837790 2569 scope.go:117] "RemoveContainer" containerID="0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75" Sep 13 20:04:38.838074 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.838055 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75"} err="failed to get container status \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": rpc error: code = NotFound desc = could not find container \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": container with ID starting with 0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75 not found: ID does not exist" Sep 13 20:04:38.838144 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.838075 2569 scope.go:117] "RemoveContainer" containerID="dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" Sep 13 20:04:38.838308 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.838287 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10"} err="failed to get container status \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": rpc error: code = NotFound desc = could not find container \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": container with ID starting with dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10 not found: ID does not exist" Sep 13 20:04:38.838353 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.838310 2569 scope.go:117] "RemoveContainer" containerID="c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" Sep 13 20:04:38.838593 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.838573 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c"} err="failed to get container status \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": rpc error: code = NotFound desc = could not find container \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": container with ID starting with c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c not found: ID does not exist" Sep 13 20:04:38.838674 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.838595 2569 scope.go:117] "RemoveContainer" containerID="df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" Sep 13 20:04:38.838933 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.838903 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734"} err="failed to get container status \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": rpc error: code = NotFound desc = could not find container \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": container with ID starting with df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734 not found: ID does not exist" Sep 13 20:04:38.838933 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.838923 2569 scope.go:117] "RemoveContainer" containerID="31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" Sep 13 20:04:38.839085 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.839027 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 13 20:04:38.839134 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.839028 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 13 20:04:38.839311 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.839278 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44"} err="failed to get container status \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": rpc error: code = NotFound desc = could not find container \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": container with ID starting with 31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44 not found: ID does not exist" Sep 13 20:04:38.839624 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.839602 2569 scope.go:117] "RemoveContainer" containerID="c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" Sep 13 20:04:38.839876 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.839856 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 13 20:04:38.840005 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.839985 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 13 20:04:38.840058 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.840027 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 13 20:04:38.840301 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.839319 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 13 20:04:38.841167 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.841144 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-di41kii73em3t\"" Sep 13 20:04:38.844998 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.842646 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 13 20:04:38.846128 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.845728 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 13 20:04:38.846128 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.845947 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-772s7\"" Sep 13 20:04:38.846128 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.846085 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 13 20:04:38.846128 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.846099 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 13 20:04:38.847963 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.847132 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 13 20:04:38.847963 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.847537 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 13 20:04:38.848334 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.848265 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 13 20:04:38.849851 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.849544 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250"} err="failed to get container status \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": rpc error: code = NotFound desc = could not find container \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": container with ID starting with c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250 not found: ID does not exist" Sep 13 20:04:38.849851 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.849584 2569 scope.go:117] "RemoveContainer" containerID="c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" Sep 13 20:04:38.850382 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.850123 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b"} err="failed to get container status \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": rpc error: code = NotFound desc = could not find container \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": container with ID starting with c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b not found: ID does not exist" Sep 13 20:04:38.850382 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.850216 2569 scope.go:117] "RemoveContainer" containerID="0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75" Sep 13 20:04:38.851024 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.850996 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75"} err="failed to get container status \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": rpc error: code = NotFound desc = could not find container \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": container with ID starting with 0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75 not found: ID does not exist" Sep 13 20:04:38.851095 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.851025 2569 scope.go:117] "RemoveContainer" containerID="dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10" Sep 13 20:04:38.852115 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.852093 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10"} err="failed to get container status \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": rpc error: code = NotFound desc = could not find container \"dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10\": container with ID starting with dad8173dfa3fc54cdaae3f994bcb1811230d0db1a1f83babd6bc1239120a0a10 not found: ID does not exist" Sep 13 20:04:38.852206 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.852140 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 13 20:04:38.852206 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.852141 2569 scope.go:117] "RemoveContainer" containerID="c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c" Sep 13 20:04:38.852296 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.852107 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:04:38.852587 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.852542 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c"} err="failed to get container status \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": rpc error: code = NotFound desc = could not find container \"c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c\": container with ID starting with c803e73a0c9f4285a957c1582bf561cc29e29c1ff56b92f2e4e49bdc1ef1b22c not found: ID does not exist" Sep 13 20:04:38.852587 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.852567 2569 scope.go:117] "RemoveContainer" containerID="df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734" Sep 13 20:04:38.852868 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.852848 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734"} err="failed to get container status \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": rpc error: code = NotFound desc = could not find container \"df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734\": container with ID starting with df325c099f61186fd92bf92c40f87f53f323e2defccf648665fc2312ce822734 not found: ID does not exist" Sep 13 20:04:38.852868 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.852870 2569 scope.go:117] "RemoveContainer" containerID="31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44" Sep 13 20:04:38.853173 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.853151 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44"} err="failed to get container status \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": rpc error: code = NotFound desc = could not find container \"31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44\": container with ID starting with 31a3306fdfb47428a09a6eff2fbec629ef23d5344495c4a19828f64655eb8c44 not found: ID does not exist" Sep 13 20:04:38.853244 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.853174 2569 scope.go:117] "RemoveContainer" containerID="c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250" Sep 13 20:04:38.853450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.853435 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250"} err="failed to get container status \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": rpc error: code = NotFound desc = could not find container \"c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250\": container with ID starting with c5add8fab2188fd06a9d6d776feda49e81bedf6f2822792a1c81993fb6aa3250 not found: ID does not exist" Sep 13 20:04:38.853504 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.853451 2569 scope.go:117] "RemoveContainer" containerID="c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b" Sep 13 20:04:38.853652 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.853637 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 13 20:04:38.853696 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.853642 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b"} err="failed to get container status \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": rpc error: code = NotFound desc = could not find container \"c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b\": container with ID starting with c7da0d79d5f5792d5530cb876e50daa60aa28db147903a65a69e36d086731e7b not found: ID does not exist" Sep 13 20:04:38.853696 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.853679 2569 scope.go:117] "RemoveContainer" containerID="0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75" Sep 13 20:04:38.853988 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:38.853970 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75"} err="failed to get container status \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": rpc error: code = NotFound desc = could not find container \"0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75\": container with ID starting with 0b924c0df2310128b6af5be63009bf78ed111209e5221c595439e686d0a84f75 not found: ID does not exist" Sep 13 20:04:39.020805 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.020760 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.020805 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.020802 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fabedabb-12b4-4f35-b6d2-e8328429466d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.020852 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.020876 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.020907 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.020925 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.020939 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.020974 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.020988 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt6q8\" (UniqueName: \"kubernetes.io/projected/fabedabb-12b4-4f35-b6d2-e8328429466d-kube-api-access-jt6q8\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021004 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-config\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021020 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021055 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021081 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021141 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021173 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-web-config\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021230 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021268 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fabedabb-12b4-4f35-b6d2-e8328429466d-config-out\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021286 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.021329 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.021302 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122158 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122072 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122158 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122118 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122158 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122137 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122172 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-web-config\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122194 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122216 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fabedabb-12b4-4f35-b6d2-e8328429466d-config-out\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122237 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122259 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122321 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122358 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fabedabb-12b4-4f35-b6d2-e8328429466d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122386 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122428 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122469 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122519 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122551 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6q8\" (UniqueName: \"kubernetes.io/projected/fabedabb-12b4-4f35-b6d2-e8328429466d-kube-api-access-jt6q8\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122606 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-config\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122660 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.122758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122681 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.123285 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.122963 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.123285 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.123274 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.123387 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.123355 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.123836 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.123615 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.125273 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.125247 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.126746 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.125908 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.126746 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.125998 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-web-config\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.126746 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.126311 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fabedabb-12b4-4f35-b6d2-e8328429466d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.126746 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.126425 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.128064 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.127475 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.128064 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.127939 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.128064 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.127991 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.128064 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.128035 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.128290 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.128265 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.128327 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.128306 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.128400 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.128386 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fabedabb-12b4-4f35-b6d2-e8328429466d-config\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.129079 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.129062 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fabedabb-12b4-4f35-b6d2-e8328429466d-config-out\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.130497 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.130478 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fabedabb-12b4-4f35-b6d2-e8328429466d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.131901 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.131876 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt6q8\" (UniqueName: \"kubernetes.io/projected/fabedabb-12b4-4f35-b6d2-e8328429466d-kube-api-access-jt6q8\") pod \"prometheus-k8s-0\" (UID: \"fabedabb-12b4-4f35-b6d2-e8328429466d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.149544 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.149497 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:04:39.409493 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.409422 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69ebef8-dc86-4f1b-b7aa-910ee12e363a" path="/var/lib/kubelet/pods/f69ebef8-dc86-4f1b-b7aa-910ee12e363a/volumes" Sep 13 20:04:39.429123 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.429100 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:04:39.430919 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:04:39.430891 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabedabb_12b4_4f35_b6d2_e8328429466d.slice/crio-62e5d77ec196f2a0b4c5e54ca9bb620544d98ace96c2700b37b963d9d2373ee9 WatchSource:0}: Error finding container 62e5d77ec196f2a0b4c5e54ca9bb620544d98ace96c2700b37b963d9d2373ee9: Status 404 returned error can't find the container with id 62e5d77ec196f2a0b4c5e54ca9bb620544d98ace96c2700b37b963d9d2373ee9 Sep 13 20:04:39.785821 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.785788 2569 generic.go:356] "Generic (PLEG): container finished" podID="fabedabb-12b4-4f35-b6d2-e8328429466d" containerID="de38e53b772d28969568bc7481ae883e7b698439569bcf3ec683ec4c3f6ca59d" exitCode=0 Sep 13 20:04:39.786257 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.785879 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fabedabb-12b4-4f35-b6d2-e8328429466d","Type":"ContainerDied","Data":"de38e53b772d28969568bc7481ae883e7b698439569bcf3ec683ec4c3f6ca59d"} Sep 13 20:04:39.786257 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:39.785958 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fabedabb-12b4-4f35-b6d2-e8328429466d","Type":"ContainerStarted","Data":"62e5d77ec196f2a0b4c5e54ca9bb620544d98ace96c2700b37b963d9d2373ee9"} Sep 13 20:04:40.800337 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:40.800298 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fabedabb-12b4-4f35-b6d2-e8328429466d","Type":"ContainerStarted","Data":"6eab8488b4dc6192dace945dbdfba4ca91654ecd6ade265318fe39a4a1978745"} Sep 13 20:04:40.800756 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:40.800392 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fabedabb-12b4-4f35-b6d2-e8328429466d","Type":"ContainerStarted","Data":"7ea042d5bb1202bd89b5a2f532db7ab667fec0d49ae384664d582bb7c30b4cca"} Sep 13 20:04:40.800756 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:40.800418 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fabedabb-12b4-4f35-b6d2-e8328429466d","Type":"ContainerStarted","Data":"bdf9af1357ab2aba13c4b60baf998ab22747be33dfbd9cfa6eca6fa9aba77fa0"} Sep 13 20:04:40.800756 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:40.800442 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fabedabb-12b4-4f35-b6d2-e8328429466d","Type":"ContainerStarted","Data":"551125fabd1ab0703cb9bbe30945b67fab75a174d240657113b392d8a5b096c1"} Sep 13 20:04:40.800756 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:40.800464 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fabedabb-12b4-4f35-b6d2-e8328429466d","Type":"ContainerStarted","Data":"ddd02aff7ac2f4e3f2f872130d036a7e7a57e52f2e0e8c156e211e186f6041f2"} Sep 13 20:04:40.800756 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:40.800486 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fabedabb-12b4-4f35-b6d2-e8328429466d","Type":"ContainerStarted","Data":"dfb1b8991b0d981c73db5a1cf95cf487cf1b4c03e593e0a7b99ed5072db445a7"} Sep 13 20:04:40.827229 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:40.827174 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.808934788 podStartE2EDuration="2.827156459s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.221671ms" isStatefulPod=false podCreationTimestamp="2026-09-13 20:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:04:40.824419305 +0000 UTC m=+387.937567409" watchObservedRunningTime="2026-09-13 20:04:40.827156459 +0000 UTC m=+387.940304542" Sep 13 20:04:44.150311 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:04:44.150272 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:05:39.150562 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:05:39.150452 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:05:39.166228 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:05:39.166202 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:05:40.057202 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:05:40.057176 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:08:05.485545 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.485509 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh"] Sep 13 20:08:05.488908 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.488886 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.491768 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.491752 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 13 20:08:05.491905 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.491795 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 13 20:08:05.491905 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.491793 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lh2xm\"" Sep 13 20:08:05.492059 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.492045 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 13 20:08:05.492122 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.492048 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 13 20:08:05.504160 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.504136 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh"] Sep 13 20:08:05.628313 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.628283 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-tmp\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.628487 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.628326 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-manifests\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.628487 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.628348 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mchl\" (UniqueName: \"kubernetes.io/projected/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-kube-api-access-4mchl\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.628487 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.628433 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.628487 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.628460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.729555 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.729523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-tmp\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.729713 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.729566 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-manifests\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.729713 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.729588 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mchl\" (UniqueName: \"kubernetes.io/projected/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-kube-api-access-4mchl\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.729713 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.729630 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.729713 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.729647 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.730036 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.730010 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-manifests\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.731931 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.731903 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-tmp\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.732113 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.732092 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.732242 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.732222 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.744316 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.744266 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mchl\" (UniqueName: \"kubernetes.io/projected/d32c6e3b-bfd8-4564-9b01-d400b9f6761f-kube-api-access-4mchl\") pod \"opendatahub-operator-controller-manager-79dc4cfddb-rh7gh\" (UID: \"d32c6e3b-bfd8-4564-9b01-d400b9f6761f\") " pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:05.798862 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:05.798826 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:06.085545 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:06.085522 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh"] Sep 13 20:08:06.087614 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:08:06.087586 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32c6e3b_bfd8_4564_9b01_d400b9f6761f.slice/crio-a17a7053fd0f5185415855c55e26edae21b6643a1c22e1aabe10e221fd0267ab WatchSource:0}: Error finding container a17a7053fd0f5185415855c55e26edae21b6643a1c22e1aabe10e221fd0267ab: Status 404 returned error can't find the container with id a17a7053fd0f5185415855c55e26edae21b6643a1c22e1aabe10e221fd0267ab Sep 13 20:08:06.614315 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:06.614281 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" event={"ID":"d32c6e3b-bfd8-4564-9b01-d400b9f6761f","Type":"ContainerStarted","Data":"a17a7053fd0f5185415855c55e26edae21b6643a1c22e1aabe10e221fd0267ab"} Sep 13 20:08:09.631075 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:09.631040 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" event={"ID":"d32c6e3b-bfd8-4564-9b01-d400b9f6761f","Type":"ContainerStarted","Data":"1e637a1f12e414431bdf55569c89ad2dd28b542bb9db199cdffa387bd54f99de"} Sep 13 20:08:10.637371 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:10.637336 2569 generic.go:356] "Generic (PLEG): container finished" podID="d32c6e3b-bfd8-4564-9b01-d400b9f6761f" containerID="1e637a1f12e414431bdf55569c89ad2dd28b542bb9db199cdffa387bd54f99de" exitCode=0 Sep 13 20:08:10.637855 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:10.637424 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" event={"ID":"d32c6e3b-bfd8-4564-9b01-d400b9f6761f","Type":"ContainerDied","Data":"1e637a1f12e414431bdf55569c89ad2dd28b542bb9db199cdffa387bd54f99de"} Sep 13 20:08:11.644068 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:11.644031 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" event={"ID":"d32c6e3b-bfd8-4564-9b01-d400b9f6761f","Type":"ContainerStarted","Data":"539f91f3f65576beac360308ccf6f7b03d5370ea6dae4831330ba6cc1950e477"} Sep 13 20:08:11.644426 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:11.644164 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:11.665689 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:11.665641 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" podStartSLOduration=2.448789292 podStartE2EDuration="6.665624362s" totalImagesPullingTime="3.178742832s" totalInitContainerRuntime="1.038092238s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:08:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:08:11.663438639 +0000 UTC m=+598.776586721" watchObservedRunningTime="2026-09-13 20:08:11.665624362 +0000 UTC m=+598.778772503" Sep 13 20:08:22.651490 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:22.651455 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79dc4cfddb-rh7gh" Sep 13 20:08:24.835767 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.835733 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf"] Sep 13 20:08:24.837937 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.837918 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:24.841251 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.841220 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:08:24.841363 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.841220 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zrf6t\"" Sep 13 20:08:24.841363 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.841268 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 13 20:08:24.841363 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.841277 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 13 20:08:24.841363 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.841298 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 13 20:08:24.841363 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.841221 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 13 20:08:24.848498 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.848479 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf"] Sep 13 20:08:24.898312 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.898283 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ca857f14-5666-4f9e-877c-58bda435c6f3-manager-config\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:24.898432 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.898315 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9c6w\" (UniqueName: \"kubernetes.io/projected/ca857f14-5666-4f9e-877c-58bda435c6f3-kube-api-access-g9c6w\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:24.898432 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.898355 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca857f14-5666-4f9e-877c-58bda435c6f3-metrics-cert\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:24.898432 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.898413 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca857f14-5666-4f9e-877c-58bda435c6f3-cert\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:24.999215 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.999183 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ca857f14-5666-4f9e-877c-58bda435c6f3-manager-config\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:24.999384 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.999219 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9c6w\" (UniqueName: \"kubernetes.io/projected/ca857f14-5666-4f9e-877c-58bda435c6f3-kube-api-access-g9c6w\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:24.999384 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.999280 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca857f14-5666-4f9e-877c-58bda435c6f3-metrics-cert\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:24.999384 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.999309 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca857f14-5666-4f9e-877c-58bda435c6f3-cert\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:24.999840 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:24.999793 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ca857f14-5666-4f9e-877c-58bda435c6f3-manager-config\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:25.001892 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:25.001871 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca857f14-5666-4f9e-877c-58bda435c6f3-cert\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:25.001972 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:25.001871 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca857f14-5666-4f9e-877c-58bda435c6f3-metrics-cert\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:25.010367 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:25.010350 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9c6w\" (UniqueName: \"kubernetes.io/projected/ca857f14-5666-4f9e-877c-58bda435c6f3-kube-api-access-g9c6w\") pod \"lws-controller-manager-95b884fcc-s9jjf\" (UID: \"ca857f14-5666-4f9e-877c-58bda435c6f3\") " pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:25.148248 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:25.148160 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:25.429347 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:25.429269 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf"] Sep 13 20:08:25.432343 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:08:25.432315 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca857f14_5666_4f9e_877c_58bda435c6f3.slice/crio-0bf488b229f570220f4c43a378c4b7c36c351869b8e537e1f3d82d8b87d1a325 WatchSource:0}: Error finding container 0bf488b229f570220f4c43a378c4b7c36c351869b8e537e1f3d82d8b87d1a325: Status 404 returned error can't find the container with id 0bf488b229f570220f4c43a378c4b7c36c351869b8e537e1f3d82d8b87d1a325 Sep 13 20:08:25.434195 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:25.434179 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:08:25.704497 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:25.704411 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" event={"ID":"ca857f14-5666-4f9e-877c-58bda435c6f3","Type":"ContainerStarted","Data":"0bf488b229f570220f4c43a378c4b7c36c351869b8e537e1f3d82d8b87d1a325"} Sep 13 20:08:28.719436 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:28.719401 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" event={"ID":"ca857f14-5666-4f9e-877c-58bda435c6f3","Type":"ContainerStarted","Data":"92405ea9a4c7ad1ce67f6b47dce379d15a8845504c4415eb70ca320d17cd45b1"} Sep 13 20:08:28.719802 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:28.719529 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:28.735749 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:28.735701 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" podStartSLOduration=2.323946672 podStartE2EDuration="4.735686717s" totalImagesPullingTime="2.411740045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:08:28.734384846 +0000 UTC m=+615.847532947" watchObservedRunningTime="2026-09-13 20:08:28.735686717 +0000 UTC m=+615.848834799" Sep 13 20:08:31.352242 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.352210 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd"] Sep 13 20:08:31.355660 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.355635 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.358377 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.358349 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 13 20:08:31.358518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.358420 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cmlsd\"" Sep 13 20:08:31.365755 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.365731 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd"] Sep 13 20:08:31.452286 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.452249 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.452286 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.452281 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smqr7\" (UniqueName: \"kubernetes.io/projected/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-kube-api-access-smqr7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.452516 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.452332 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.452516 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.452382 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.452516 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.452451 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.452670 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.452517 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.452670 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.452554 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.452670 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.452579 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.452670 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.452606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.553770 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.553731 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.553991 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.553788 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.553991 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.553847 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.553991 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.553869 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.553991 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.553885 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.553991 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.553906 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.553991 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.553957 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.553991 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.553980 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smqr7\" (UniqueName: \"kubernetes.io/projected/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-kube-api-access-smqr7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.554339 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.554014 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.554339 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.554216 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.554339 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.554296 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.554529 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.554427 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.554626 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.554605 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.554779 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.554753 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.556512 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.556488 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.556611 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.556535 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.562290 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.562262 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.562450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.562432 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smqr7\" (UniqueName: \"kubernetes.io/projected/3cf0009e-9f6a-44cd-adbe-8c9f6c468141-kube-api-access-smqr7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd\" (UID: \"3cf0009e-9f6a-44cd-adbe-8c9f6c468141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.667686 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.667606 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:31.943544 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:31.943518 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd"] Sep 13 20:08:31.945474 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:08:31.945444 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf0009e_9f6a_44cd_adbe_8c9f6c468141.slice/crio-cd9518de43749f90b5a88a1aa1d6db870d53641ccbef04a239edd8902d8397d4 WatchSource:0}: Error finding container cd9518de43749f90b5a88a1aa1d6db870d53641ccbef04a239edd8902d8397d4: Status 404 returned error can't find the container with id cd9518de43749f90b5a88a1aa1d6db870d53641ccbef04a239edd8902d8397d4 Sep 13 20:08:32.739531 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:32.739497 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" event={"ID":"3cf0009e-9f6a-44cd-adbe-8c9f6c468141","Type":"ContainerStarted","Data":"cd9518de43749f90b5a88a1aa1d6db870d53641ccbef04a239edd8902d8397d4"} Sep 13 20:08:34.854164 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:34.854122 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:08:34.854462 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:34.854197 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:08:34.854462 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:34.854224 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:08:35.227675 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.227600 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s6h8r"] Sep 13 20:08:35.231079 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.231063 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:35.233443 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.233421 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 13 20:08:35.233558 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.233423 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rdmjk\"" Sep 13 20:08:35.240567 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.240547 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s6h8r"] Sep 13 20:08:35.291140 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.291065 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c47c612-c4d0-4469-b2c6-09f16946c661-cert\") pod \"odh-model-controller-7998c67dc4-s6h8r\" (UID: \"0c47c612-c4d0-4469-b2c6-09f16946c661\") " pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:35.291140 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.291121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghcc\" (UniqueName: \"kubernetes.io/projected/0c47c612-c4d0-4469-b2c6-09f16946c661-kube-api-access-gghcc\") pod \"odh-model-controller-7998c67dc4-s6h8r\" (UID: \"0c47c612-c4d0-4469-b2c6-09f16946c661\") " pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:35.392605 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.392575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c47c612-c4d0-4469-b2c6-09f16946c661-cert\") pod \"odh-model-controller-7998c67dc4-s6h8r\" (UID: \"0c47c612-c4d0-4469-b2c6-09f16946c661\") " pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:35.392755 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.392614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gghcc\" (UniqueName: \"kubernetes.io/projected/0c47c612-c4d0-4469-b2c6-09f16946c661-kube-api-access-gghcc\") pod \"odh-model-controller-7998c67dc4-s6h8r\" (UID: \"0c47c612-c4d0-4469-b2c6-09f16946c661\") " pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:35.395063 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.395037 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c47c612-c4d0-4469-b2c6-09f16946c661-cert\") pod \"odh-model-controller-7998c67dc4-s6h8r\" (UID: \"0c47c612-c4d0-4469-b2c6-09f16946c661\") " pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:35.400075 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.400044 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghcc\" (UniqueName: \"kubernetes.io/projected/0c47c612-c4d0-4469-b2c6-09f16946c661-kube-api-access-gghcc\") pod \"odh-model-controller-7998c67dc4-s6h8r\" (UID: \"0c47c612-c4d0-4469-b2c6-09f16946c661\") " pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:35.543446 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.543418 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:35.755727 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.755689 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" event={"ID":"3cf0009e-9f6a-44cd-adbe-8c9f6c468141","Type":"ContainerStarted","Data":"e383f81ac2699a48f6c02099a7a1415f2e0f8594b30c9634de6fc659d7d275b8"} Sep 13 20:08:35.773520 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.773491 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gchp2"] Sep 13 20:08:35.778253 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.778104 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:08:35.779506 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.779453 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" podStartSLOduration=1.873525002 podStartE2EDuration="4.779434775s" totalImagesPullingTime="2.905909773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:08:35.777779689 +0000 UTC m=+622.890927789" watchObservedRunningTime="2026-09-13 20:08:35.779434775 +0000 UTC m=+622.892582859" Sep 13 20:08:35.780490 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.780472 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 13 20:08:35.786497 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.786317 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gchp2"] Sep 13 20:08:35.815088 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.815071 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s6h8r"] Sep 13 20:08:35.818049 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:08:35.818024 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c47c612_c4d0_4469_b2c6_09f16946c661.slice/crio-9b306b6f9638493a9a0032d1dabed836d430ca5a0b164090ae4879eda10cc9b1 WatchSource:0}: Error finding container 9b306b6f9638493a9a0032d1dabed836d430ca5a0b164090ae4879eda10cc9b1: Status 404 returned error can't find the container with id 9b306b6f9638493a9a0032d1dabed836d430ca5a0b164090ae4879eda10cc9b1 Sep 13 20:08:35.896754 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.896723 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzpct\" (UniqueName: \"kubernetes.io/projected/afe45138-eed2-4c26-bf6c-c9f1fa69d9eb-kube-api-access-xzpct\") pod \"model-serving-api-54d89bd5fc-gchp2\" (UID: \"afe45138-eed2-4c26-bf6c-c9f1fa69d9eb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:08:35.897153 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.896770 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe45138-eed2-4c26-bf6c-c9f1fa69d9eb-tls-certs\") pod \"model-serving-api-54d89bd5fc-gchp2\" (UID: \"afe45138-eed2-4c26-bf6c-c9f1fa69d9eb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:08:35.997392 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.997355 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzpct\" (UniqueName: \"kubernetes.io/projected/afe45138-eed2-4c26-bf6c-c9f1fa69d9eb-kube-api-access-xzpct\") pod \"model-serving-api-54d89bd5fc-gchp2\" (UID: \"afe45138-eed2-4c26-bf6c-c9f1fa69d9eb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:08:35.997560 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.997408 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe45138-eed2-4c26-bf6c-c9f1fa69d9eb-tls-certs\") pod \"model-serving-api-54d89bd5fc-gchp2\" (UID: \"afe45138-eed2-4c26-bf6c-c9f1fa69d9eb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:08:36.000000 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:35.999964 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe45138-eed2-4c26-bf6c-c9f1fa69d9eb-tls-certs\") pod \"model-serving-api-54d89bd5fc-gchp2\" (UID: \"afe45138-eed2-4c26-bf6c-c9f1fa69d9eb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:08:36.004439 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:36.004416 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzpct\" (UniqueName: \"kubernetes.io/projected/afe45138-eed2-4c26-bf6c-c9f1fa69d9eb-kube-api-access-xzpct\") pod \"model-serving-api-54d89bd5fc-gchp2\" (UID: \"afe45138-eed2-4c26-bf6c-c9f1fa69d9eb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:08:36.092123 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:36.092040 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:08:36.376930 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:36.376858 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gchp2"] Sep 13 20:08:36.379769 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:08:36.379744 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe45138_eed2_4c26_bf6c_c9f1fa69d9eb.slice/crio-cc874f048f8341d5764c9273e30aafa218a0317111085c75925cc9f1ef1a006c WatchSource:0}: Error finding container cc874f048f8341d5764c9273e30aafa218a0317111085c75925cc9f1ef1a006c: Status 404 returned error can't find the container with id cc874f048f8341d5764c9273e30aafa218a0317111085c75925cc9f1ef1a006c Sep 13 20:08:36.668098 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:36.668025 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:36.673878 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:36.673851 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:36.763245 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:36.763172 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" event={"ID":"0c47c612-c4d0-4469-b2c6-09f16946c661","Type":"ContainerStarted","Data":"9b306b6f9638493a9a0032d1dabed836d430ca5a0b164090ae4879eda10cc9b1"} Sep 13 20:08:36.765072 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:36.765040 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" event={"ID":"afe45138-eed2-4c26-bf6c-c9f1fa69d9eb","Type":"ContainerStarted","Data":"cc874f048f8341d5764c9273e30aafa218a0317111085c75925cc9f1ef1a006c"} Sep 13 20:08:36.765250 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:36.765232 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:36.766539 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:36.766516 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd" Sep 13 20:08:39.726297 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:39.726274 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-95b884fcc-s9jjf" Sep 13 20:08:39.784591 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:39.784551 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" event={"ID":"0c47c612-c4d0-4469-b2c6-09f16946c661","Type":"ContainerStarted","Data":"6e8ea1617ed93784df1160baa473641c7365dbb81192dde777018b96430ad51b"} Sep 13 20:08:39.784758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:39.784664 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:39.786634 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:39.786590 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" event={"ID":"afe45138-eed2-4c26-bf6c-c9f1fa69d9eb","Type":"ContainerStarted","Data":"78f49ea3edd254ab394c7d568d6baf092bb7a119f5edbf55eb2f46830a1936a2"} Sep 13 20:08:39.786847 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:39.786654 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:08:39.800298 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:39.800245 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" podStartSLOduration=0.94592767 podStartE2EDuration="4.800225148s" totalImagesPullingTime="3.854297478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:08:39.798025401 +0000 UTC m=+626.911173526" watchObservedRunningTime="2026-09-13 20:08:39.800225148 +0000 UTC m=+626.913373232" Sep 13 20:08:39.813186 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:39.813138 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" podStartSLOduration=1.478609185 podStartE2EDuration="4.813121747s" totalImagesPullingTime="3.334512562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:08:39.812004465 +0000 UTC m=+626.925152576" watchObservedRunningTime="2026-09-13 20:08:39.813121747 +0000 UTC m=+626.926269829" Sep 13 20:08:41.687499 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.687460 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5"] Sep 13 20:08:41.690830 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.690801 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.693335 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.693310 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fxmf6\"" Sep 13 20:08:41.693335 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.693335 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 13 20:08:41.693519 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.693390 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 13 20:08:41.693519 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.693336 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 13 20:08:41.702234 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.702211 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5"] Sep 13 20:08:41.751642 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.751601 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.751642 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.751633 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.751642 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.751650 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkc8z\" (UniqueName: \"kubernetes.io/projected/4337c656-f857-4d35-83d6-45a92b30fe9d-kube-api-access-nkc8z\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.751958 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.751777 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.751958 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.751867 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4337c656-f857-4d35-83d6-45a92b30fe9d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.751958 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.751898 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.752111 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.751977 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4337c656-f857-4d35-83d6-45a92b30fe9d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.853005 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.852967 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4337c656-f857-4d35-83d6-45a92b30fe9d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.853166 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.853029 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.853166 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.853057 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.853166 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.853080 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkc8z\" (UniqueName: \"kubernetes.io/projected/4337c656-f857-4d35-83d6-45a92b30fe9d-kube-api-access-nkc8z\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.853166 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.853126 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.853444 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.853257 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4337c656-f857-4d35-83d6-45a92b30fe9d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.853444 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.853306 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.853891 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.853867 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.855423 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.855402 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4337c656-f857-4d35-83d6-45a92b30fe9d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.855520 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.855402 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4337c656-f857-4d35-83d6-45a92b30fe9d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.855561 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.855515 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.856084 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.856068 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.861159 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.861138 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkc8z\" (UniqueName: \"kubernetes.io/projected/4337c656-f857-4d35-83d6-45a92b30fe9d-kube-api-access-nkc8z\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.861246 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.861197 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4337c656-f857-4d35-83d6-45a92b30fe9d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jsmw5\" (UID: \"4337c656-f857-4d35-83d6-45a92b30fe9d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:41.999958 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:41.999881 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:42.274493 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:42.274463 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5"] Sep 13 20:08:42.277015 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:08:42.276986 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4337c656_f857_4d35_83d6_45a92b30fe9d.slice/crio-3da4636c7724cf6225ad850696ce5d5672f0cc8fbc45c3ba4aa847344ce1a6a1 WatchSource:0}: Error finding container 3da4636c7724cf6225ad850696ce5d5672f0cc8fbc45c3ba4aa847344ce1a6a1: Status 404 returned error can't find the container with id 3da4636c7724cf6225ad850696ce5d5672f0cc8fbc45c3ba4aa847344ce1a6a1 Sep 13 20:08:42.803692 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:42.803657 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" event={"ID":"4337c656-f857-4d35-83d6-45a92b30fe9d","Type":"ContainerStarted","Data":"3da4636c7724cf6225ad850696ce5d5672f0cc8fbc45c3ba4aa847344ce1a6a1"} Sep 13 20:08:44.464297 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:44.464265 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:08:44.464554 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:44.464328 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:08:44.814621 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:44.814577 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" event={"ID":"4337c656-f857-4d35-83d6-45a92b30fe9d","Type":"ContainerStarted","Data":"ddab308455052e7f361a7808d1d01955e4f9e25551689f1fd730316f1eb2757e"} Sep 13 20:08:44.814795 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:44.814692 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:44.835719 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:44.835659 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" podStartSLOduration=1.650695445 podStartE2EDuration="3.835641409s" totalImagesPullingTime="2.184945964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:08:44.834224491 +0000 UTC m=+631.947372588" watchObservedRunningTime="2026-09-13 20:08:44.835641409 +0000 UTC m=+631.948789493" Sep 13 20:08:45.821239 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:45.821201 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jsmw5" Sep 13 20:08:50.794069 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:50.794038 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-s6h8r" Sep 13 20:08:50.796665 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:08:50.796640 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gchp2" Sep 13 20:10:47.686795 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.686758 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4"] Sep 13 20:10:47.689557 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.689538 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.692289 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.692242 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jvdzt\"" Sep 13 20:10:47.700453 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.700428 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4"] Sep 13 20:10:47.770180 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.770141 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.770180 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.770184 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.770463 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.770217 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.770463 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.770299 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b9jq\" (UniqueName: \"kubernetes.io/projected/59563f0c-3cdc-4752-9153-7932e6c3d31f-kube-api-access-7b9jq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.770463 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.770365 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.770463 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.770388 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59563f0c-3cdc-4752-9153-7932e6c3d31f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.770463 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.770419 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.770463 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.770434 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.770687 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.770494 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.871502 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871465 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.871502 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871508 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.871761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871537 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.871761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871563 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b9jq\" (UniqueName: \"kubernetes.io/projected/59563f0c-3cdc-4752-9153-7932e6c3d31f-kube-api-access-7b9jq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.871761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871589 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.871761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871606 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59563f0c-3cdc-4752-9153-7932e6c3d31f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.871761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871642 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.871761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.871761 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871712 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.872152 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.871975 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.872253 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.872235 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.872311 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.872262 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.872311 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.872296 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.872485 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.872466 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59563f0c-3cdc-4752-9153-7932e6c3d31f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.874515 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.874483 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.874661 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.874645 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.879682 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.879657 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59563f0c-3cdc-4752-9153-7932e6c3d31f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:47.879785 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:47.879744 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b9jq\" (UniqueName: \"kubernetes.io/projected/59563f0c-3cdc-4752-9153-7932e6c3d31f-kube-api-access-7b9jq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-64hw4\" (UID: \"59563f0c-3cdc-4752-9153-7932e6c3d31f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:48.001874 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:48.001760 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:48.273865 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:48.273838 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4"] Sep 13 20:10:48.276148 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:10:48.276102 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59563f0c_3cdc_4752_9153_7932e6c3d31f.slice/crio-5bb1023333784361968f33d8dfe25ad5cf5918c4f3e891890b0e983b2803b25b WatchSource:0}: Error finding container 5bb1023333784361968f33d8dfe25ad5cf5918c4f3e891890b0e983b2803b25b: Status 404 returned error can't find the container with id 5bb1023333784361968f33d8dfe25ad5cf5918c4f3e891890b0e983b2803b25b Sep 13 20:10:48.278517 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:48.278480 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:10:48.278608 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:48.278552 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:10:48.278608 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:48.278578 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:10:48.378643 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:48.378608 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" event={"ID":"59563f0c-3cdc-4752-9153-7932e6c3d31f","Type":"ContainerStarted","Data":"c6a0af01a7dad3a2f4098e16b4886dddbb005fe686f948ef4a48bcc9950866cb"} Sep 13 20:10:48.378854 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:48.378666 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" event={"ID":"59563f0c-3cdc-4752-9153-7932e6c3d31f","Type":"ContainerStarted","Data":"5bb1023333784361968f33d8dfe25ad5cf5918c4f3e891890b0e983b2803b25b"} Sep 13 20:10:48.398662 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:48.398611 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" podStartSLOduration=1.3985963670000001 podStartE2EDuration="1.398596367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:10:48.395531774 +0000 UTC m=+755.508679873" watchObservedRunningTime="2026-09-13 20:10:48.398596367 +0000 UTC m=+755.511744449" Sep 13 20:10:49.002471 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:49.002430 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:49.007787 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:49.007756 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:49.386959 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:49.386924 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:10:49.388095 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:10:49.388077 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:11:38.100251 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.100173 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-89fbg"] Sep 13 20:11:38.102637 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.102611 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.107781 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.107448 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 13 20:11:38.108773 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.108746 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lvnsv\"" Sep 13 20:11:38.109551 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.109533 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 13 20:11:38.109797 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.109772 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 13 20:11:38.115544 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.115520 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-89fbg"] Sep 13 20:11:38.121179 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.121151 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-webhook-cert\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.121310 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.121214 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdz8w\" (UniqueName: \"kubernetes.io/projected/c8870ff8-dc57-42b2-925a-500bcf459971-kube-api-access-xdz8w\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.121310 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.121258 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-metrics-certs\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.222253 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.222214 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-webhook-cert\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.222447 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.222282 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdz8w\" (UniqueName: \"kubernetes.io/projected/c8870ff8-dc57-42b2-925a-500bcf459971-kube-api-access-xdz8w\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.222447 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.222326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-metrics-certs\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.222447 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:11:38.222376 2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 13 20:11:38.222595 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:11:38.222474 2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 13 20:11:38.222595 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:11:38.222482 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-webhook-cert podName:c8870ff8-dc57-42b2-925a-500bcf459971 nodeName:}" failed. No retries permitted until 2026-09-13 20:11:38.722465354 +0000 UTC m=+805.835613419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-webhook-cert") pod "maas-controller-98f5d4d4f-89fbg" (UID: "c8870ff8-dc57-42b2-925a-500bcf459971") : secret "maas-controller-webhook-cert" not found Sep 13 20:11:38.222595 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:11:38.222570 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-metrics-certs podName:c8870ff8-dc57-42b2-925a-500bcf459971 nodeName:}" failed. No retries permitted until 2026-09-13 20:11:38.722553557 +0000 UTC m=+805.835701622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-metrics-certs") pod "maas-controller-98f5d4d4f-89fbg" (UID: "c8870ff8-dc57-42b2-925a-500bcf459971") : secret "maas-controller-metrics-tls" not found Sep 13 20:11:38.232177 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.232146 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdz8w\" (UniqueName: \"kubernetes.io/projected/c8870ff8-dc57-42b2-925a-500bcf459971-kube-api-access-xdz8w\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.271621 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.271578 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-687b847df4-5mrh5"] Sep 13 20:11:38.278221 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.276624 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.285889 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.285862 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687b847df4-5mrh5"] Sep 13 20:11:38.323079 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.323039 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-metrics-certs\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.323079 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.323078 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67gjs\" (UniqueName: \"kubernetes.io/projected/3736c4d9-d009-40e8-ad2e-4633ff366083-kube-api-access-67gjs\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.323334 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.323172 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-webhook-cert\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.423947 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.423858 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-metrics-certs\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.423947 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.423899 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67gjs\" (UniqueName: \"kubernetes.io/projected/3736c4d9-d009-40e8-ad2e-4633ff366083-kube-api-access-67gjs\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.424131 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.423959 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-webhook-cert\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.424131 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:11:38.424004 2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 13 20:11:38.424131 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:11:38.424078 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-metrics-certs podName:3736c4d9-d009-40e8-ad2e-4633ff366083 nodeName:}" failed. No retries permitted until 2026-09-13 20:11:38.924058539 +0000 UTC m=+806.037206616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-metrics-certs") pod "maas-controller-687b847df4-5mrh5" (UID: "3736c4d9-d009-40e8-ad2e-4633ff366083") : secret "maas-controller-metrics-tls" not found Sep 13 20:11:38.426410 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.426383 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-webhook-cert\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.431836 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.431786 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67gjs\" (UniqueName: \"kubernetes.io/projected/3736c4d9-d009-40e8-ad2e-4633ff366083-kube-api-access-67gjs\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.727949 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.727854 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-metrics-certs\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.728128 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.727966 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-webhook-cert\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.730376 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.730346 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-metrics-certs\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.730513 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.730388 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-webhook-cert\") pod \"maas-controller-98f5d4d4f-89fbg\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:38.930270 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.930227 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-metrics-certs\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:38.932577 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:38.932555 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-metrics-certs\") pod \"maas-controller-687b847df4-5mrh5\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:39.016870 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:39.016767 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:39.191306 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:39.191267 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:39.285456 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:39.285430 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-89fbg"] Sep 13 20:11:39.287595 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:11:39.287564 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8870ff8_dc57_42b2_925a_500bcf459971.slice/crio-f24e294939ce92ec65631fb7c2c566de9fe5be8667ee3e7a5520cb19371657f6 WatchSource:0}: Error finding container f24e294939ce92ec65631fb7c2c566de9fe5be8667ee3e7a5520cb19371657f6: Status 404 returned error can't find the container with id f24e294939ce92ec65631fb7c2c566de9fe5be8667ee3e7a5520cb19371657f6 Sep 13 20:11:39.460281 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:39.460256 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687b847df4-5mrh5"] Sep 13 20:11:39.462328 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:11:39.462298 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3736c4d9_d009_40e8_ad2e_4633ff366083.slice/crio-18a0237f2021068fc273ec0fa4f57f132241c7f4c99a855ea35032ac2ce37fcb WatchSource:0}: Error finding container 18a0237f2021068fc273ec0fa4f57f132241c7f4c99a855ea35032ac2ce37fcb: Status 404 returned error can't find the container with id 18a0237f2021068fc273ec0fa4f57f132241c7f4c99a855ea35032ac2ce37fcb Sep 13 20:11:39.627538 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:39.627438 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b847df4-5mrh5" event={"ID":"3736c4d9-d009-40e8-ad2e-4633ff366083","Type":"ContainerStarted","Data":"18a0237f2021068fc273ec0fa4f57f132241c7f4c99a855ea35032ac2ce37fcb"} Sep 13 20:11:39.628450 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:39.628423 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" event={"ID":"c8870ff8-dc57-42b2-925a-500bcf459971","Type":"ContainerStarted","Data":"f24e294939ce92ec65631fb7c2c566de9fe5be8667ee3e7a5520cb19371657f6"} Sep 13 20:11:42.651279 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:42.651238 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b847df4-5mrh5" event={"ID":"3736c4d9-d009-40e8-ad2e-4633ff366083","Type":"ContainerStarted","Data":"f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc"} Sep 13 20:11:42.651713 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:42.651524 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:42.653209 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:42.653181 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" event={"ID":"c8870ff8-dc57-42b2-925a-500bcf459971","Type":"ContainerStarted","Data":"fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b"} Sep 13 20:11:42.653335 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:42.653305 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:42.675995 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:42.675929 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-687b847df4-5mrh5" podStartSLOduration=2.085903148 podStartE2EDuration="4.67590576s" totalImagesPullingTime="2.590002612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:11:42.675286665 +0000 UTC m=+809.788434761" watchObservedRunningTime="2026-09-13 20:11:42.67590576 +0000 UTC m=+809.789053844" Sep 13 20:11:42.699685 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:42.699624 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" podStartSLOduration=1.941292084 podStartE2EDuration="4.699606577s" totalImagesPullingTime="2.758314493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:11:42.697974481 +0000 UTC m=+809.811122588" watchObservedRunningTime="2026-09-13 20:11:42.699606577 +0000 UTC m=+809.812754660" Sep 13 20:11:53.660465 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:53.660434 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:53.660879 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:53.660500 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:11:53.716700 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:53.716670 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-89fbg"] Sep 13 20:11:53.716925 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:53.716895 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" podUID="c8870ff8-dc57-42b2-925a-500bcf459971" containerName="manager" containerID="cri-o://fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b" gracePeriod=30 Sep 13 20:11:53.959362 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:53.959338 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:54.082479 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.082447 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-metrics-certs\") pod \"c8870ff8-dc57-42b2-925a-500bcf459971\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " Sep 13 20:11:54.082676 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.082508 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdz8w\" (UniqueName: \"kubernetes.io/projected/c8870ff8-dc57-42b2-925a-500bcf459971-kube-api-access-xdz8w\") pod \"c8870ff8-dc57-42b2-925a-500bcf459971\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " Sep 13 20:11:54.082676 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.082604 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-webhook-cert\") pod \"c8870ff8-dc57-42b2-925a-500bcf459971\" (UID: \"c8870ff8-dc57-42b2-925a-500bcf459971\") " Sep 13 20:11:54.084974 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.084948 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c8870ff8-dc57-42b2-925a-500bcf459971" (UID: "c8870ff8-dc57-42b2-925a-500bcf459971"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:11:54.085089 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.084987 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c8870ff8-dc57-42b2-925a-500bcf459971" (UID: "c8870ff8-dc57-42b2-925a-500bcf459971"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:11:54.085089 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.085001 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8870ff8-dc57-42b2-925a-500bcf459971-kube-api-access-xdz8w" (OuterVolumeSpecName: "kube-api-access-xdz8w") pod "c8870ff8-dc57-42b2-925a-500bcf459971" (UID: "c8870ff8-dc57-42b2-925a-500bcf459971"). InnerVolumeSpecName "kube-api-access-xdz8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:11:54.183860 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.183802 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-webhook-cert\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:11:54.183860 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.183858 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8870ff8-dc57-42b2-925a-500bcf459971-metrics-certs\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:11:54.183860 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.183868 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdz8w\" (UniqueName: \"kubernetes.io/projected/c8870ff8-dc57-42b2-925a-500bcf459971-kube-api-access-xdz8w\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:11:54.711861 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.711806 2569 generic.go:356] "Generic (PLEG): container finished" podID="c8870ff8-dc57-42b2-925a-500bcf459971" containerID="fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b" exitCode=0 Sep 13 20:11:54.712353 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.711878 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" Sep 13 20:11:54.712353 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.711904 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" event={"ID":"c8870ff8-dc57-42b2-925a-500bcf459971","Type":"ContainerDied","Data":"fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b"} Sep 13 20:11:54.712353 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.711977 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98f5d4d4f-89fbg" event={"ID":"c8870ff8-dc57-42b2-925a-500bcf459971","Type":"ContainerDied","Data":"f24e294939ce92ec65631fb7c2c566de9fe5be8667ee3e7a5520cb19371657f6"} Sep 13 20:11:54.712353 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.711999 2569 scope.go:117] "RemoveContainer" containerID="fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b" Sep 13 20:11:54.721688 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.721499 2569 scope.go:117] "RemoveContainer" containerID="fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b" Sep 13 20:11:54.721854 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:11:54.721832 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b\": container with ID starting with fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b not found: ID does not exist" containerID="fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b" Sep 13 20:11:54.721912 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.721864 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b"} err="failed to get container status \"fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b\": rpc error: code = NotFound desc = could not find container \"fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b\": container with ID starting with fee3fe8eac4248a5251088cf02b247e0617c1b5057aabadf90ba77a1fa42194b not found: ID does not exist" Sep 13 20:11:54.732246 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.732226 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-89fbg"] Sep 13 20:11:54.735451 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:54.735431 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-89fbg"] Sep 13 20:11:55.407207 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:11:55.407173 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8870ff8-dc57-42b2-925a-500bcf459971" path="/var/lib/kubelet/pods/c8870ff8-dc57-42b2-925a-500bcf459971/volumes" Sep 13 20:12:16.017704 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.017664 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k225n"] Sep 13 20:12:16.018135 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.018050 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8870ff8-dc57-42b2-925a-500bcf459971" containerName="manager" Sep 13 20:12:16.018135 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.018061 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8870ff8-dc57-42b2-925a-500bcf459971" containerName="manager" Sep 13 20:12:16.018135 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.018120 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8870ff8-dc57-42b2-925a-500bcf459971" containerName="manager" Sep 13 20:12:16.022116 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.022100 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:16.024266 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.024245 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-986gp\"" Sep 13 20:12:16.024416 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.024397 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 13 20:12:16.031164 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.031140 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k225n"] Sep 13 20:12:16.083444 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.083403 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k225n\" (UID: \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:16.083641 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.083518 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rgtq\" (UniqueName: \"kubernetes.io/projected/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-kube-api-access-7rgtq\") pod \"payload-processing-5b54b7fbb7-k225n\" (UID: \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:16.184024 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.183986 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k225n\" (UID: \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:16.184204 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.184046 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rgtq\" (UniqueName: \"kubernetes.io/projected/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-kube-api-access-7rgtq\") pod \"payload-processing-5b54b7fbb7-k225n\" (UID: \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:16.184675 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.184657 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k225n\" (UID: \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:16.191635 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.191601 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rgtq\" (UniqueName: \"kubernetes.io/projected/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-kube-api-access-7rgtq\") pod \"payload-processing-5b54b7fbb7-k225n\" (UID: \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:16.333475 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.333440 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:16.602988 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:12:16.602958 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df2512f_2d9c_469b_a83a_f6dd00e5d4f1.slice/crio-4652796bdf54f8e0f5925f8dc7bf1c6848099a8404f3e4318074d25b364dab81 WatchSource:0}: Error finding container 4652796bdf54f8e0f5925f8dc7bf1c6848099a8404f3e4318074d25b364dab81: Status 404 returned error can't find the container with id 4652796bdf54f8e0f5925f8dc7bf1c6848099a8404f3e4318074d25b364dab81 Sep 13 20:12:16.603758 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.603676 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k225n"] Sep 13 20:12:16.821553 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:16.821515 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" event={"ID":"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1","Type":"ContainerStarted","Data":"4652796bdf54f8e0f5925f8dc7bf1c6848099a8404f3e4318074d25b364dab81"} Sep 13 20:12:19.838551 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:19.837974 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" event={"ID":"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1","Type":"ContainerStarted","Data":"e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3"} Sep 13 20:12:19.838551 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:19.838085 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:19.856003 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:19.855925 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" podStartSLOduration=1.069316577 podStartE2EDuration="3.85590356s" totalImagesPullingTime="2.786586983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:12:19.852996904 +0000 UTC m=+846.966145012" watchObservedRunningTime="2026-09-13 20:12:19.85590356 +0000 UTC m=+846.969051645" Sep 13 20:12:25.871220 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:25.871187 2569 generic.go:356] "Generic (PLEG): container finished" podID="59563f0c-3cdc-4752-9153-7932e6c3d31f" containerID="c6a0af01a7dad3a2f4098e16b4886dddbb005fe686f948ef4a48bcc9950866cb" exitCode=0 Sep 13 20:12:25.871645 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:25.871262 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" event={"ID":"59563f0c-3cdc-4752-9153-7932e6c3d31f","Type":"ContainerDied","Data":"c6a0af01a7dad3a2f4098e16b4886dddbb005fe686f948ef4a48bcc9950866cb"} Sep 13 20:12:25.871704 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:25.871672 2569 scope.go:117] "RemoveContainer" containerID="c6a0af01a7dad3a2f4098e16b4886dddbb005fe686f948ef4a48bcc9950866cb" Sep 13 20:12:25.872845 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:25.872795 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:12:25.872929 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:25.872887 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:12:25.872977 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:25.872928 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:12:26.879315 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:26.879277 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" event={"ID":"59563f0c-3cdc-4752-9153-7932e6c3d31f","Type":"ContainerStarted","Data":"6911f4a11a1e07916224122c3f99c56c4952b7f8f25713c0411747da9b0d4a77"} Sep 13 20:12:27.002962 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:27.002927 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:12:27.003158 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:27.003136 2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-64hw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 13 20:12:27.003216 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:27.003199 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" podUID="59563f0c-3cdc-4752-9153-7932e6c3d31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 13 20:12:28.002990 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:28.002958 2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-64hw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 13 20:12:28.003357 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:28.003012 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" podUID="59563f0c-3cdc-4752-9153-7932e6c3d31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 13 20:12:29.002891 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:29.002850 2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-64hw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 13 20:12:29.003078 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:29.002909 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" podUID="59563f0c-3cdc-4752-9153-7932e6c3d31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 13 20:12:30.002931 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:30.002896 2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-64hw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 13 20:12:30.003105 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:30.002980 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" podUID="59563f0c-3cdc-4752-9153-7932e6c3d31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 13 20:12:30.850081 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:30.850040 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:12:31.002504 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:31.002456 2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-64hw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 13 20:12:31.002701 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:31.002551 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" podUID="59563f0c-3cdc-4752-9153-7932e6c3d31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 13 20:12:32.250996 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:32.250951 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:12:32.251547 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:32.251366 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:12:32.252651 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:12:32.252629 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-64hw4" Sep 13 20:13:03.815555 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.815520 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg"] Sep 13 20:13:03.824326 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.824300 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg"] Sep 13 20:13:03.824483 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.824394 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:03.826971 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.826946 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 13 20:13:03.827852 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.827806 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 13 20:13:03.827979 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.827846 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-khw6f\"" Sep 13 20:13:03.827979 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.827834 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 13 20:13:03.927503 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.927461 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:03.927503 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.927505 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:03.927766 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.927541 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:03.927766 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.927583 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97b05694-72b6-49d9-96d9-65c141dde484-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:03.927766 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.927623 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnvcr\" (UniqueName: \"kubernetes.io/projected/97b05694-72b6-49d9-96d9-65c141dde484-kube-api-access-lnvcr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:03.927766 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:03.927654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.028985 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.028944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.028985 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.028986 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.029202 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.029012 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.029202 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.029126 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97b05694-72b6-49d9-96d9-65c141dde484-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.029202 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.029177 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnvcr\" (UniqueName: \"kubernetes.io/projected/97b05694-72b6-49d9-96d9-65c141dde484-kube-api-access-lnvcr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.029390 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.029363 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.029466 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.029434 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.029539 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.029465 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.029718 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.029694 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.031315 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.031293 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97b05694-72b6-49d9-96d9-65c141dde484-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.031591 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.031574 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97b05694-72b6-49d9-96d9-65c141dde484-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.036908 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.036886 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnvcr\" (UniqueName: \"kubernetes.io/projected/97b05694-72b6-49d9-96d9-65c141dde484-kube-api-access-lnvcr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kk7gg\" (UID: \"97b05694-72b6-49d9-96d9-65c141dde484\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.154427 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.154331 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:04.425597 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:04.425573 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg"] Sep 13 20:13:04.427270 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:13:04.427245 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b05694_72b6_49d9_96d9_65c141dde484.slice/crio-c1246f77c3878db97f0575930b724a52984de515d23adba4d15f39daa0a9fe8e WatchSource:0}: Error finding container c1246f77c3878db97f0575930b724a52984de515d23adba4d15f39daa0a9fe8e: Status 404 returned error can't find the container with id c1246f77c3878db97f0575930b724a52984de515d23adba4d15f39daa0a9fe8e Sep 13 20:13:05.065326 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:05.065287 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" event={"ID":"97b05694-72b6-49d9-96d9-65c141dde484","Type":"ContainerStarted","Data":"c1246f77c3878db97f0575930b724a52984de515d23adba4d15f39daa0a9fe8e"} Sep 13 20:13:06.072181 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:06.072147 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" event={"ID":"97b05694-72b6-49d9-96d9-65c141dde484","Type":"ContainerStarted","Data":"5d3634efa4afd30b92cce67b01151e3d1a4e04481d04b848995b58d0f28b4bb2"} Sep 13 20:13:06.089278 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:06.089223 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" podStartSLOduration=2.080707943 podStartE2EDuration="3.089207431s" totalImagesPullingTime="1.008499488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:06.08733375 +0000 UTC m=+893.200481866" watchObservedRunningTime="2026-09-13 20:13:06.089207431 +0000 UTC m=+893.202355514" Sep 13 20:13:14.155148 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:14.155119 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:14.155536 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:14.155178 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:14.167830 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:14.167784 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:15.128600 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:15.128568 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kk7gg" Sep 13 20:13:18.701561 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.701518 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns"] Sep 13 20:13:18.705847 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.705822 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.708607 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.708587 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 13 20:13:18.714254 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.714230 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns"] Sep 13 20:13:18.773655 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.773619 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.773655 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.773663 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.773894 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.773699 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.773894 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.773717 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j75h5\" (UniqueName: \"kubernetes.io/projected/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-kube-api-access-j75h5\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.773894 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.773742 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.773894 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.773833 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.875159 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.875121 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.875347 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.875178 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.875347 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.875279 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.875347 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.875316 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.875347 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.875342 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.875565 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.875366 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j75h5\" (UniqueName: \"kubernetes.io/projected/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-kube-api-access-j75h5\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.875617 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.875568 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.875672 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.875624 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.875724 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.875699 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.877552 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.877535 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.877734 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.877718 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:18.882386 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:18.882362 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j75h5\" (UniqueName: \"kubernetes.io/projected/e27b90c3-1a88-4a1f-90c4-0caacea7dba5-kube-api-access-j75h5\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns\" (UID: \"e27b90c3-1a88-4a1f-90c4-0caacea7dba5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:19.017637 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:19.017543 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:19.286804 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:19.286778 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns"] Sep 13 20:13:19.288993 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:13:19.288961 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27b90c3_1a88_4a1f_90c4_0caacea7dba5.slice/crio-443a6ec9d86fed2e774a66a6591483a1d2fdec1051fda2a68fa67a2a595691ca WatchSource:0}: Error finding container 443a6ec9d86fed2e774a66a6591483a1d2fdec1051fda2a68fa67a2a595691ca: Status 404 returned error can't find the container with id 443a6ec9d86fed2e774a66a6591483a1d2fdec1051fda2a68fa67a2a595691ca Sep 13 20:13:20.149717 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:20.149673 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" event={"ID":"e27b90c3-1a88-4a1f-90c4-0caacea7dba5","Type":"ContainerStarted","Data":"a6e4ed5183027e75cf9ecc073081c3305e76b4a4265b0077c4069a707b320494"} Sep 13 20:13:20.150213 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:20.149744 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" event={"ID":"e27b90c3-1a88-4a1f-90c4-0caacea7dba5","Type":"ContainerStarted","Data":"443a6ec9d86fed2e774a66a6591483a1d2fdec1051fda2a68fa67a2a595691ca"} Sep 13 20:13:20.167723 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:20.167674 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" podStartSLOduration=1.9768309469999998 podStartE2EDuration="2.167653452s" totalImagesPullingTime="190.822505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:20.165621098 +0000 UTC m=+907.278769218" watchObservedRunningTime="2026-09-13 20:13:20.167653452 +0000 UTC m=+907.280801536" Sep 13 20:13:29.017886 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:29.017847 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:29.018374 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:29.017939 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:29.030684 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:29.030659 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:13:29.203974 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:13:29.203945 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xfwns" Sep 13 20:15:00.137888 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:00.137849 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x"] Sep 13 20:15:00.141597 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:00.141579 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x" Sep 13 20:15:00.143940 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:00.143916 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjst\"" Sep 13 20:15:00.149352 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:00.149094 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x"] Sep 13 20:15:00.153057 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:00.153037 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x" Sep 13 20:15:00.422141 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:00.422118 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x"] Sep 13 20:15:00.424952 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:15:00.424925 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52331459_6cc0_444a_979b_e2db32a4e776.slice/crio-5888e34216368cfacc6d6af0773ba0f5215d9810dd3d7e3920e662cb102e4a54 WatchSource:0}: Error finding container 5888e34216368cfacc6d6af0773ba0f5215d9810dd3d7e3920e662cb102e4a54: Status 404 returned error can't find the container with id 5888e34216368cfacc6d6af0773ba0f5215d9810dd3d7e3920e662cb102e4a54 Sep 13 20:15:00.427328 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:00.427312 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:15:00.637768 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:00.637733 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x" event={"ID":"52331459-6cc0-444a-979b-e2db32a4e776","Type":"ContainerStarted","Data":"5888e34216368cfacc6d6af0773ba0f5215d9810dd3d7e3920e662cb102e4a54"} Sep 13 20:15:03.656031 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:03.655996 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x" event={"ID":"52331459-6cc0-444a-979b-e2db32a4e776","Type":"ContainerStarted","Data":"5ce2e5aa738c79aecef55fb44dc30a7f80bf303a33c068fcae1fc101770ceca7"} Sep 13 20:15:04.662203 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:04.662164 2569 generic.go:356] "Generic (PLEG): container finished" podID="52331459-6cc0-444a-979b-e2db32a4e776" containerID="5ce2e5aa738c79aecef55fb44dc30a7f80bf303a33c068fcae1fc101770ceca7" exitCode=0 Sep 13 20:15:04.662660 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:04.662242 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x" event={"ID":"52331459-6cc0-444a-979b-e2db32a4e776","Type":"ContainerDied","Data":"5ce2e5aa738c79aecef55fb44dc30a7f80bf303a33c068fcae1fc101770ceca7"} Sep 13 20:15:04.790723 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:04.790696 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x" Sep 13 20:15:05.668392 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:05.668309 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x" event={"ID":"52331459-6cc0-444a-979b-e2db32a4e776","Type":"ContainerDied","Data":"5888e34216368cfacc6d6af0773ba0f5215d9810dd3d7e3920e662cb102e4a54"} Sep 13 20:15:05.668392 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:05.668346 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822175-d668x" Sep 13 20:15:05.668392 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:05.668356 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5888e34216368cfacc6d6af0773ba0f5215d9810dd3d7e3920e662cb102e4a54" Sep 13 20:15:13.895847 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:13.895793 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-687b847df4-5mrh5"] Sep 13 20:15:13.896241 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:13.896056 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-687b847df4-5mrh5" podUID="3736c4d9-d009-40e8-ad2e-4633ff366083" containerName="manager" containerID="cri-o://f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc" gracePeriod=30 Sep 13 20:15:14.129671 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.129638 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k225n"] Sep 13 20:15:14.129963 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.129910 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" podUID="0df2512f-2d9c-469b-a83a-f6dd00e5d4f1" containerName="payload-processing" containerID="cri-o://e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3" gracePeriod=30 Sep 13 20:15:14.206688 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.206659 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:15:14.336313 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.336275 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-webhook-cert\") pod \"3736c4d9-d009-40e8-ad2e-4633ff366083\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " Sep 13 20:15:14.336505 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.336343 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-metrics-certs\") pod \"3736c4d9-d009-40e8-ad2e-4633ff366083\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " Sep 13 20:15:14.336505 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.336466 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67gjs\" (UniqueName: \"kubernetes.io/projected/3736c4d9-d009-40e8-ad2e-4633ff366083-kube-api-access-67gjs\") pod \"3736c4d9-d009-40e8-ad2e-4633ff366083\" (UID: \"3736c4d9-d009-40e8-ad2e-4633ff366083\") " Sep 13 20:15:14.338639 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.338603 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3736c4d9-d009-40e8-ad2e-4633ff366083" (UID: "3736c4d9-d009-40e8-ad2e-4633ff366083"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:15:14.338913 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.338887 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3736c4d9-d009-40e8-ad2e-4633ff366083-kube-api-access-67gjs" (OuterVolumeSpecName: "kube-api-access-67gjs") pod "3736c4d9-d009-40e8-ad2e-4633ff366083" (UID: "3736c4d9-d009-40e8-ad2e-4633ff366083"). InnerVolumeSpecName "kube-api-access-67gjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:15:14.340436 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.340409 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3736c4d9-d009-40e8-ad2e-4633ff366083" (UID: "3736c4d9-d009-40e8-ad2e-4633ff366083"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:15:14.376092 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.376066 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:15:14.437284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.437199 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rgtq\" (UniqueName: \"kubernetes.io/projected/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-kube-api-access-7rgtq\") pod \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\" (UID: \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\") " Sep 13 20:15:14.437284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.437244 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-plugins-config-volume\") pod \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\" (UID: \"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1\") " Sep 13 20:15:14.437518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.437392 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-metrics-certs\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:15:14.437518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.437402 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67gjs\" (UniqueName: \"kubernetes.io/projected/3736c4d9-d009-40e8-ad2e-4633ff366083-kube-api-access-67gjs\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:15:14.437518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.437410 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3736c4d9-d009-40e8-ad2e-4633ff366083-webhook-cert\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:15:14.437683 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.437612 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0df2512f-2d9c-469b-a83a-f6dd00e5d4f1" (UID: "0df2512f-2d9c-469b-a83a-f6dd00e5d4f1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:15:14.439498 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.439475 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-kube-api-access-7rgtq" (OuterVolumeSpecName: "kube-api-access-7rgtq") pod "0df2512f-2d9c-469b-a83a-f6dd00e5d4f1" (UID: "0df2512f-2d9c-469b-a83a-f6dd00e5d4f1"). InnerVolumeSpecName "kube-api-access-7rgtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:15:14.538518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.538489 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rgtq\" (UniqueName: \"kubernetes.io/projected/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-kube-api-access-7rgtq\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:15:14.538518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.538516 2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1-plugins-config-volume\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:15:14.713888 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.713782 2569 generic.go:356] "Generic (PLEG): container finished" podID="0df2512f-2d9c-469b-a83a-f6dd00e5d4f1" containerID="e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3" exitCode=0 Sep 13 20:15:14.713888 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.713847 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" event={"ID":"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1","Type":"ContainerDied","Data":"e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3"} Sep 13 20:15:14.714093 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.713907 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" event={"ID":"0df2512f-2d9c-469b-a83a-f6dd00e5d4f1","Type":"ContainerDied","Data":"4652796bdf54f8e0f5925f8dc7bf1c6848099a8404f3e4318074d25b364dab81"} Sep 13 20:15:14.714093 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.713858 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k225n" Sep 13 20:15:14.714093 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.713930 2569 scope.go:117] "RemoveContainer" containerID="e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3" Sep 13 20:15:14.715380 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.715356 2569 generic.go:356] "Generic (PLEG): container finished" podID="3736c4d9-d009-40e8-ad2e-4633ff366083" containerID="f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc" exitCode=0 Sep 13 20:15:14.715473 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.715393 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b847df4-5mrh5" Sep 13 20:15:14.715473 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.715421 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b847df4-5mrh5" event={"ID":"3736c4d9-d009-40e8-ad2e-4633ff366083","Type":"ContainerDied","Data":"f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc"} Sep 13 20:15:14.715589 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.715474 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b847df4-5mrh5" event={"ID":"3736c4d9-d009-40e8-ad2e-4633ff366083","Type":"ContainerDied","Data":"18a0237f2021068fc273ec0fa4f57f132241c7f4c99a855ea35032ac2ce37fcb"} Sep 13 20:15:14.723836 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.723799 2569 scope.go:117] "RemoveContainer" containerID="e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3" Sep 13 20:15:14.724093 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:15:14.724077 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3\": container with ID starting with e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3 not found: ID does not exist" containerID="e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3" Sep 13 20:15:14.724140 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.724101 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3"} err="failed to get container status \"e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3\": rpc error: code = NotFound desc = could not find container \"e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3\": container with ID starting with e64a71d33b46490403ed74f365a6e189ad9b8e12266dcc639d113730d8e3bae3 not found: ID does not exist" Sep 13 20:15:14.724140 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.724118 2569 scope.go:117] "RemoveContainer" containerID="f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc" Sep 13 20:15:14.732149 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.732131 2569 scope.go:117] "RemoveContainer" containerID="f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc" Sep 13 20:15:14.732426 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:15:14.732405 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc\": container with ID starting with f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc not found: ID does not exist" containerID="f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc" Sep 13 20:15:14.732481 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.732434 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc"} err="failed to get container status \"f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc\": rpc error: code = NotFound desc = could not find container \"f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc\": container with ID starting with f3e69ef87491a8db297788e84f987171e295096ecdb392510ac3afc3640499cc not found: ID does not exist" Sep 13 20:15:14.737318 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.737299 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-687b847df4-5mrh5"] Sep 13 20:15:14.743534 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.743513 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-687b847df4-5mrh5"] Sep 13 20:15:14.752996 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.752977 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k225n"] Sep 13 20:15:14.756284 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:14.756265 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k225n"] Sep 13 20:15:15.007945 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.007864 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp"] Sep 13 20:15:15.008370 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.008252 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52331459-6cc0-444a-979b-e2db32a4e776" containerName="cleanup" Sep 13 20:15:15.008370 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.008264 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="52331459-6cc0-444a-979b-e2db32a4e776" containerName="cleanup" Sep 13 20:15:15.008370 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.008279 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df2512f-2d9c-469b-a83a-f6dd00e5d4f1" containerName="payload-processing" Sep 13 20:15:15.008370 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.008286 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df2512f-2d9c-469b-a83a-f6dd00e5d4f1" containerName="payload-processing" Sep 13 20:15:15.008370 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.008296 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3736c4d9-d009-40e8-ad2e-4633ff366083" containerName="manager" Sep 13 20:15:15.008370 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.008301 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3736c4d9-d009-40e8-ad2e-4633ff366083" containerName="manager" Sep 13 20:15:15.008370 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.008358 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df2512f-2d9c-469b-a83a-f6dd00e5d4f1" containerName="payload-processing" Sep 13 20:15:15.008370 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.008368 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="52331459-6cc0-444a-979b-e2db32a4e776" containerName="cleanup" Sep 13 20:15:15.008370 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.008377 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3736c4d9-d009-40e8-ad2e-4633ff366083" containerName="manager" Sep 13 20:15:15.012559 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.012541 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" Sep 13 20:15:15.014842 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.014819 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 13 20:15:15.014957 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.014907 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-b62dp\"" Sep 13 20:15:15.020196 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.020170 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp"] Sep 13 20:15:15.043594 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.043561 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lpmq\" (UniqueName: \"kubernetes.io/projected/ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60-kube-api-access-7lpmq\") pod \"ai-gateway-controller-6b57f8d4cf-zjwcp\" (UID: \"ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60\") " pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" Sep 13 20:15:15.144946 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.144906 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lpmq\" (UniqueName: \"kubernetes.io/projected/ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60-kube-api-access-7lpmq\") pod \"ai-gateway-controller-6b57f8d4cf-zjwcp\" (UID: \"ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60\") " pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" Sep 13 20:15:15.152270 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.152247 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lpmq\" (UniqueName: \"kubernetes.io/projected/ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60-kube-api-access-7lpmq\") pod \"ai-gateway-controller-6b57f8d4cf-zjwcp\" (UID: \"ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60\") " pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" Sep 13 20:15:15.324016 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.323974 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" Sep 13 20:15:15.408740 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.408704 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0df2512f-2d9c-469b-a83a-f6dd00e5d4f1" path="/var/lib/kubelet/pods/0df2512f-2d9c-469b-a83a-f6dd00e5d4f1/volumes" Sep 13 20:15:15.409224 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.409202 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3736c4d9-d009-40e8-ad2e-4633ff366083" path="/var/lib/kubelet/pods/3736c4d9-d009-40e8-ad2e-4633ff366083/volumes" Sep 13 20:15:15.591220 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.591180 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp"] Sep 13 20:15:15.593723 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:15:15.593689 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded47bfdb_ed47_4ec9_a20b_1dbcf7addd60.slice/crio-5b294c4639c6349dd2c42c86ccf187df1c6ac941efa977769ff4791f402d6739 WatchSource:0}: Error finding container 5b294c4639c6349dd2c42c86ccf187df1c6ac941efa977769ff4791f402d6739: Status 404 returned error can't find the container with id 5b294c4639c6349dd2c42c86ccf187df1c6ac941efa977769ff4791f402d6739 Sep 13 20:15:15.725405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:15.725367 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" event={"ID":"ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60","Type":"ContainerStarted","Data":"5b294c4639c6349dd2c42c86ccf187df1c6ac941efa977769ff4791f402d6739"} Sep 13 20:15:17.738117 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:17.738079 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" event={"ID":"ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60","Type":"ContainerStarted","Data":"81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607"} Sep 13 20:15:17.738603 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:17.738188 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" Sep 13 20:15:17.754308 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:17.754259 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" podStartSLOduration=2.467815216 podStartE2EDuration="3.754245674s" totalImagesPullingTime="1.286430458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:15:17.751867 +0000 UTC m=+1024.865015106" watchObservedRunningTime="2026-09-13 20:15:17.754245674 +0000 UTC m=+1024.867393757" Sep 13 20:15:28.745900 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:28.745862 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" Sep 13 20:15:28.928753 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:28.928712 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-7b987b879c-m4wx4"] Sep 13 20:15:28.932521 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:28.932499 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" Sep 13 20:15:28.939614 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:28.939590 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7b987b879c-m4wx4"] Sep 13 20:15:28.970649 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:28.970621 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt22l\" (UniqueName: \"kubernetes.io/projected/3bb440ad-8f24-4180-bd24-9ce5fcbcaafc-kube-api-access-wt22l\") pod \"ai-gateway-controller-7b987b879c-m4wx4\" (UID: \"3bb440ad-8f24-4180-bd24-9ce5fcbcaafc\") " pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" Sep 13 20:15:29.071631 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:29.071586 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt22l\" (UniqueName: \"kubernetes.io/projected/3bb440ad-8f24-4180-bd24-9ce5fcbcaafc-kube-api-access-wt22l\") pod \"ai-gateway-controller-7b987b879c-m4wx4\" (UID: \"3bb440ad-8f24-4180-bd24-9ce5fcbcaafc\") " pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" Sep 13 20:15:29.079366 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:29.079339 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt22l\" (UniqueName: \"kubernetes.io/projected/3bb440ad-8f24-4180-bd24-9ce5fcbcaafc-kube-api-access-wt22l\") pod \"ai-gateway-controller-7b987b879c-m4wx4\" (UID: \"3bb440ad-8f24-4180-bd24-9ce5fcbcaafc\") " pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" Sep 13 20:15:29.245103 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:29.245068 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" Sep 13 20:15:29.512850 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:29.512828 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7b987b879c-m4wx4"] Sep 13 20:15:29.514984 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:15:29.514947 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb440ad_8f24_4180_bd24_9ce5fcbcaafc.slice/crio-90ff768c3143f346519c1bbad5d7cea380b28abdf491a00bb5b4824fa373d6b6 WatchSource:0}: Error finding container 90ff768c3143f346519c1bbad5d7cea380b28abdf491a00bb5b4824fa373d6b6: Status 404 returned error can't find the container with id 90ff768c3143f346519c1bbad5d7cea380b28abdf491a00bb5b4824fa373d6b6 Sep 13 20:15:29.798303 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:29.798270 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" event={"ID":"3bb440ad-8f24-4180-bd24-9ce5fcbcaafc","Type":"ContainerStarted","Data":"90ff768c3143f346519c1bbad5d7cea380b28abdf491a00bb5b4824fa373d6b6"} Sep 13 20:15:30.804323 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:30.804288 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" event={"ID":"3bb440ad-8f24-4180-bd24-9ce5fcbcaafc","Type":"ContainerStarted","Data":"78c56337092e441f0a60ee07f6d6d31b551397ee90341e95059e6990b4c9cedf"} Sep 13 20:15:30.804794 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:30.804486 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" Sep 13 20:15:30.819022 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:30.818960 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" podStartSLOduration=2.4742876320000002 podStartE2EDuration="2.81894111s" totalImagesPullingTime="344.653478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:15:30.818378741 +0000 UTC m=+1037.931526838" watchObservedRunningTime="2026-09-13 20:15:30.81894111 +0000 UTC m=+1037.932089194" Sep 13 20:15:41.811644 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:41.811614 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-7b987b879c-m4wx4" Sep 13 20:15:41.848535 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:41.848502 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp"] Sep 13 20:15:41.848712 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:41.848687 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" podUID="ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60" containerName="manager" containerID="cri-o://81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607" gracePeriod=30 Sep 13 20:15:42.096562 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.096536 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" Sep 13 20:15:42.195343 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.195297 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lpmq\" (UniqueName: \"kubernetes.io/projected/ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60-kube-api-access-7lpmq\") pod \"ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60\" (UID: \"ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60\") " Sep 13 20:15:42.197355 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.197324 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60-kube-api-access-7lpmq" (OuterVolumeSpecName: "kube-api-access-7lpmq") pod "ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60" (UID: "ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60"). InnerVolumeSpecName "kube-api-access-7lpmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:15:42.296245 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.296197 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lpmq\" (UniqueName: \"kubernetes.io/projected/ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60-kube-api-access-7lpmq\") on node \"ip-10-0-142-113.ec2.internal\" DevicePath \"\"" Sep 13 20:15:42.867734 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.867703 2569 generic.go:356] "Generic (PLEG): container finished" podID="ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60" containerID="81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607" exitCode=0 Sep 13 20:15:42.868159 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.867745 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" Sep 13 20:15:42.868159 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.867748 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" event={"ID":"ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60","Type":"ContainerDied","Data":"81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607"} Sep 13 20:15:42.868159 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.867878 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp" event={"ID":"ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60","Type":"ContainerDied","Data":"5b294c4639c6349dd2c42c86ccf187df1c6ac941efa977769ff4791f402d6739"} Sep 13 20:15:42.868159 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.867906 2569 scope.go:117] "RemoveContainer" containerID="81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607" Sep 13 20:15:42.877325 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.877311 2569 scope.go:117] "RemoveContainer" containerID="81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607" Sep 13 20:15:42.877574 ip-10-0-142-113 kubenswrapper[2569]: E0913 20:15:42.877556 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607\": container with ID starting with 81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607 not found: ID does not exist" containerID="81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607" Sep 13 20:15:42.877638 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.877586 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607"} err="failed to get container status \"81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607\": rpc error: code = NotFound desc = could not find container \"81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607\": container with ID starting with 81f197de1c64ef4aad8bbd7847b4b9e1e62fa7b95107378413fdf2523de31607 not found: ID does not exist" Sep 13 20:15:42.888644 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.888610 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp"] Sep 13 20:15:42.890309 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:42.890290 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-6b57f8d4cf-zjwcp"] Sep 13 20:15:43.407889 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:15:43.407855 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60" path="/var/lib/kubelet/pods/ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60/volumes" Sep 13 20:18:41.242628 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.242590 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-7b987b879c-m4wx4_3bb440ad-8f24-4180-bd24-9ce5fcbcaafc/manager/0.log" Sep 13 20:18:41.468582 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.468542 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-687b847df4-rpsc8"] Sep 13 20:18:41.469031 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.469014 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60" containerName="manager" Sep 13 20:18:41.469031 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.469033 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60" containerName="manager" Sep 13 20:18:41.469184 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.469127 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed47bfdb-ed47-4ec9-a20b-1dbcf7addd60" containerName="manager" Sep 13 20:18:41.472136 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.472115 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.476267 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.476243 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lvnsv\"" Sep 13 20:18:41.476381 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.476370 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 13 20:18:41.476459 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.476445 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 13 20:18:41.476544 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.476531 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 13 20:18:41.503011 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.502940 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687b847df4-rpsc8"] Sep 13 20:18:41.562153 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.562121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h55f7\" (UniqueName: \"kubernetes.io/projected/5b4597e1-bbe8-40bf-998c-8c84f97e7dfa-kube-api-access-h55f7\") pod \"maas-controller-687b847df4-rpsc8\" (UID: \"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa\") " pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.562336 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.562184 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b4597e1-bbe8-40bf-998c-8c84f97e7dfa-metrics-certs\") pod \"maas-controller-687b847df4-rpsc8\" (UID: \"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa\") " pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.562336 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.562207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b4597e1-bbe8-40bf-998c-8c84f97e7dfa-webhook-cert\") pod \"maas-controller-687b847df4-rpsc8\" (UID: \"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa\") " pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.663220 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.663181 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b4597e1-bbe8-40bf-998c-8c84f97e7dfa-metrics-certs\") pod \"maas-controller-687b847df4-rpsc8\" (UID: \"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa\") " pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.663411 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.663228 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b4597e1-bbe8-40bf-998c-8c84f97e7dfa-webhook-cert\") pod \"maas-controller-687b847df4-rpsc8\" (UID: \"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa\") " pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.663411 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.663290 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55f7\" (UniqueName: \"kubernetes.io/projected/5b4597e1-bbe8-40bf-998c-8c84f97e7dfa-kube-api-access-h55f7\") pod \"maas-controller-687b847df4-rpsc8\" (UID: \"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa\") " pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.665672 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.665651 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b4597e1-bbe8-40bf-998c-8c84f97e7dfa-webhook-cert\") pod \"maas-controller-687b847df4-rpsc8\" (UID: \"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa\") " pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.665785 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.665749 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b4597e1-bbe8-40bf-998c-8c84f97e7dfa-metrics-certs\") pod \"maas-controller-687b847df4-rpsc8\" (UID: \"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa\") " pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.670756 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.670736 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h55f7\" (UniqueName: \"kubernetes.io/projected/5b4597e1-bbe8-40bf-998c-8c84f97e7dfa-kube-api-access-h55f7\") pod \"maas-controller-687b847df4-rpsc8\" (UID: \"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa\") " pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:41.782511 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:41.782481 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:42.052720 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:42.052695 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687b847df4-rpsc8"] Sep 13 20:18:42.054702 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:18:42.054677 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4597e1_bbe8_40bf_998c_8c84f97e7dfa.slice/crio-8e2d71e7a272d302c23c6a44f7f48e22c7c6640aa265d2cd8ff376701e87fed0 WatchSource:0}: Error finding container 8e2d71e7a272d302c23c6a44f7f48e22c7c6640aa265d2cd8ff376701e87fed0: Status 404 returned error can't find the container with id 8e2d71e7a272d302c23c6a44f7f48e22c7c6640aa265d2cd8ff376701e87fed0 Sep 13 20:18:42.744518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:42.744433 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b847df4-rpsc8" event={"ID":"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa","Type":"ContainerStarted","Data":"044194d59297abeb7ed4113968544a8252723bba8be85efebe3fc81982ceab0f"} Sep 13 20:18:42.744518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:42.744485 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b847df4-rpsc8" event={"ID":"5b4597e1-bbe8-40bf-998c-8c84f97e7dfa","Type":"ContainerStarted","Data":"8e2d71e7a272d302c23c6a44f7f48e22c7c6640aa265d2cd8ff376701e87fed0"} Sep 13 20:18:42.744917 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:42.744556 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:42.761455 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:42.761402 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-687b847df4-rpsc8" podStartSLOduration=1.371815911 podStartE2EDuration="1.761385783s" totalImagesPullingTime="389.569872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:18:42.759635427 +0000 UTC m=+1229.872783531" watchObservedRunningTime="2026-09-13 20:18:42.761385783 +0000 UTC m=+1229.874533904" Sep 13 20:18:53.751990 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:53.751956 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-687b847df4-rpsc8" Sep 13 20:18:57.536210 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:57.536177 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qfsm9_d313ffdb-9c1c-442c-b9ed-06eb5b20ec99/global-pull-secret-syncer/0.log" Sep 13 20:18:57.661580 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:57.661552 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-htg87_aa735bd5-2718-4898-a9a8-dc76008e50df/konnectivity-agent/0.log" Sep 13 20:18:57.751978 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:18:57.751949 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-113.ec2.internal_d7461e26c7315106ef2eff1b716d85f1/haproxy/0.log" Sep 13 20:19:01.444614 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.444581 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-r7kz6"] Sep 13 20:19:01.448351 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.448330 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:01.450732 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.450713 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-986gp\"" Sep 13 20:19:01.450896 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.450773 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 13 20:19:01.456484 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.456461 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-r7kz6"] Sep 13 20:19:01.495400 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.495366 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m"] Sep 13 20:19:01.498782 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.498766 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:01.507454 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.507432 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m"] Sep 13 20:19:01.549356 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.549320 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt266\" (UniqueName: \"kubernetes.io/projected/4c4f758b-256c-45fd-9a35-697a977965aa-kube-api-access-vt266\") pod \"payload-processing-5b54b7fbb7-r7kz6\" (UID: \"4c4f758b-256c-45fd-9a35-697a977965aa\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:01.549500 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.549381 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c4f758b-256c-45fd-9a35-697a977965aa-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-r7kz6\" (UID: \"4c4f758b-256c-45fd-9a35-697a977965aa\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:01.650805 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.650769 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt266\" (UniqueName: \"kubernetes.io/projected/4c4f758b-256c-45fd-9a35-697a977965aa-kube-api-access-vt266\") pod \"payload-processing-5b54b7fbb7-r7kz6\" (UID: \"4c4f758b-256c-45fd-9a35-697a977965aa\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:01.651019 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.650840 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a88103b6-5498-49d4-9f15-1784a1d6f640-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-ffb6m\" (UID: \"a88103b6-5498-49d4-9f15-1784a1d6f640\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:01.651019 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.650867 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c4f758b-256c-45fd-9a35-697a977965aa-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-r7kz6\" (UID: \"4c4f758b-256c-45fd-9a35-697a977965aa\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:01.651019 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.650978 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqm5z\" (UniqueName: \"kubernetes.io/projected/a88103b6-5498-49d4-9f15-1784a1d6f640-kube-api-access-pqm5z\") pod \"payload-pre-processing-59fbc47bf8-ffb6m\" (UID: \"a88103b6-5498-49d4-9f15-1784a1d6f640\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:01.651518 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.651500 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c4f758b-256c-45fd-9a35-697a977965aa-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-r7kz6\" (UID: \"4c4f758b-256c-45fd-9a35-697a977965aa\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:01.658296 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.658277 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt266\" (UniqueName: \"kubernetes.io/projected/4c4f758b-256c-45fd-9a35-697a977965aa-kube-api-access-vt266\") pod \"payload-processing-5b54b7fbb7-r7kz6\" (UID: \"4c4f758b-256c-45fd-9a35-697a977965aa\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:01.752147 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.752056 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a88103b6-5498-49d4-9f15-1784a1d6f640-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-ffb6m\" (UID: \"a88103b6-5498-49d4-9f15-1784a1d6f640\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:01.752298 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.752160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqm5z\" (UniqueName: \"kubernetes.io/projected/a88103b6-5498-49d4-9f15-1784a1d6f640-kube-api-access-pqm5z\") pod \"payload-pre-processing-59fbc47bf8-ffb6m\" (UID: \"a88103b6-5498-49d4-9f15-1784a1d6f640\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:01.752795 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.752774 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a88103b6-5498-49d4-9f15-1784a1d6f640-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-ffb6m\" (UID: \"a88103b6-5498-49d4-9f15-1784a1d6f640\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:01.759669 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.759637 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqm5z\" (UniqueName: \"kubernetes.io/projected/a88103b6-5498-49d4-9f15-1784a1d6f640-kube-api-access-pqm5z\") pod \"payload-pre-processing-59fbc47bf8-ffb6m\" (UID: \"a88103b6-5498-49d4-9f15-1784a1d6f640\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:01.761421 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.761403 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:01.811994 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:01.811973 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:02.030872 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.030848 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-r7kz6"] Sep 13 20:19:02.032805 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:19:02.032777 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4f758b_256c_45fd_9a35_697a977965aa.slice/crio-483ad3ce349a4224e97ad4532eb93d52ba4849abc02672f463607b3b81912dc3 WatchSource:0}: Error finding container 483ad3ce349a4224e97ad4532eb93d52ba4849abc02672f463607b3b81912dc3: Status 404 returned error can't find the container with id 483ad3ce349a4224e97ad4532eb93d52ba4849abc02672f463607b3b81912dc3 Sep 13 20:19:02.097517 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.097493 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m"] Sep 13 20:19:02.099156 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:19:02.099131 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88103b6_5498_49d4_9f15_1784a1d6f640.slice/crio-25cdf5d3849a768e295a9e270b24685465a32463af3c6e436ce298b3b71730ff WatchSource:0}: Error finding container 25cdf5d3849a768e295a9e270b24685465a32463af3c6e436ce298b3b71730ff: Status 404 returned error can't find the container with id 25cdf5d3849a768e295a9e270b24685465a32463af3c6e436ce298b3b71730ff Sep 13 20:19:02.849198 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.849158 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" event={"ID":"a88103b6-5498-49d4-9f15-1784a1d6f640","Type":"ContainerStarted","Data":"3843dca2d7f77a3cb7d9677df96271bd856dda5c508f66b216c58c7594893334"} Sep 13 20:19:02.849666 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.849226 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" event={"ID":"a88103b6-5498-49d4-9f15-1784a1d6f640","Type":"ContainerStarted","Data":"25cdf5d3849a768e295a9e270b24685465a32463af3c6e436ce298b3b71730ff"} Sep 13 20:19:02.849666 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.849337 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:02.850769 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.850744 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" event={"ID":"4c4f758b-256c-45fd-9a35-697a977965aa","Type":"ContainerStarted","Data":"6a99805b699852c1f639688de93d5fefd48294a045f9834a72dfedb87fc124ed"} Sep 13 20:19:02.850907 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.850783 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" event={"ID":"4c4f758b-256c-45fd-9a35-697a977965aa","Type":"ContainerStarted","Data":"483ad3ce349a4224e97ad4532eb93d52ba4849abc02672f463607b3b81912dc3"} Sep 13 20:19:02.850907 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.850828 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:02.865068 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.865020 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" podStartSLOduration=1.865004505 podStartE2EDuration="1.865004505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:19:02.863467324 +0000 UTC m=+1249.976615426" watchObservedRunningTime="2026-09-13 20:19:02.865004505 +0000 UTC m=+1249.978152587" Sep 13 20:19:02.877794 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:02.877725 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" podStartSLOduration=1.877707671 podStartE2EDuration="1.877707671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:19:02.877458761 +0000 UTC m=+1249.990606869" watchObservedRunningTime="2026-09-13 20:19:02.877707671 +0000 UTC m=+1249.990855754" Sep 13 20:19:03.819567 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:03.819530 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3606352-8a04-49dc-9098-ebeb08e03f0d/alertmanager/0.log" Sep 13 20:19:03.844405 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:03.844379 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3606352-8a04-49dc-9098-ebeb08e03f0d/config-reloader/0.log" Sep 13 20:19:03.864678 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:03.864648 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3606352-8a04-49dc-9098-ebeb08e03f0d/kube-rbac-proxy-web/0.log" Sep 13 20:19:03.883314 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:03.883289 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3606352-8a04-49dc-9098-ebeb08e03f0d/kube-rbac-proxy/0.log" Sep 13 20:19:03.903339 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:03.903272 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3606352-8a04-49dc-9098-ebeb08e03f0d/kube-rbac-proxy-metric/0.log" Sep 13 20:19:03.923892 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:03.923872 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3606352-8a04-49dc-9098-ebeb08e03f0d/prom-label-proxy/0.log" Sep 13 20:19:03.942289 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:03.942268 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3606352-8a04-49dc-9098-ebeb08e03f0d/init-config-reloader/0.log" Sep 13 20:19:03.988627 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:03.988601 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-zc2h9_91f08fdb-d699-4ac6-b31a-705cacd93db1/cluster-monitoring-operator/0.log" Sep 13 20:19:04.142001 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.141969 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bb48t_b9989315-f368-48e8-b412-30d3fc3ddc8b/node-exporter/0.log" Sep 13 20:19:04.160167 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.160090 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bb48t_b9989315-f368-48e8-b412-30d3fc3ddc8b/kube-rbac-proxy/0.log" Sep 13 20:19:04.181930 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.181910 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bb48t_b9989315-f368-48e8-b412-30d3fc3ddc8b/init-textfile/0.log" Sep 13 20:19:04.370172 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.370134 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-s6rgf_3e3ed14f-33db-4329-a030-eab21d26f46f/kube-rbac-proxy-main/0.log" Sep 13 20:19:04.393126 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.393101 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-s6rgf_3e3ed14f-33db-4329-a030-eab21d26f46f/kube-rbac-proxy-self/0.log" Sep 13 20:19:04.412458 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.412371 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-s6rgf_3e3ed14f-33db-4329-a030-eab21d26f46f/openshift-state-metrics/0.log" Sep 13 20:19:04.447923 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.447886 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fabedabb-12b4-4f35-b6d2-e8328429466d/prometheus/0.log" Sep 13 20:19:04.471434 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.471407 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fabedabb-12b4-4f35-b6d2-e8328429466d/config-reloader/0.log" Sep 13 20:19:04.495967 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.495944 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fabedabb-12b4-4f35-b6d2-e8328429466d/thanos-sidecar/0.log" Sep 13 20:19:04.515216 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.515189 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fabedabb-12b4-4f35-b6d2-e8328429466d/kube-rbac-proxy-web/0.log" Sep 13 20:19:04.534104 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.534080 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fabedabb-12b4-4f35-b6d2-e8328429466d/kube-rbac-proxy/0.log" Sep 13 20:19:04.553673 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.553656 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fabedabb-12b4-4f35-b6d2-e8328429466d/kube-rbac-proxy-thanos/0.log" Sep 13 20:19:04.573617 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.573595 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fabedabb-12b4-4f35-b6d2-e8328429466d/init-config-reloader/0.log" Sep 13 20:19:04.600347 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.600320 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-x9ld2_764f2657-ce85-47b0-8aa6-e4794046d9b6/prometheus-operator/0.log" Sep 13 20:19:04.615440 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.615417 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-x9ld2_764f2657-ce85-47b0-8aa6-e4794046d9b6/kube-rbac-proxy/0.log" Sep 13 20:19:04.638681 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:04.638659 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-tvgwj_ca4b6a9d-f71e-4599-984c-aea6c5828491/prometheus-operator-admission-webhook/0.log" Sep 13 20:19:06.353519 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:06.353490 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-l7zs5_28b67391-3565-4995-88db-bfcf87c81c1f/networking-console-plugin/0.log" Sep 13 20:19:08.108609 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.108571 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz"] Sep 13 20:19:08.113290 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.113269 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.115348 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.115323 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mwr95\"/\"default-dockercfg-kqvcq\"" Sep 13 20:19:08.116279 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.116257 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwr95\"/\"kube-root-ca.crt\"" Sep 13 20:19:08.116400 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.116320 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwr95\"/\"openshift-service-ca.crt\"" Sep 13 20:19:08.118941 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.118916 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz"] Sep 13 20:19:08.212325 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.212278 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbxmd\" (UniqueName: \"kubernetes.io/projected/647ba853-ab7b-46a2-a29f-5c2d4360e892-kube-api-access-lbxmd\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.212498 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.212333 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-proc\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.212498 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.212428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-lib-modules\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.212498 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.212486 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-sys\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.212613 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.212542 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-podres\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.313378 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.313345 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbxmd\" (UniqueName: \"kubernetes.io/projected/647ba853-ab7b-46a2-a29f-5c2d4360e892-kube-api-access-lbxmd\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.313542 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.313384 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-proc\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.313542 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.313434 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-lib-modules\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.313675 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.313601 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-lib-modules\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.313675 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.313620 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-sys\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.313675 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.313658 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-sys\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.313675 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.313601 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-proc\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.313833 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.313719 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-podres\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.313875 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.313847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/647ba853-ab7b-46a2-a29f-5c2d4360e892-podres\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.320668 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.320643 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbxmd\" (UniqueName: \"kubernetes.io/projected/647ba853-ab7b-46a2-a29f-5c2d4360e892-kube-api-access-lbxmd\") pod \"perf-node-gather-daemonset-7x8wz\" (UID: \"647ba853-ab7b-46a2-a29f-5c2d4360e892\") " pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.424782 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.424699 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.695981 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.695949 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz"] Sep 13 20:19:08.697879 ip-10-0-142-113 kubenswrapper[2569]: W0913 20:19:08.697852 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod647ba853_ab7b_46a2_a29f_5c2d4360e892.slice/crio-02adf9fba65531bcccb3c26bc41040718a555b801619a6845e92023d58facf04 WatchSource:0}: Error finding container 02adf9fba65531bcccb3c26bc41040718a555b801619a6845e92023d58facf04: Status 404 returned error can't find the container with id 02adf9fba65531bcccb3c26bc41040718a555b801619a6845e92023d58facf04 Sep 13 20:19:08.880908 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.880872 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" event={"ID":"647ba853-ab7b-46a2-a29f-5c2d4360e892","Type":"ContainerStarted","Data":"e5a06453b8e59434cef2632a332991a3ded96b94350910a95d95a346a6803004"} Sep 13 20:19:08.881087 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.880931 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" event={"ID":"647ba853-ab7b-46a2-a29f-5c2d4360e892","Type":"ContainerStarted","Data":"02adf9fba65531bcccb3c26bc41040718a555b801619a6845e92023d58facf04"} Sep 13 20:19:08.881087 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.880959 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:08.895449 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:08.895389 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" podStartSLOduration=0.895370191 podStartE2EDuration="895.370191ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:19:08.895016912 +0000 UTC m=+1256.008165014" watchObservedRunningTime="2026-09-13 20:19:08.895370191 +0000 UTC m=+1256.008518274" Sep 13 20:19:09.330555 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:09.330519 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f9s98_778172bd-98e3-4ca4-a15f-12b06c94ae66/dns/0.log" Sep 13 20:19:09.349385 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:09.349364 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f9s98_778172bd-98e3-4ca4-a15f-12b06c94ae66/kube-rbac-proxy/0.log" Sep 13 20:19:09.435987 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:09.435949 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ncgpc_a2b5801b-42a5-4419-841a-6411b1c69ffd/dns-node-resolver/0.log" Sep 13 20:19:10.009332 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:10.009301 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7nqq_36d1e385-0377-4ed8-912d-2c5fdc1e7be6/node-ca/0.log" Sep 13 20:19:10.919782 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:10.919752 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd_3cf0009e-9f6a-44cd-adbe-8c9f6c468141/istio-proxy/0.log" Sep 13 20:19:10.980716 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:10.980685 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jsmw5_4337c656-f857-4d35-83d6-45a92b30fe9d/discovery/0.log" Sep 13 20:19:11.053318 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:11.053283 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-64hw4_59563f0c-3cdc-4752-9153-7932e6c3d31f/istio-proxy/1.log" Sep 13 20:19:11.053979 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:11.053949 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-64hw4_59563f0c-3cdc-4752-9153-7932e6c3d31f/istio-proxy/0.log" Sep 13 20:19:11.071918 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:11.071890 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-ffb6m_a88103b6-5498-49d4-9f15-1784a1d6f640/payload-pre-processing/0.log" Sep 13 20:19:11.094056 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:11.094034 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-r7kz6_4c4f758b-256c-45fd-9a35-697a977965aa/payload-processing/0.log" Sep 13 20:19:11.116514 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:11.116477 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c6dbdcb8-7qsmg_7704f8cb-d331-48b5-9a17-dde4d3d33af5/router/0.log" Sep 13 20:19:11.771724 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:11.771692 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgjt2_3b873e7a-1282-4602-9959-9208c4de4d7e/serve-healthcheck-canary/0.log" Sep 13 20:19:12.362130 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:12.362100 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m74g8_31c2b737-47a9-48ab-a8e5-df78d3548ec7/kube-rbac-proxy/0.log" Sep 13 20:19:12.379626 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:12.379600 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m74g8_31c2b737-47a9-48ab-a8e5-df78d3548ec7/exporter/0.log" Sep 13 20:19:12.398527 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:12.398497 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m74g8_31c2b737-47a9-48ab-a8e5-df78d3548ec7/extractor/0.log" Sep 13 20:19:13.858825 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:13.858772 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ffb6m" Sep 13 20:19:13.859207 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:13.858962 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-r7kz6" Sep 13 20:19:14.398653 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:14.398626 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-7b987b879c-m4wx4_3bb440ad-8f24-4180-bd24-9ce5fcbcaafc/manager/0.log" Sep 13 20:19:14.486694 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:14.486656 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-687b847df4-rpsc8_5b4597e1-bbe8-40bf-998c-8c84f97e7dfa/manager/0.log" Sep 13 20:19:14.505041 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:14.505011 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gchp2_afe45138-eed2-4c26-bf6c-c9f1fa69d9eb/server/0.log" Sep 13 20:19:14.572164 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:14.572131 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-s6h8r_0c47c612-c4d0-4469-b2c6-09f16946c661/manager/0.log" Sep 13 20:19:14.708060 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:14.707976 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dc4cfddb-rh7gh_d32c6e3b-bfd8-4564-9b01-d400b9f6761f/manager/0.log" Sep 13 20:19:14.724484 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:14.724459 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dc4cfddb-rh7gh_d32c6e3b-bfd8-4564-9b01-d400b9f6761f/copy-manifests/0.log" Sep 13 20:19:14.896186 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:14.896158 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mwr95/perf-node-gather-daemonset-7x8wz" Sep 13 20:19:15.840025 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:15.839985 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-95b884fcc-s9jjf_ca857f14-5666-4f9e-877c-58bda435c6f3/manager/0.log" Sep 13 20:19:17.749683 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:17.749643 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd_3cf0009e-9f6a-44cd-adbe-8c9f6c468141/istio-proxy/0.log" Sep 13 20:19:17.802970 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:17.802944 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jsmw5_4337c656-f857-4d35-83d6-45a92b30fe9d/discovery/0.log" Sep 13 20:19:17.861432 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:17.861407 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-64hw4_59563f0c-3cdc-4752-9153-7932e6c3d31f/istio-proxy/1.log" Sep 13 20:19:17.882498 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:17.882473 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-64hw4_59563f0c-3cdc-4752-9153-7932e6c3d31f/istio-proxy/0.log" Sep 13 20:19:17.909211 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:17.909188 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-ffb6m_a88103b6-5498-49d4-9f15-1784a1d6f640/payload-pre-processing/0.log" Sep 13 20:19:17.948137 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:17.948112 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-r7kz6_4c4f758b-256c-45fd-9a35-697a977965aa/payload-processing/0.log" Sep 13 20:19:17.966910 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:17.966882 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c6dbdcb8-7qsmg_7704f8cb-d331-48b5-9a17-dde4d3d33af5/router/0.log" Sep 13 20:19:19.066769 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:19.066736 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5cvpd_3cf0009e-9f6a-44cd-adbe-8c9f6c468141/istio-proxy/0.log" Sep 13 20:19:19.125202 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:19.125170 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jsmw5_4337c656-f857-4d35-83d6-45a92b30fe9d/discovery/0.log" Sep 13 20:19:19.180061 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:19.180014 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-64hw4_59563f0c-3cdc-4752-9153-7932e6c3d31f/istio-proxy/1.log" Sep 13 20:19:19.180683 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:19.180663 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-64hw4_59563f0c-3cdc-4752-9153-7932e6c3d31f/istio-proxy/0.log" Sep 13 20:19:19.195090 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:19.195063 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-ffb6m_a88103b6-5498-49d4-9f15-1784a1d6f640/payload-pre-processing/0.log" Sep 13 20:19:19.211876 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:19.211851 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-r7kz6_4c4f758b-256c-45fd-9a35-697a977965aa/payload-processing/0.log" Sep 13 20:19:19.233155 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:19.233126 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c6dbdcb8-7qsmg_7704f8cb-d331-48b5-9a17-dde4d3d33af5/router/0.log" Sep 13 20:19:21.481584 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:21.481545 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-nq7dz_e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6/kube-storage-version-migrator-operator/1.log" Sep 13 20:19:21.483393 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:21.483368 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-nq7dz_e7b8cef0-b6ab-4c71-b0e4-dd9f14d46de6/kube-storage-version-migrator-operator/0.log" Sep 13 20:19:22.521046 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:22.521017 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcc85_d1f0c999-550f-4957-a2e4-9ef903418850/kube-multus-additional-cni-plugins/0.log" Sep 13 20:19:22.540215 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:22.540167 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcc85_d1f0c999-550f-4957-a2e4-9ef903418850/egress-router-binary-copy/0.log" Sep 13 20:19:22.558854 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:22.558820 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcc85_d1f0c999-550f-4957-a2e4-9ef903418850/cni-plugins/0.log" Sep 13 20:19:22.577549 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:22.577517 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcc85_d1f0c999-550f-4957-a2e4-9ef903418850/bond-cni-plugin/0.log" Sep 13 20:19:22.595379 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:22.595356 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcc85_d1f0c999-550f-4957-a2e4-9ef903418850/routeoverride-cni/0.log" Sep 13 20:19:22.612766 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:22.612740 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcc85_d1f0c999-550f-4957-a2e4-9ef903418850/whereabouts-cni-bincopy/0.log" Sep 13 20:19:22.630604 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:22.630576 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcc85_d1f0c999-550f-4957-a2e4-9ef903418850/whereabouts-cni/0.log" Sep 13 20:19:22.960123 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:22.960097 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g2fmm_6a563e60-e64b-4e7d-8211-650ee89a4816/kube-multus/0.log" Sep 13 20:19:23.006867 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:23.006834 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7lwvg_8579a980-87c8-459e-90c7-d81ac524a9e6/network-metrics-daemon/0.log" Sep 13 20:19:23.024166 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:23.024138 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7lwvg_8579a980-87c8-459e-90c7-d81ac524a9e6/kube-rbac-proxy/0.log" Sep 13 20:19:23.875995 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:23.875966 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bhcvh_8d81020d-4c38-4543-8b9f-7686539e35e9/ovn-controller/0.log" Sep 13 20:19:23.892971 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:23.892932 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bhcvh_8d81020d-4c38-4543-8b9f-7686539e35e9/ovn-acl-logging/0.log" Sep 13 20:19:23.922005 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:23.921973 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bhcvh_8d81020d-4c38-4543-8b9f-7686539e35e9/kube-rbac-proxy-node/0.log" Sep 13 20:19:23.945897 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:23.945869 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bhcvh_8d81020d-4c38-4543-8b9f-7686539e35e9/kube-rbac-proxy-ovn-metrics/0.log" Sep 13 20:19:23.960828 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:23.960784 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bhcvh_8d81020d-4c38-4543-8b9f-7686539e35e9/northd/0.log" Sep 13 20:19:23.979100 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:23.979060 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bhcvh_8d81020d-4c38-4543-8b9f-7686539e35e9/nbdb/0.log" Sep 13 20:19:23.998322 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:23.998298 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bhcvh_8d81020d-4c38-4543-8b9f-7686539e35e9/sbdb/0.log" Sep 13 20:19:24.053603 ip-10-0-142-113 kubenswrapper[2569]: I0913 20:19:24.053573 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bhcvh_8d81020d-4c38-4543-8b9f-7686539e35e9/ovnkube-controller/0.log"