Sep 09 20:52:18.116304 ip-10-0-140-67 systemd[1]: Starting Kubernetes Kubelet... Sep 09 20:52:18.511512 ip-10-0-140-67 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:52:18.511512 ip-10-0-140-67 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 20:52:18.511512 ip-10-0-140-67 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:52:18.511512 ip-10-0-140-67 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 20:52:18.511512 ip-10-0-140-67 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:52:18.513418 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.513325 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 20:52:18.516247 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516226 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:52:18.516247 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516242 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:52:18.516247 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516250 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516255 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516261 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516265 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516269 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516273 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516277 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516287 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516291 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516295 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516298 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516302 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516307 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516312 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516317 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516322 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516327 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516331 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516335 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516340 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:52:18.516447 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516344 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516349 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516354 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516358 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516362 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516367 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516372 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516376 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516381 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516387 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516391 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516396 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516401 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516405 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516409 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516414 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516419 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516423 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516428 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:52:18.517344 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516432 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516436 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516440 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516444 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516448 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516452 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516456 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516460 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516464 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516468 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516472 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516476 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516480 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516485 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516489 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516494 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516498 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516503 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516507 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516511 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:52:18.518159 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516515 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516520 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516524 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516528 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516532 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516536 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516541 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516545 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516550 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516554 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516559 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516563 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516567 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516573 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516578 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516582 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516586 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516590 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516594 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516598 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:52:18.518994 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516602 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516606 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516610 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516616 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516623 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516627 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516632 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516636 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516640 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516645 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516649 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516653 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516657 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516661 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516666 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516670 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516674 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.516679 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517814 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517825 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:52:18.519950 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517830 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517835 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517839 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517853 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517858 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517861 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517866 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517870 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517874 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517879 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517883 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517890 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517896 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517901 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517905 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517910 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517914 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517918 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517923 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517927 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:52:18.520811 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517931 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517935 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517940 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517944 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517948 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517952 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517956 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517960 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517967 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517973 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517978 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517983 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517988 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517993 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.517997 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518001 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518013 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518017 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518021 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:52:18.521502 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518025 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518049 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518054 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518058 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518062 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518066 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518070 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518075 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518078 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518083 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518087 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518091 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518095 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518100 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518104 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518108 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518112 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518116 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518121 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:52:18.521995 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518125 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518129 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518133 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518138 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518142 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518146 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518150 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518155 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518161 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518165 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518168 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518180 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518185 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518189 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518194 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518198 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518204 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518208 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518213 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518217 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:52:18.522519 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518221 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518226 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518230 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518234 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518238 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518242 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518247 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518251 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518255 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518259 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518264 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518268 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518273 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518277 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518281 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518285 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518289 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518294 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518298 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:52:18.523193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518903 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518911 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518915 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518919 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518929 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518933 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518937 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518942 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518946 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518950 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518955 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518959 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518964 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518968 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518973 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518977 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518981 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518986 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518990 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518993 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:52:18.523653 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.518997 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519002 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519006 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519009 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519013 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519017 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519021 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519025 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519045 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519051 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519055 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519059 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519063 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519068 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519072 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519076 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519080 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519085 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519089 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:52:18.524245 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519095 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519101 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519106 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519111 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519115 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519119 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519123 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519132 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519137 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519142 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519147 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519151 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519155 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519160 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519164 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519169 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519173 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519177 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519181 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519185 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:52:18.524708 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519190 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519194 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519198 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519204 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519208 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519212 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519216 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519220 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519224 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519228 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519233 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519238 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519242 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519246 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519250 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519254 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519259 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519263 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519267 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:52:18.525238 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519272 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519276 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519281 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519285 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519289 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519295 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519301 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519306 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519310 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519314 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519318 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519322 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519326 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519330 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519334 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519338 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519342 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519346 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519350 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:52:18.525712 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519355 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.519359 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519466 2560 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519512 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519521 2560 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519528 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519541 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519546 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519553 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519559 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519564 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519569 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519575 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519583 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519588 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519593 2560 flags.go:64] FLAG: --cgroup-root="" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519597 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519602 2560 flags.go:64] FLAG: --client-ca-file="" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519606 2560 flags.go:64] FLAG: --cloud-provider="external" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519611 2560 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519622 2560 flags.go:64] FLAG: --cluster-domain="" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519627 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519632 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519637 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 20:52:18.526193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519642 2560 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519648 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519653 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519658 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519663 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519667 2560 flags.go:64] FLAG: --contention-profiling="false" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519672 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519676 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519680 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519685 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519693 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519698 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519702 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519706 2560 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519710 2560 flags.go:64] FLAG: --enable-server="true" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519715 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519721 2560 flags.go:64] FLAG: --event-burst="100" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519726 2560 flags.go:64] FLAG: --event-qps="50" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519730 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519735 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519739 2560 flags.go:64] FLAG: --eviction-hard="" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519746 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519751 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519755 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519759 2560 flags.go:64] FLAG: --eviction-soft="" Sep 09 20:52:18.526766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519764 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519769 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519773 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519778 2560 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519783 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519787 2560 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519792 2560 flags.go:64] FLAG: --feature-gates="" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519798 2560 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519803 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519808 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519813 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519818 2560 flags.go:64] FLAG: --healthz-port="10248" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519823 2560 flags.go:64] FLAG: --help="false" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519828 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519834 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519839 2560 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519844 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519851 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519857 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519861 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519866 2560 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519870 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519875 2560 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 20:52:18.527485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519881 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519886 2560 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519891 2560 flags.go:64] FLAG: --kube-reserved="" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519895 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519900 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519907 2560 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519911 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519916 2560 flags.go:64] FLAG: --lock-file="" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519921 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519926 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519931 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519939 2560 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519944 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519948 2560 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519952 2560 flags.go:64] FLAG: --logging-format="text" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519957 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519962 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519966 2560 flags.go:64] FLAG: --manifest-url="" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519971 2560 flags.go:64] FLAG: --manifest-url-header="" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519977 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519982 2560 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519989 2560 flags.go:64] FLAG: --max-pods="110" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519994 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.519998 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520003 2560 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 20:52:18.528093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520009 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520016 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520020 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520026 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520054 2560 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520059 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520064 2560 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520070 2560 flags.go:64] FLAG: --pod-cidr="" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520075 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520083 2560 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520087 2560 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520093 2560 flags.go:64] FLAG: --pods-per-core="0" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520097 2560 flags.go:64] FLAG: --port="10250" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520105 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520109 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0308ffc6ed066a015" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520115 2560 flags.go:64] FLAG: --qos-reserved="" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520120 2560 flags.go:64] FLAG: --read-only-port="10255" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520125 2560 flags.go:64] FLAG: --register-node="true" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520129 2560 flags.go:64] FLAG: --register-with-taints="" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520135 2560 flags.go:64] FLAG: --registry-burst="10" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520140 2560 flags.go:64] FLAG: --registry-qps="5" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520145 2560 flags.go:64] FLAG: --reserved-cpus="" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520150 2560 flags.go:64] FLAG: --reserved-memory="" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520156 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520161 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 20:52:18.528699 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520165 2560 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520170 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520175 2560 flags.go:64] FLAG: --runonce="false" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520180 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520185 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520190 2560 flags.go:64] FLAG: --seccomp-default="false" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520195 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520199 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520206 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520211 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520216 2560 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520221 2560 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520226 2560 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520230 2560 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520235 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520240 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520245 2560 flags.go:64] FLAG: --system-cgroups="" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520251 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520260 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520264 2560 flags.go:64] FLAG: --tls-cert-file="" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520270 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520277 2560 flags.go:64] FLAG: --tls-min-version="" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520282 2560 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520287 2560 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520292 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 20:52:18.529334 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520296 2560 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520301 2560 flags.go:64] FLAG: --v="2" Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520308 2560 flags.go:64] FLAG: --version="false" Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520314 2560 flags.go:64] FLAG: --vmodule="" Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520320 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520325 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520519 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520527 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520532 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520536 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520541 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520546 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520552 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520558 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520562 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520569 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520575 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520579 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520584 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520588 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:52:18.529940 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520592 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520596 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520600 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520604 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520609 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520613 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520618 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520625 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520629 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520634 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520638 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520642 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520646 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520650 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520654 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520659 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520663 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520667 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520671 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520676 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:52:18.530464 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520680 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520684 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520688 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520692 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520696 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520700 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520705 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520711 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520715 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520719 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520723 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520727 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520731 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520735 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520739 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520743 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520747 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520752 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520757 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520764 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:52:18.531002 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520770 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520775 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520779 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520783 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520788 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520792 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520796 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520800 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520804 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520808 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520812 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520816 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520820 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520824 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520828 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520832 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520836 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520840 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520844 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520849 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:52:18.531650 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520854 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520860 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520866 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520871 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520875 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520879 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520883 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520887 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520892 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520896 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520901 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520907 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520911 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520915 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520919 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520923 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520927 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520931 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520936 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520940 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:52:18.532324 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520944 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520948 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520953 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520957 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.520961 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.520968 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.528625 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.528640 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.529472 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.529483 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529536 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529542 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529545 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529549 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529552 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:52:18.532845 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529555 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529558 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529561 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529564 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529566 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529571 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529574 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529577 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529580 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529583 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529586 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529589 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529591 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529594 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529596 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529599 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529601 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529604 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529606 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:52:18.533258 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529610 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529614 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529617 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529620 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529622 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529627 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529630 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529633 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529635 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529638 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529640 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529643 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529646 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529649 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529651 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529654 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529656 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529659 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529661 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529664 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:52:18.533743 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529667 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529669 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529672 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529674 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529677 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529679 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529682 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529684 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529687 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529689 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529691 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529694 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529697 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529699 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529702 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529704 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529707 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529710 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529713 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529716 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:52:18.534318 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529718 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529721 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529723 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529726 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529729 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529731 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529734 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529736 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529739 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529741 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529743 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529746 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529749 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529751 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529754 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529756 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529759 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529761 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529764 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529766 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:52:18.534841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529769 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529771 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529773 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529777 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529781 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529784 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529786 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529789 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529792 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529794 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529797 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529800 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529803 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529805 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529808 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:52:18.535383 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.529812 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529950 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529956 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529959 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529962 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529965 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529968 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529971 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529974 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529976 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529979 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529982 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529984 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529987 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529989 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529992 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529994 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529997 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.529999 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:52:18.535751 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530002 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530004 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530007 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530009 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530012 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530014 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530017 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530020 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530022 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530025 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530028 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530042 2560 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530045 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530047 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530050 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530052 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530055 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530058 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530061 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530065 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:52:18.536222 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530068 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530071 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530074 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530076 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530079 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530082 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530085 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530088 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530091 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530093 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530096 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530099 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530101 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530103 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530106 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530109 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530111 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530114 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530116 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:52:18.536707 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530119 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530121 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530124 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530127 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530130 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530133 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530135 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530138 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530140 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530143 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530145 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530148 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530150 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530153 2560 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530155 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530157 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530160 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530162 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530165 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530167 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:52:18.537168 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530170 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530172 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530175 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530177 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530180 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530182 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530185 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530188 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530190 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530194 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530197 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530200 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530203 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530206 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530208 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530211 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530213 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530216 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530218 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:52:18.537648 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530221 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:52:18.538214 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530223 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:52:18.538214 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:18.530226 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:52:18.538214 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.530230 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:52:18.538214 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.530325 2560 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 20:52:18.538214 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.534707 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 20:52:18.538214 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.536286 2560 server.go:1019] "Starting client certificate rotation" Sep 09 20:52:18.538214 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.536388 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 20:52:18.538214 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.536421 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 20:52:18.538975 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.538963 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 20:52:18.541661 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.541636 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 20:52:18.556892 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.556877 2560 log.go:25] "Validated CRI v1 runtime API" Sep 09 20:52:18.559768 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.559754 2560 log.go:25] "Validated CRI v1 image API" Sep 09 20:52:18.560653 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.560637 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 20:52:18.563457 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.563438 2560 fs.go:135] Filesystem UUIDs: map[3491c54c-a8df-40d0-94dc-a85426f381d7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 882e382a-6e2e-4c43-b22e-d1cbadffe804:/dev/nvme0n1p4] Sep 09 20:52:18.563510 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.563456 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 20:52:18.568308 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.568198 2560 manager.go:216] Machine: {Timestamp:2026-09-09 20:52:18.566938867 +0000 UTC m=+0.335998379 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102769 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c0e12ca1a60094adb21c97e3ba2c9 SystemUUID:ec2c0e12-ca1a-6009-4adb-21c97e3ba2c9 BootID:ee89f71b-3efc-4c05-9cfc-93f338bd388a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:06:3b:c1:f9:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:06:3b:c1:f9:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:29:89:09:f2:60 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 20:52:18.568308 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.568297 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 20:52:18.568451 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.568367 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 20:52:18.569383 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.569368 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 20:52:18.570540 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.570518 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 20:52:18.570725 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.570543 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 20:52:18.571414 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.571394 2560 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 20:52:18.571549 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.571539 2560 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 20:52:18.571624 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.571614 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 20:52:18.572886 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.572861 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 20:52:18.574190 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.574176 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 20:52:18.577737 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.577725 2560 state_mem.go:36] "Initialized new in-memory state store" Sep 09 20:52:18.577853 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.577844 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 20:52:18.577888 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.577872 2560 kubelet.go:486] "Attempting to sync node with API server" Sep 09 20:52:18.577888 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.577882 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 20:52:18.577939 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.577892 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 20:52:18.577939 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.577901 2560 kubelet.go:398] "Adding apiserver pod source" Sep 09 20:52:18.577939 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.577909 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 20:52:18.578252 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.578238 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 20:52:18.578305 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.578263 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 20:52:18.581172 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.581157 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 20:52:18.583411 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.583397 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 20:52:18.583461 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.583427 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 20:52:18.583620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.583606 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 20:52:18.583659 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.583632 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 20:52:18.583659 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.583644 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 20:52:18.583659 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.583657 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 20:52:18.583748 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.583669 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 20:52:18.583748 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.583679 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 20:52:18.584557 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.584547 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 20:52:18.584557 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.584557 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 20:52:18.584663 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.584563 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 20:52:18.584663 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.584569 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 20:52:18.584663 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.584578 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 20:52:18.584663 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.584587 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 20:52:18.585861 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.585850 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 20:52:18.585861 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.585860 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 20:52:18.589470 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.589451 2560 server.go:1268] "Started kubelet" Sep 09 20:52:18.589651 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.589543 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 20:52:18.589651 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.589636 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 20:52:18.589778 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.589660 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 20:52:18.589778 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.589690 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 20:52:18.589778 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.589764 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 20:52:18.589927 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.589832 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 20:52:18.590523 ip-10-0-140-67 systemd[1]: Started Kubernetes Kubelet. Sep 09 20:52:18.591662 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.591648 2560 server.go:310] "Adding debug handlers to kubelet server" Sep 09 20:52:18.591758 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.591702 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 20:52:18.594696 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.594541 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 20:52:18.596427 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.594749 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18d3c252f75d8152 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-09-09 20:52:18.589426002 +0000 UTC m=+0.358485516,LastTimestamp:2026-09-09 20:52:18.589426002 +0000 UTC m=+0.358485516,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}" Sep 09 20:52:18.597373 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.597355 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 20:52:18.598089 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.598076 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 20:52:18.598175 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.598155 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:18.599282 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.599267 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 20:52:18.599282 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.599266 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 20:52:18.599421 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.599284 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 20:52:18.599457 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.599441 2560 reconstruct.go:97] "Volume reconstruction finished" Sep 09 20:52:18.599457 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.599453 2560 reconciler.go:29] "Reconciler: start to sync state" Sep 09 20:52:18.600482 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.600466 2560 factory.go:55] Registering systemd factory Sep 09 20:52:18.600482 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.600483 2560 factory.go:223] Registration of the systemd container factory successfully Sep 09 20:52:18.600619 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.600598 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 20:52:18.600689 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.600669 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 20:52:18.600727 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.600700 2560 factory.go:153] Registering CRI-O factory Sep 09 20:52:18.600727 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.600711 2560 factory.go:223] Registration of the crio container factory successfully Sep 09 20:52:18.600785 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.600767 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 20:52:18.600817 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.600785 2560 factory.go:103] Registering Raw factory Sep 09 20:52:18.600817 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.600803 2560 manager.go:1196] Started watching for new ooms in manager Sep 09 20:52:18.601181 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.601169 2560 manager.go:349] Starting recovery of all containers Sep 09 20:52:18.613448 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.613432 2560 manager.go:354] Recovery completed Sep 09 20:52:18.619569 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.619437 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:52:18.621215 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.621197 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:52:18.621278 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.621230 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:52:18.621278 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.621244 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:52:18.621811 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.621784 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 20:52:18.621811 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.621798 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 20:52:18.621811 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.621809 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:52:18.621980 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.621815 2560 state_mem.go:36] "Initialized new in-memory state store" Sep 09 20:52:18.622451 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.622437 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:52:18.622506 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.622462 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:52:18.622506 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.622475 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:52:18.623018 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.623005 2560 policy_none.go:49] "None policy: Start" Sep 09 20:52:18.623082 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.623021 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 20:52:18.623082 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.623045 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 20:52:18.624679 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.624668 2560 policy_none.go:47] "Start" Sep 09 20:52:18.630149 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.630074 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18d3c252f9428ffa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-67.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-09-09 20:52:18.621214714 +0000 UTC m=+0.390274227,LastTimestamp:2026-09-09 20:52:18.621214714 +0000 UTC m=+0.390274227,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}" Sep 09 20:52:18.631352 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.631335 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kn8rj" Sep 09 20:52:18.635533 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.635463 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18d3c252f942e34d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-67.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-09-09 20:52:18.621236045 +0000 UTC m=+0.390295562,LastTimestamp:2026-09-09 20:52:18.621236045 +0000 UTC m=+0.390295562,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}" Sep 09 20:52:18.639823 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.639762 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18d3c252f943173c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-67.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-09-09 20:52:18.62124934 +0000 UTC m=+0.390308855,LastTimestamp:2026-09-09 20:52:18.62124934 +0000 UTC m=+0.390308855,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}" Sep 09 20:52:18.640064 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.640027 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kn8rj" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.652586 2560 manager.go:337] "Starting Device Plugin manager" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.652626 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.652637 2560 server.go:87] "Starting device plugin registration server" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.652921 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.652934 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.653090 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.653168 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.653177 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.653698 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 20:52:18.660679 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.653742 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:18.688268 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.688244 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 20:52:18.689388 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.689367 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 20:52:18.689467 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.689427 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 20:52:18.689467 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.689448 2560 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 20:52:18.689577 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.689525 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 20:52:18.691801 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.691782 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:52:18.753962 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.753935 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:52:18.754683 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.754658 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:52:18.754758 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.754691 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:52:18.754758 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.754706 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:52:18.754758 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.754729 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.765514 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.765454 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.765514 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.765478 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-67.ec2.internal\": node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:18.789867 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.789841 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"] Sep 09 20:52:18.789938 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.789906 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:52:18.790633 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.790615 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:52:18.790717 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.790643 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:52:18.790717 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.790652 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:52:18.791777 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.791765 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:52:18.791890 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.791867 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.791926 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.791903 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:52:18.792631 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.792616 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:52:18.792696 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.792646 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:52:18.792696 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.792656 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:52:18.792779 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.792716 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:52:18.792779 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.792747 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:52:18.792779 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.792760 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:52:18.793786 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.793772 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.793864 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.793792 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:52:18.794455 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.794443 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:52:18.794532 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.794464 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:52:18.794532 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.794476 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:52:18.795358 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.795335 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:18.800541 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.800524 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22e1b74539fcecbce06d50f64861542a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"22e1b74539fcecbce06d50f64861542a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.800598 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.800548 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22e1b74539fcecbce06d50f64861542a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"22e1b74539fcecbce06d50f64861542a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.800598 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.800564 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6fdb7123ceb0203ddf37a480d40e184b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-67.ec2.internal\" (UID: \"6fdb7123ceb0203ddf37a480d40e184b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.808585 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.808569 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-67.ec2.internal\" not found" node="ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.812409 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.812393 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-67.ec2.internal\" not found" node="ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.896334 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.896310 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:18.900653 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.900637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22e1b74539fcecbce06d50f64861542a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"22e1b74539fcecbce06d50f64861542a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.900715 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.900667 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22e1b74539fcecbce06d50f64861542a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"22e1b74539fcecbce06d50f64861542a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.900715 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.900679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22e1b74539fcecbce06d50f64861542a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"22e1b74539fcecbce06d50f64861542a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.900715 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.900700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6fdb7123ceb0203ddf37a480d40e184b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-67.ec2.internal\" (UID: \"6fdb7123ceb0203ddf37a480d40e184b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.900715 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.900713 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22e1b74539fcecbce06d50f64861542a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"22e1b74539fcecbce06d50f64861542a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.901126 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:18.900728 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6fdb7123ceb0203ddf37a480d40e184b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-67.ec2.internal\" (UID: \"6fdb7123ceb0203ddf37a480d40e184b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" Sep 09 20:52:18.996629 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:18.996594 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:19.097350 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:19.097279 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:19.111727 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.111706 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" Sep 09 20:52:19.116063 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.115764 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" Sep 09 20:52:19.197561 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:19.197526 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:19.298018 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:19.297999 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:19.401495 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:19.401442 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:19.438620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.438599 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:52:19.448071 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.448038 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:52:19.502504 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:19.502481 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:19.535915 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.535893 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 20:52:19.536357 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.536005 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 20:52:19.536357 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.536012 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 20:52:19.536357 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.536057 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 20:52:19.602563 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:19.602532 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:19.633895 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.633865 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:52:19.635035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.635019 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:52:19.635107 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.635074 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:52:19.635107 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.635088 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:52:19.642059 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.642033 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 20:47:19 +0000 UTC" deadline="2028-02-25 08:58:55.157024635 +0000 UTC" Sep 09 20:52:19.642129 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.642059 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12804h6m35.51496867s" Sep 09 20:52:19.671224 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:19.671196 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e1b74539fcecbce06d50f64861542a.slice/crio-aa71280b08783fc2da625c7433e2a05f04a0eb00350a5934394bab7851628e0b WatchSource:0}: Error finding container aa71280b08783fc2da625c7433e2a05f04a0eb00350a5934394bab7851628e0b: Status 404 returned error can't find the container with id aa71280b08783fc2da625c7433e2a05f04a0eb00350a5934394bab7851628e0b Sep 09 20:52:19.677035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.677019 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:52:19.693137 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:19.693099 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" event={"ID":"22e1b74539fcecbce06d50f64861542a","Type":"ContainerStarted","Data":"aa71280b08783fc2da625c7433e2a05f04a0eb00350a5934394bab7851628e0b"} Sep 09 20:52:19.703122 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:19.703104 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:19.804114 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:19.804072 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:19.905111 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:19.905082 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:20.005630 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.005561 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:20.105787 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.105757 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found" Sep 09 20:52:20.116668 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.116644 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:52:20.198775 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.198743 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" Sep 09 20:52:20.210637 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.210614 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 20:52:20.211700 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.211684 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" Sep 09 20:52:20.224645 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.224626 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 20:52:20.483525 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.483442 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:52:20.578662 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.578630 2560 apiserver.go:52] "Watching apiserver" Sep 09 20:52:20.589169 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.589143 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 20:52:20.589581 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.589559 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-l7zr9","openshift-image-registry/node-ca-9fmt6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal","openshift-multus/multus-additional-cni-plugins-thdmf","openshift-multus/network-metrics-daemon-kqq54","openshift-network-diagnostics/network-check-target-q5sw5","openshift-ovn-kubernetes/ovnkube-node-mx4j8","kube-system/global-pull-secret-syncer-s86nr","kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2","openshift-cluster-node-tuning-operator/tuned-bqvhp","openshift-multus/multus-dd952","openshift-network-operator/iptables-alerter-8n2xs","kube-system/konnectivity-agent-2x22v"] Sep 09 20:52:20.591343 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.591314 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.592458 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.592430 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.593860 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.593652 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:20.593860 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.593683 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 20:52:20.593860 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.593741 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 20:52:20.594120 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.593874 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 20:52:20.594279 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.594260 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 20:52:20.594365 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.594300 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 20:52:20.594427 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.594382 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 20:52:20.595069 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.595023 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qbnxx\"" Sep 09 20:52:20.595069 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.595064 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:52:20.595331 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.595118 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 20:52:20.595401 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.595333 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 20:52:20.595401 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.595379 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.595538 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.595432 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kh2p6\"" Sep 09 20:52:20.596940 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.596909 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 20:52:20.596940 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.596910 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-prc5b\"" Sep 09 20:52:20.597141 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.596941 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 20:52:20.597141 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.597005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:20.597141 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.597092 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:20.597835 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.597809 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 20:52:20.597921 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.597839 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 20:52:20.597985 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.597928 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 20:52:20.598053 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.598023 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 20:52:20.598343 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.598324 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 20:52:20.598445 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.598381 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rt9mm\"" Sep 09 20:52:20.598573 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.598327 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 20:52:20.598943 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.598926 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:20.599016 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.598999 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:20.600216 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.600197 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:20.600291 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.600259 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:20.601501 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.601473 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.603506 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.603481 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.604665 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.604642 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 20:52:20.604798 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.604781 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 20:52:20.605132 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.605116 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-82cx7\"" Sep 09 20:52:20.607008 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.606136 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xhx7d\"" Sep 09 20:52:20.607008 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.606572 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.607008 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.606603 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 20:52:20.607008 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.606651 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 20:52:20.607008 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.606987 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 20:52:20.608455 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.608433 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.609154 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.609079 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 20:52:20.609154 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.609104 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 20:52:20.609154 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.609105 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 20:52:20.609154 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.609133 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9sfcq\"" Sep 09 20:52:20.610145 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-node-log\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.610243 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-ovnkube-config\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.610243 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fee1d122-4edc-4e62-bddc-e30d307e5fbd-kubelet-config\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:20.610243 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-systemd-units\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.610243 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-var-lib-openvswitch\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.610386 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610264 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.610386 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-cnibin\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.610386 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-cni-binary-copy\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.610386 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610339 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebb71af5-7ff5-4491-bd81-c449ea4cf608-host-slash\") pod \"iptables-alerter-8n2xs\" (UID: \"ebb71af5-7ff5-4491-bd81-c449ea4cf608\") " pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.610386 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-kubelet\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.610678 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610387 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-slash\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.610678 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610410 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-run-systemd\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.610678 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-run-ovn\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.610678 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.610678 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610614 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw9wm\" (UniqueName: \"kubernetes.io/projected/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-kube-api-access-qw9wm\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.610678 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610647 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4842z\" (UniqueName: \"kubernetes.io/projected/ebb71af5-7ff5-4491-bd81-c449ea4cf608-kube-api-access-4842z\") pod \"iptables-alerter-8n2xs\" (UID: \"ebb71af5-7ff5-4491-bd81-c449ea4cf608\") " pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.610678 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610686 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fee1d122-4edc-4e62-bddc-e30d307e5fbd-dbus\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610713 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5prv\" (UniqueName: \"kubernetes.io/projected/3e84cae0-3a97-4a52-b3d9-e447b551aac8-kube-api-access-b5prv\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610742 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41-agent-certs\") pod \"konnectivity-agent-2x22v\" (UID: \"c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41\") " pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-run-netns\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610819 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-etc-openvswitch\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610855 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-log-socket\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610869 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610887 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z4gpk\"" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610885 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610933 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebb71af5-7ff5-4491-bd81-c449ea4cf608-iptables-alerter-script\") pod \"iptables-alerter-8n2xs\" (UID: \"ebb71af5-7ff5-4491-bd81-c449ea4cf608\") " pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41-konnectivity-ca\") pod \"konnectivity-agent-2x22v\" (UID: \"c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41\") " pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.610983 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-ovnkube-script-lib\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611009 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-run-openvswitch\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611129 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-env-overrides\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.611152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611153 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 20:52:20.612065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7sjc\" (UniqueName: \"kubernetes.io/projected/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-kube-api-access-f7sjc\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.612065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611187 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:20.612065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-cni-bin\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.612065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-cni-netd\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.612065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611265 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-ovn-node-metrics-cert\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.612065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-system-cni-dir\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.612065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.612065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:20.612065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.611914 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dd952" Sep 09 20:52:20.613074 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.613051 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 20:52:20.614195 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.614175 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 20:52:20.614885 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.614867 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4q2w5\"" Sep 09 20:52:20.644832 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.644799 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-824mr" Sep 09 20:52:20.652199 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.652183 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-824mr" Sep 09 20:52:20.700142 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.700124 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 20:52:20.711900 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.711879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m2fp\" (UniqueName: \"kubernetes.io/projected/5fd5e31e-fb66-452c-a0da-2fb04573d32b-kube-api-access-8m2fp\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.712006 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.711912 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-kubernetes\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.712006 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.711936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-systemd\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.712006 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.711961 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfwll\" (UniqueName: \"kubernetes.io/projected/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-kube-api-access-rfwll\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.712178 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fee1d122-4edc-4e62-bddc-e30d307e5fbd-kubelet-config\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:20.712178 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712069 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-systemd-units\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712178 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712178 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712118 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fee1d122-4edc-4e62-bddc-e30d307e5fbd-kubelet-config\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:20.712178 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712137 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-systemd-units\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712439 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712202 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-cnibin\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.712439 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712217 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712439 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-cni-binary-copy\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.712439 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712301 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-cnibin\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.712439 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebb71af5-7ff5-4491-bd81-c449ea4cf608-host-slash\") pod \"iptables-alerter-8n2xs\" (UID: \"ebb71af5-7ff5-4491-bd81-c449ea4cf608\") " pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.712439 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-run-netns\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.712439 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712436 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-run-multus-certs\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712466 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebb71af5-7ff5-4491-bd81-c449ea4cf608-host-slash\") pod \"iptables-alerter-8n2xs\" (UID: \"ebb71af5-7ff5-4491-bd81-c449ea4cf608\") " pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-kubelet\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-slash\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712545 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-kubelet\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-run-systemd\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-run-ovn\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712587 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-run-systemd\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-socket-dir-parent\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712627 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-run-ovn\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712646 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-slash\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-daemon-config\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-sys\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b9a3743-c66a-497c-935e-c79bb856e33d-serviceca\") pod \"node-ca-9fmt6\" (UID: \"3b9a3743-c66a-497c-935e-c79bb856e33d\") " pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-sysctl-conf\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712789 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-run-netns\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712817 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.712914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712840 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b9a3743-c66a-497c-935e-c79bb856e33d-host\") pod \"node-ca-9fmt6\" (UID: \"3b9a3743-c66a-497c-935e-c79bb856e33d\") " pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712869 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712879 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-run-netns\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712870 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712899 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.712996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-var-lib-kubelet\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2zll\" (UniqueName: \"kubernetes.io/projected/3b9a3743-c66a-497c-935e-c79bb856e33d-kube-api-access-m2zll\") pod \"node-ca-9fmt6\" (UID: \"3b9a3743-c66a-497c-935e-c79bb856e33d\") " pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713126 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l24bl\" (UniqueName: \"kubernetes.io/projected/1917e841-81cf-49db-947d-40cd8c8c111e-kube-api-access-l24bl\") pod \"node-resolver-l7zr9\" (UID: \"1917e841-81cf-49db-947d-40cd8c8c111e\") " pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713176 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-system-cni-dir\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713216 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-modprobe-d\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-host\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.713266 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713273 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-cni-netd\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-ovn-node-metrics-cert\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.713372 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs podName:3e84cae0-3a97-4a52-b3d9-e447b551aac8 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:21.213317965 +0000 UTC m=+2.982377481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs") pod "network-metrics-daemon-kqq54" (UID: "3e84cae0-3a97-4a52-b3d9-e447b551aac8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:20.713794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713466 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-system-cni-dir\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713548 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-cni-dir\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-run\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713628 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-cni-binary-copy\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713645 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713719 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-system-cni-dir\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713732 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-cni-netd\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713744 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713795 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-tuned\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-node-log\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-ovnkube-config\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-socket-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713900 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-node-log\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713922 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-registration-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-run-k8s-cni-cncf-io\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.714575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.713988 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-var-lib-kubelet\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1917e841-81cf-49db-947d-40cd8c8c111e-hosts-file\") pod \"node-resolver-l7zr9\" (UID: \"1917e841-81cf-49db-947d-40cd8c8c111e\") " pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714063 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1917e841-81cf-49db-947d-40cd8c8c111e-tmp-dir\") pod \"node-resolver-l7zr9\" (UID: \"1917e841-81cf-49db-947d-40cd8c8c111e\") " pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714136 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714137 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-sys-fs\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zwhw\" (UniqueName: \"kubernetes.io/projected/9833e798-bcb1-4e22-acf5-d26a7af10f9f-kube-api-access-2zwhw\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-var-lib-openvswitch\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714263 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-lib-modules\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714318 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-var-lib-openvswitch\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714343 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw9wm\" (UniqueName: \"kubernetes.io/projected/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-kube-api-access-qw9wm\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714369 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4842z\" (UniqueName: \"kubernetes.io/projected/ebb71af5-7ff5-4491-bd81-c449ea4cf608-kube-api-access-4842z\") pod \"iptables-alerter-8n2xs\" (UID: \"ebb71af5-7ff5-4491-bd81-c449ea4cf608\") " pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714394 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41-agent-certs\") pod \"konnectivity-agent-2x22v\" (UID: \"c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41\") " pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714421 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-ovnkube-config\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-device-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714480 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.715324 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714517 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-cnibin\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714628 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-var-lib-cni-multus\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714667 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fee1d122-4edc-4e62-bddc-e30d307e5fbd-dbus\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5prv\" (UniqueName: \"kubernetes.io/projected/3e84cae0-3a97-4a52-b3d9-e447b551aac8-kube-api-access-b5prv\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714746 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-etc-kubernetes\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-tmp\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714784 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fee1d122-4edc-4e62-bddc-e30d307e5fbd-dbus\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.714796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-etc-openvswitch\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715063 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-etc-openvswitch\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-log-socket\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebb71af5-7ff5-4491-bd81-c449ea4cf608-iptables-alerter-script\") pod \"iptables-alerter-8n2xs\" (UID: \"ebb71af5-7ff5-4491-bd81-c449ea4cf608\") " pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715277 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-log-socket\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715317 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41-konnectivity-ca\") pod \"konnectivity-agent-2x22v\" (UID: \"c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41\") " pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-conf-dir\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-sysctl-d\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715386 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-ovnkube-script-lib\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.716185 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715410 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-var-lib-cni-bin\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715466 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-run-openvswitch\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-env-overrides\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7sjc\" (UniqueName: \"kubernetes.io/projected/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-kube-api-access-f7sjc\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715553 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-sysconfig\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-cni-bin\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fd5e31e-fb66-452c-a0da-2fb04573d32b-cni-binary-copy\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-hostroot\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.715813 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebb71af5-7ff5-4491-bd81-c449ea4cf608-iptables-alerter-script\") pod \"iptables-alerter-8n2xs\" (UID: \"ebb71af5-7ff5-4491-bd81-c449ea4cf608\") " pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.716432 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41-konnectivity-ca\") pod \"konnectivity-agent-2x22v\" (UID: \"c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41\") " pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.716523 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.716568 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret podName:fee1d122-4edc-4e62-bddc-e30d307e5fbd nodeName:}" failed. No retries permitted until 2026-09-09 20:52:21.216550062 +0000 UTC m=+2.985609578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret") pod "global-pull-secret-syncer-s86nr" (UID: "fee1d122-4edc-4e62-bddc-e30d307e5fbd") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.716616 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-run-openvswitch\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.717035 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.716620 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-host-cni-bin\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.717819 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.717044 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-env-overrides\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.717819 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.717136 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-ovnkube-script-lib\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.718304 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.718282 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-ovn-node-metrics-cert\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.718450 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.718431 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41-agent-certs\") pod \"konnectivity-agent-2x22v\" (UID: \"c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41\") " pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:20.721459 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.721402 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:52:20.721459 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.721443 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:52:20.721459 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.721458 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ct5gn for pod openshift-network-diagnostics/network-check-target-q5sw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:20.721674 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:20.721536 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn podName:ed7e3aa3-1078-4f63-904a-ef4e84e1623c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:21.221519901 +0000 UTC m=+2.990579423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ct5gn" (UniqueName: "kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn") pod "network-check-target-q5sw5" (UID: "ed7e3aa3-1078-4f63-904a-ef4e84e1623c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:20.724667 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.724636 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4842z\" (UniqueName: \"kubernetes.io/projected/ebb71af5-7ff5-4491-bd81-c449ea4cf608-kube-api-access-4842z\") pod \"iptables-alerter-8n2xs\" (UID: \"ebb71af5-7ff5-4491-bd81-c449ea4cf608\") " pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.724765 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.724672 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5prv\" (UniqueName: \"kubernetes.io/projected/3e84cae0-3a97-4a52-b3d9-e447b551aac8-kube-api-access-b5prv\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:20.724765 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.724698 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw9wm\" (UniqueName: \"kubernetes.io/projected/1afca2ca-c4d4-4c76-88b4-d2e4e162936b-kube-api-access-qw9wm\") pod \"multus-additional-cni-plugins-thdmf\" (UID: \"1afca2ca-c4d4-4c76-88b4-d2e4e162936b\") " pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.727781 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.727755 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7sjc\" (UniqueName: \"kubernetes.io/projected/9a547fdc-ea43-4192-8aa2-6d50e9484d9f-kube-api-access-f7sjc\") pod \"ovnkube-node-mx4j8\" (UID: \"9a547fdc-ea43-4192-8aa2-6d50e9484d9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.815966 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.815889 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b9a3743-c66a-497c-935e-c79bb856e33d-serviceca\") pod \"node-ca-9fmt6\" (UID: \"3b9a3743-c66a-497c-935e-c79bb856e33d\") " pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.815966 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.815933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-sysctl-conf\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.815966 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.815964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b9a3743-c66a-497c-935e-c79bb856e33d-host\") pod \"node-ca-9fmt6\" (UID: \"3b9a3743-c66a-497c-935e-c79bb856e33d\") " pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.816225 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.815992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.816225 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816017 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-var-lib-kubelet\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.816225 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816043 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2zll\" (UniqueName: \"kubernetes.io/projected/3b9a3743-c66a-497c-935e-c79bb856e33d-kube-api-access-m2zll\") pod \"node-ca-9fmt6\" (UID: \"3b9a3743-c66a-497c-935e-c79bb856e33d\") " pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.816225 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816099 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l24bl\" (UniqueName: \"kubernetes.io/projected/1917e841-81cf-49db-947d-40cd8c8c111e-kube-api-access-l24bl\") pod \"node-resolver-l7zr9\" (UID: \"1917e841-81cf-49db-947d-40cd8c8c111e\") " pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.816225 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816123 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-system-cni-dir\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.816225 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816147 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-modprobe-d\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.816225 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-host\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.816225 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816214 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-cni-dir\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816240 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-run\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816304 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b9a3743-c66a-497c-935e-c79bb856e33d-host\") pod \"node-ca-9fmt6\" (UID: \"3b9a3743-c66a-497c-935e-c79bb856e33d\") " pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816367 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-system-cni-dir\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816408 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b9a3743-c66a-497c-935e-c79bb856e33d-serviceca\") pod \"node-ca-9fmt6\" (UID: \"3b9a3743-c66a-497c-935e-c79bb856e33d\") " pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816455 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-modprobe-d\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816476 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-host\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-tuned\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816514 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816523 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-cni-dir\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-socket-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816559 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-sysctl-conf\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816572 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-run\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-registration-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816566 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-var-lib-kubelet\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816607 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-registration-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.816620 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816610 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-run-k8s-cni-cncf-io\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816638 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-var-lib-kubelet\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1917e841-81cf-49db-947d-40cd8c8c111e-hosts-file\") pod \"node-resolver-l7zr9\" (UID: \"1917e841-81cf-49db-947d-40cd8c8c111e\") " pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816687 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1917e841-81cf-49db-947d-40cd8c8c111e-tmp-dir\") pod \"node-resolver-l7zr9\" (UID: \"1917e841-81cf-49db-947d-40cd8c8c111e\") " pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-sys-fs\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816710 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-socket-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zwhw\" (UniqueName: \"kubernetes.io/projected/9833e798-bcb1-4e22-acf5-d26a7af10f9f-kube-api-access-2zwhw\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816745 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-lib-modules\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-device-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816815 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-cnibin\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816822 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-run-k8s-cni-cncf-io\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-var-lib-cni-multus\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-etc-kubernetes\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816875 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-var-lib-kubelet\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-tmp\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816918 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-lib-modules\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-conf-dir\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816944 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-device-dir\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816953 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-sysctl-d\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-var-lib-cni-bin\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-sysconfig\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fd5e31e-fb66-452c-a0da-2fb04573d32b-cni-binary-copy\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817073 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-hostroot\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m2fp\" (UniqueName: \"kubernetes.io/projected/5fd5e31e-fb66-452c-a0da-2fb04573d32b-kube-api-access-8m2fp\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817138 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-kubernetes\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817152 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-sys-fs\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817162 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-systemd\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817161 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1917e841-81cf-49db-947d-40cd8c8c111e-tmp-dir\") pod \"node-resolver-l7zr9\" (UID: \"1917e841-81cf-49db-947d-40cd8c8c111e\") " pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817195 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfwll\" (UniqueName: \"kubernetes.io/projected/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-kube-api-access-rfwll\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817239 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-run-netns\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817266 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-var-lib-cni-bin\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-run-multus-certs\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817318 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-cnibin\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817332 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-socket-dir-parent\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.817910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817347 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-var-lib-cni-multus\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-daemon-config\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-sys\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817384 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-etc-kubernetes\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817415 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-kubernetes\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.816788 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1917e841-81cf-49db-947d-40cd8c8c111e-hosts-file\") pod \"node-resolver-l7zr9\" (UID: \"1917e841-81cf-49db-947d-40cd8c8c111e\") " pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817474 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-sysconfig\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817034 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9833e798-bcb1-4e22-acf5-d26a7af10f9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817479 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-conf-dir\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817535 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-systemd\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817536 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-run-netns\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817566 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-host-run-multus-certs\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817768 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-hostroot\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.817866 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-sysctl-d\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.818221 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-daemon-config\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.818290 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5fd5e31e-fb66-452c-a0da-2fb04573d32b-multus-socket-dir-parent\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.818336 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-sys\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.818677 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.818354 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fd5e31e-fb66-452c-a0da-2fb04573d32b-cni-binary-copy\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.819487 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.819283 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-etc-tuned\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.819834 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.819806 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-tmp\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.825261 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.825231 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2zll\" (UniqueName: \"kubernetes.io/projected/3b9a3743-c66a-497c-935e-c79bb856e33d-kube-api-access-m2zll\") pod \"node-ca-9fmt6\" (UID: \"3b9a3743-c66a-497c-935e-c79bb856e33d\") " pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.825381 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.825281 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l24bl\" (UniqueName: \"kubernetes.io/projected/1917e841-81cf-49db-947d-40cd8c8c111e-kube-api-access-l24bl\") pod \"node-resolver-l7zr9\" (UID: \"1917e841-81cf-49db-947d-40cd8c8c111e\") " pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.827026 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.826979 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m2fp\" (UniqueName: \"kubernetes.io/projected/5fd5e31e-fb66-452c-a0da-2fb04573d32b-kube-api-access-8m2fp\") pod \"multus-dd952\" (UID: \"5fd5e31e-fb66-452c-a0da-2fb04573d32b\") " pod="openshift-multus/multus-dd952" Sep 09 20:52:20.827289 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.827268 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zwhw\" (UniqueName: \"kubernetes.io/projected/9833e798-bcb1-4e22-acf5-d26a7af10f9f-kube-api-access-2zwhw\") pod \"aws-ebs-csi-driver-node-trvs2\" (UID: \"9833e798-bcb1-4e22-acf5-d26a7af10f9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.827637 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.827619 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfwll\" (UniqueName: \"kubernetes.io/projected/fa94721b-9b0a-41c1-bcb2-5fbb0736c41c-kube-api-access-rfwll\") pod \"tuned-bqvhp\" (UID: \"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c\") " pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.908794 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.908757 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:20.915682 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.915662 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8n2xs" Sep 09 20:52:20.922894 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.922866 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:20.929268 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.929249 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-thdmf" Sep 09 20:52:20.934852 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.934827 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a547fdc_ea43_4192_8aa2_6d50e9484d9f.slice/crio-af7383e385e013b8210013bd2a278a99017d043bd2892464cb2ab00248e12a8d WatchSource:0}: Error finding container af7383e385e013b8210013bd2a278a99017d043bd2892464cb2ab00248e12a8d: Status 404 returned error can't find the container with id af7383e385e013b8210013bd2a278a99017d043bd2892464cb2ab00248e12a8d Sep 09 20:52:20.936165 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.936145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l7zr9" Sep 09 20:52:20.936841 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.936809 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb71af5_7ff5_4491_bd81_c449ea4cf608.slice/crio-97991f91962675ac1991aeef37cd1176692f7a92889c0760af400d98bc35810e WatchSource:0}: Error finding container 97991f91962675ac1991aeef37cd1176692f7a92889c0760af400d98bc35810e: Status 404 returned error can't find the container with id 97991f91962675ac1991aeef37cd1176692f7a92889c0760af400d98bc35810e Sep 09 20:52:20.940185 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.940157 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9eed9dc_a6b3_4488_8fc0_6b44cc3abb41.slice/crio-102f859ffc1881925e43cae63abf3b50fb495e21d671b6a3597b87f9d6b5c92a WatchSource:0}: Error finding container 102f859ffc1881925e43cae63abf3b50fb495e21d671b6a3597b87f9d6b5c92a: Status 404 returned error can't find the container with id 102f859ffc1881925e43cae63abf3b50fb495e21d671b6a3597b87f9d6b5c92a Sep 09 20:52:20.941659 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.941601 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9fmt6" Sep 09 20:52:20.941964 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.941937 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdb7123ceb0203ddf37a480d40e184b.slice/crio-5a21873d1e83ad5b24f4cb3bb04157e1f44bdd845ed7e0e692d5a200d5e105a7 WatchSource:0}: Error finding container 5a21873d1e83ad5b24f4cb3bb04157e1f44bdd845ed7e0e692d5a200d5e105a7: Status 404 returned error can't find the container with id 5a21873d1e83ad5b24f4cb3bb04157e1f44bdd845ed7e0e692d5a200d5e105a7 Sep 09 20:52:20.943874 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.943840 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afca2ca_c4d4_4c76_88b4_d2e4e162936b.slice/crio-2ad4e2eb5bc1a13b2b938f6a88b8b84ce26972d01c2e4c81ce13069e9d6022a0 WatchSource:0}: Error finding container 2ad4e2eb5bc1a13b2b938f6a88b8b84ce26972d01c2e4c81ce13069e9d6022a0: Status 404 returned error can't find the container with id 2ad4e2eb5bc1a13b2b938f6a88b8b84ce26972d01c2e4c81ce13069e9d6022a0 Sep 09 20:52:20.949004 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.948980 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" Sep 09 20:52:20.949244 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.949222 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1917e841_81cf_49db_947d_40cd8c8c111e.slice/crio-0d44024ff1f3af069ce709635f0f1fb690f8715a5bab1efc9fca98d68ba2bd3a WatchSource:0}: Error finding container 0d44024ff1f3af069ce709635f0f1fb690f8715a5bab1efc9fca98d68ba2bd3a: Status 404 returned error can't find the container with id 0d44024ff1f3af069ce709635f0f1fb690f8715a5bab1efc9fca98d68ba2bd3a Sep 09 20:52:20.952273 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.952250 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9a3743_c66a_497c_935e_c79bb856e33d.slice/crio-9b020aafa5090b5c2350c9fd7d09a8a52dcb1baf395bfde3af8a85a9821497f1 WatchSource:0}: Error finding container 9b020aafa5090b5c2350c9fd7d09a8a52dcb1baf395bfde3af8a85a9821497f1: Status 404 returned error can't find the container with id 9b020aafa5090b5c2350c9fd7d09a8a52dcb1baf395bfde3af8a85a9821497f1 Sep 09 20:52:20.955755 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.955733 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" Sep 09 20:52:20.958320 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.958302 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9833e798_bcb1_4e22_acf5_d26a7af10f9f.slice/crio-7677669c5107a0442466a368961b341253bb79126518935905a4140728462b9a WatchSource:0}: Error finding container 7677669c5107a0442466a368961b341253bb79126518935905a4140728462b9a: Status 404 returned error can't find the container with id 7677669c5107a0442466a368961b341253bb79126518935905a4140728462b9a Sep 09 20:52:20.961326 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:20.961147 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dd952" Sep 09 20:52:20.965842 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.965821 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa94721b_9b0a_41c1_bcb2_5fbb0736c41c.slice/crio-bfd2d8e525be4839323e92e190d121765ee84c9c57b718c45b115495c2b789db WatchSource:0}: Error finding container bfd2d8e525be4839323e92e190d121765ee84c9c57b718c45b115495c2b789db: Status 404 returned error can't find the container with id bfd2d8e525be4839323e92e190d121765ee84c9c57b718c45b115495c2b789db Sep 09 20:52:20.970403 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:20.970383 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd5e31e_fb66_452c_a0da_2fb04573d32b.slice/crio-bfbdcadeac9ee5c3eb6b72c54dfcae0e07c157a8e45f7ad24cda3506a13f792c WatchSource:0}: Error finding container bfbdcadeac9ee5c3eb6b72c54dfcae0e07c157a8e45f7ad24cda3506a13f792c: Status 404 returned error can't find the container with id bfbdcadeac9ee5c3eb6b72c54dfcae0e07c157a8e45f7ad24cda3506a13f792c Sep 09 20:52:21.220360 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.220333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:21.220465 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.220379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:21.220519 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:21.220478 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:21.220519 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:21.220482 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:21.220592 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:21.220522 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs podName:3e84cae0-3a97-4a52-b3d9-e447b551aac8 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:22.220509306 +0000 UTC m=+3.989568808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs") pod "network-metrics-daemon-kqq54" (UID: "3e84cae0-3a97-4a52-b3d9-e447b551aac8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:21.220592 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:21.220535 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret podName:fee1d122-4edc-4e62-bddc-e30d307e5fbd nodeName:}" failed. No retries permitted until 2026-09-09 20:52:22.220529342 +0000 UTC m=+3.989588843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret") pod "global-pull-secret-syncer-s86nr" (UID: "fee1d122-4edc-4e62-bddc-e30d307e5fbd") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:21.321044 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.321002 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:21.321206 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:21.321181 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:52:21.321279 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:21.321217 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:52:21.321279 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:21.321232 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ct5gn for pod openshift-network-diagnostics/network-check-target-q5sw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:21.321370 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:21.321302 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn podName:ed7e3aa3-1078-4f63-904a-ef4e84e1623c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:22.32127955 +0000 UTC m=+4.090339065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ct5gn" (UniqueName: "kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn") pod "network-check-target-q5sw5" (UID: "ed7e3aa3-1078-4f63-904a-ef4e84e1623c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:21.654340 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.654251 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:47:20 +0000 UTC" deadline="2028-04-12 04:06:55.063603904 +0000 UTC" Sep 09 20:52:21.654340 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.654289 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13927h14m33.409319022s" Sep 09 20:52:21.721487 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.720741 2560 generic.go:356] "Generic (PLEG): container finished" podID="22e1b74539fcecbce06d50f64861542a" containerID="f847decdc57c82e4be0a3432320d32044069ce96bc9b524d808e92f5a662091a" exitCode=0 Sep 09 20:52:21.721487 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.720836 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" event={"ID":"22e1b74539fcecbce06d50f64861542a","Type":"ContainerDied","Data":"f847decdc57c82e4be0a3432320d32044069ce96bc9b524d808e92f5a662091a"} Sep 09 20:52:21.728422 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.728052 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dd952" event={"ID":"5fd5e31e-fb66-452c-a0da-2fb04573d32b","Type":"ContainerStarted","Data":"bfbdcadeac9ee5c3eb6b72c54dfcae0e07c157a8e45f7ad24cda3506a13f792c"} Sep 09 20:52:21.747723 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.747333 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" event={"ID":"9833e798-bcb1-4e22-acf5-d26a7af10f9f","Type":"ContainerStarted","Data":"7677669c5107a0442466a368961b341253bb79126518935905a4140728462b9a"} Sep 09 20:52:21.766992 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.766960 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thdmf" event={"ID":"1afca2ca-c4d4-4c76-88b4-d2e4e162936b","Type":"ContainerStarted","Data":"2ad4e2eb5bc1a13b2b938f6a88b8b84ce26972d01c2e4c81ce13069e9d6022a0"} Sep 09 20:52:21.776391 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.776361 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" event={"ID":"6fdb7123ceb0203ddf37a480d40e184b","Type":"ContainerStarted","Data":"5a21873d1e83ad5b24f4cb3bb04157e1f44bdd845ed7e0e692d5a200d5e105a7"} Sep 09 20:52:21.805150 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.805102 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2x22v" event={"ID":"c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41","Type":"ContainerStarted","Data":"102f859ffc1881925e43cae63abf3b50fb495e21d671b6a3597b87f9d6b5c92a"} Sep 09 20:52:21.826314 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.826224 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8n2xs" event={"ID":"ebb71af5-7ff5-4491-bd81-c449ea4cf608","Type":"ContainerStarted","Data":"97991f91962675ac1991aeef37cd1176692f7a92889c0760af400d98bc35810e"} Sep 09 20:52:21.834685 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.834573 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" event={"ID":"9a547fdc-ea43-4192-8aa2-6d50e9484d9f","Type":"ContainerStarted","Data":"af7383e385e013b8210013bd2a278a99017d043bd2892464cb2ab00248e12a8d"} Sep 09 20:52:21.843900 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.843829 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" event={"ID":"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c","Type":"ContainerStarted","Data":"bfd2d8e525be4839323e92e190d121765ee84c9c57b718c45b115495c2b789db"} Sep 09 20:52:21.860413 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.860386 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9fmt6" event={"ID":"3b9a3743-c66a-497c-935e-c79bb856e33d","Type":"ContainerStarted","Data":"9b020aafa5090b5c2350c9fd7d09a8a52dcb1baf395bfde3af8a85a9821497f1"} Sep 09 20:52:21.879300 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:21.879272 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l7zr9" event={"ID":"1917e841-81cf-49db-947d-40cd8c8c111e","Type":"ContainerStarted","Data":"0d44024ff1f3af069ce709635f0f1fb690f8715a5bab1efc9fca98d68ba2bd3a"} Sep 09 20:52:22.049986 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.049958 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:52:22.230538 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.230191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:22.230538 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.230282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:22.230538 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.230365 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:22.230538 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.230397 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:22.230538 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.230443 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs podName:3e84cae0-3a97-4a52-b3d9-e447b551aac8 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:24.230420754 +0000 UTC m=+5.999480281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs") pod "network-metrics-daemon-kqq54" (UID: "3e84cae0-3a97-4a52-b3d9-e447b551aac8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:22.230538 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.230464 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret podName:fee1d122-4edc-4e62-bddc-e30d307e5fbd nodeName:}" failed. No retries permitted until 2026-09-09 20:52:24.230453582 +0000 UTC m=+5.999513088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret") pod "global-pull-secret-syncer-s86nr" (UID: "fee1d122-4edc-4e62-bddc-e30d307e5fbd") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:22.331501 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.331427 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:22.331721 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.331701 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:52:22.331785 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.331729 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:52:22.331785 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.331743 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ct5gn for pod openshift-network-diagnostics/network-check-target-q5sw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:22.331889 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.331803 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn podName:ed7e3aa3-1078-4f63-904a-ef4e84e1623c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:24.331784759 +0000 UTC m=+6.100844276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ct5gn" (UniqueName: "kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn") pod "network-check-target-q5sw5" (UID: "ed7e3aa3-1078-4f63-904a-ef4e84e1623c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:22.544766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.544628 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:52:22.655291 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.655204 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:47:20 +0000 UTC" deadline="2028-05-30 19:03:15.351729106 +0000 UTC" Sep 09 20:52:22.655291 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.655265 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15094h10m52.696467913s" Sep 09 20:52:22.692973 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.692930 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:22.693148 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.693061 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:22.693606 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.693581 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:22.693719 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.693695 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:22.693783 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.693774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:22.693879 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:22.693860 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:22.906097 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.905461 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" event={"ID":"22e1b74539fcecbce06d50f64861542a","Type":"ContainerStarted","Data":"f182d390428f197e009edf5f808db85bf0c486a0f78b4e2c67a4c7b8f2d9e563"} Sep 09 20:52:22.922955 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:22.922895 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" podStartSLOduration=2.922872376 podStartE2EDuration="2.922872376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:22.92279385 +0000 UTC m=+4.691853376" watchObservedRunningTime="2026-09-09 20:52:22.922872376 +0000 UTC m=+4.691931918" Sep 09 20:52:24.249238 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:24.249196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:24.249848 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:24.249268 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:24.249848 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.249408 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:24.249848 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.249473 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs podName:3e84cae0-3a97-4a52-b3d9-e447b551aac8 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:28.249452813 +0000 UTC m=+10.018512314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs") pod "network-metrics-daemon-kqq54" (UID: "3e84cae0-3a97-4a52-b3d9-e447b551aac8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:24.250304 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.250174 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:24.250304 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.250246 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret podName:fee1d122-4edc-4e62-bddc-e30d307e5fbd nodeName:}" failed. No retries permitted until 2026-09-09 20:52:28.250227967 +0000 UTC m=+10.019287487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret") pod "global-pull-secret-syncer-s86nr" (UID: "fee1d122-4edc-4e62-bddc-e30d307e5fbd") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:24.349974 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:24.349941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:24.350148 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.350109 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:52:24.350148 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.350134 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:52:24.350148 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.350147 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ct5gn for pod openshift-network-diagnostics/network-check-target-q5sw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:24.350320 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.350201 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn podName:ed7e3aa3-1078-4f63-904a-ef4e84e1623c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:28.350185045 +0000 UTC m=+10.119244558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ct5gn" (UniqueName: "kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn") pod "network-check-target-q5sw5" (UID: "ed7e3aa3-1078-4f63-904a-ef4e84e1623c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:24.692265 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:24.690273 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:24.692265 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.690408 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:24.692265 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:24.690701 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:24.692265 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.690785 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:24.692265 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:24.690821 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:24.692265 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:24.690906 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:26.689988 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:26.689954 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:26.690459 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:26.690111 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:26.690861 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:26.690536 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:26.690861 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:26.690670 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:26.690861 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:26.690757 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:26.690861 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:26.690830 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:28.283611 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:28.283572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:28.284095 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:28.283655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:28.284095 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.283830 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:28.284095 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.283894 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs podName:3e84cae0-3a97-4a52-b3d9-e447b551aac8 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:36.283872718 +0000 UTC m=+18.052932234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs") pod "network-metrics-daemon-kqq54" (UID: "3e84cae0-3a97-4a52-b3d9-e447b551aac8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:28.284320 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.284302 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:28.284386 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.284361 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret podName:fee1d122-4edc-4e62-bddc-e30d307e5fbd nodeName:}" failed. No retries permitted until 2026-09-09 20:52:36.2843456 +0000 UTC m=+18.053405118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret") pod "global-pull-secret-syncer-s86nr" (UID: "fee1d122-4edc-4e62-bddc-e30d307e5fbd") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:28.384941 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:28.384839 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:28.385140 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.385028 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:52:28.385140 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.385066 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:52:28.385140 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.385078 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ct5gn for pod openshift-network-diagnostics/network-check-target-q5sw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:28.385140 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.385130 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn podName:ed7e3aa3-1078-4f63-904a-ef4e84e1623c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:36.385113841 +0000 UTC m=+18.154173360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ct5gn" (UniqueName: "kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn") pod "network-check-target-q5sw5" (UID: "ed7e3aa3-1078-4f63-904a-ef4e84e1623c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:28.690828 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:28.690755 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:28.690984 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.690878 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:28.691265 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:28.691241 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:28.691365 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.691340 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:28.691704 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:28.691674 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:28.691822 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:28.691798 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:30.690522 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:30.690483 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:30.691108 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:30.690492 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:30.691108 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:30.690492 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:30.691108 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:30.690669 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:30.691108 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:30.690805 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:30.691108 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:30.690952 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:32.689990 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:32.689959 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:32.690440 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:32.689965 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:32.690440 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:32.690094 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:32.690440 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:32.689965 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:32.690440 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:32.690172 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:32.690440 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:32.690246 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:34.690509 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:34.690475 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:34.690509 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:34.690489 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:34.691010 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:34.690613 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:34.691010 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:34.690678 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:34.691010 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:34.690749 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:34.691010 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:34.690835 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:36.336547 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:36.336506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:36.336972 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:36.336571 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:36.336972 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.336665 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:36.336972 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.336680 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:36.336972 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.336736 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret podName:fee1d122-4edc-4e62-bddc-e30d307e5fbd nodeName:}" failed. No retries permitted until 2026-09-09 20:52:52.336718785 +0000 UTC m=+34.105778291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret") pod "global-pull-secret-syncer-s86nr" (UID: "fee1d122-4edc-4e62-bddc-e30d307e5fbd") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:36.336972 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.336750 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs podName:3e84cae0-3a97-4a52-b3d9-e447b551aac8 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:52.33674315 +0000 UTC m=+34.105802649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs") pod "network-metrics-daemon-kqq54" (UID: "3e84cae0-3a97-4a52-b3d9-e447b551aac8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:36.437287 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:36.437248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:36.437452 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.437433 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:52:36.437528 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.437454 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:52:36.437528 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.437464 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ct5gn for pod openshift-network-diagnostics/network-check-target-q5sw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:36.437528 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.437518 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn podName:ed7e3aa3-1078-4f63-904a-ef4e84e1623c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:52.43750061 +0000 UTC m=+34.206560113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ct5gn" (UniqueName: "kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn") pod "network-check-target-q5sw5" (UID: "ed7e3aa3-1078-4f63-904a-ef4e84e1623c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:36.690460 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:36.690346 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:36.690460 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:36.690346 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:36.690460 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:36.690346 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:36.690717 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.690480 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:36.690717 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.690569 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:36.690717 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:36.690661 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:38.691127 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:38.691098 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:38.691503 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:38.691199 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:38.691503 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:38.691490 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:38.691600 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:38.691561 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:38.691641 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:38.691607 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:38.691671 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:38.691662 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:39.956558 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:39.955809 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" event={"ID":"9833e798-bcb1-4e22-acf5-d26a7af10f9f","Type":"ContainerStarted","Data":"7c74f830b845dc337c4ba62ad4bd59d1dbeb51d813ae25ec52162f730e0b6f80"} Sep 09 20:52:39.959430 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:39.958700 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thdmf" event={"ID":"1afca2ca-c4d4-4c76-88b4-d2e4e162936b","Type":"ContainerStarted","Data":"dd4fce17f395c5a612276bc8e62918a09a73d7c4bcdcf11b14ccdcf1e44a1e92"} Sep 09 20:52:39.960916 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:39.960891 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" event={"ID":"6fdb7123ceb0203ddf37a480d40e184b","Type":"ContainerStarted","Data":"8df74a43ceb8b72d2f4d375135d1771786964b456d7be47e699f1ce063467050"} Sep 09 20:52:39.962926 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:39.962880 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2x22v" event={"ID":"c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41","Type":"ContainerStarted","Data":"a55026755e19552bc791cea29ec8b13f2a191c031b8bde646e4f2e4ffa67bc99"} Sep 09 20:52:40.020202 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.020144 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" podStartSLOduration=20.02012786 podStartE2EDuration="20.02012786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:40.019743124 +0000 UTC m=+21.788802645" watchObservedRunningTime="2026-09-09 20:52:40.02012786 +0000 UTC m=+21.789187384" Sep 09 20:52:40.020320 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.020289 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" podStartSLOduration=2.257068159 podStartE2EDuration="21.020281054s" totalImagesPullingTime="18.763212895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:40.00109091 +0000 UTC m=+21.770150425" watchObservedRunningTime="2026-09-09 20:52:40.020281054 +0000 UTC m=+21.789340577" Sep 09 20:52:40.040130 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.039913 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2x22v" podStartSLOduration=2.299275749 podStartE2EDuration="21.03989513s" totalImagesPullingTime="18.740619381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:40.039398634 +0000 UTC m=+21.808458176" watchObservedRunningTime="2026-09-09 20:52:40.03989513 +0000 UTC m=+21.808954650" Sep 09 20:52:40.071775 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.071723 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l7zr9" podStartSLOduration=2.292985791 podStartE2EDuration="21.071709215s" totalImagesPullingTime="18.778723424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:40.07143917 +0000 UTC m=+21.840498702" watchObservedRunningTime="2026-09-09 20:52:40.071709215 +0000 UTC m=+21.840768736" Sep 09 20:52:40.690066 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.689957 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:40.690066 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.689957 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:40.690270 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:40.690117 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:40.690270 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.690165 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:40.690270 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:40.690242 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:40.690632 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:40.690611 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:40.974877 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.974851 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dd952" event={"ID":"5fd5e31e-fb66-452c-a0da-2fb04573d32b","Type":"ContainerStarted","Data":"2d0fd0a20a9aa50a2b7b806f9c379aa9c16479842fa2bcccf4dd02d754702f08"} Sep 09 20:52:40.976379 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.976353 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afca2ca-c4d4-4c76-88b4-d2e4e162936b" containerID="dd4fce17f395c5a612276bc8e62918a09a73d7c4bcdcf11b14ccdcf1e44a1e92" exitCode=0 Sep 09 20:52:40.976469 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.976424 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thdmf" event={"ID":"1afca2ca-c4d4-4c76-88b4-d2e4e162936b","Type":"ContainerDied","Data":"dd4fce17f395c5a612276bc8e62918a09a73d7c4bcdcf11b14ccdcf1e44a1e92"} Sep 09 20:52:40.977796 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.977767 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8n2xs" event={"ID":"ebb71af5-7ff5-4491-bd81-c449ea4cf608","Type":"ContainerStarted","Data":"7bb909f1f14daccbb9a7ce7c452683617814aadd2d825d7551bb521714302204"} Sep 09 20:52:40.980736 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.980714 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" event={"ID":"9a547fdc-ea43-4192-8aa2-6d50e9484d9f","Type":"ContainerStarted","Data":"08996c91569ec69ff8ed7ee862f241a274b24ee03b03921ac250ec0bbfd98b42"} Sep 09 20:52:40.980856 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.980785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" event={"ID":"9a547fdc-ea43-4192-8aa2-6d50e9484d9f","Type":"ContainerStarted","Data":"6e063ee88ca39dd3c3ac43a9cb6cea6d837fc888f83e999e653aa9663f6d66da"} Sep 09 20:52:40.980856 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.980838 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" event={"ID":"9a547fdc-ea43-4192-8aa2-6d50e9484d9f","Type":"ContainerStarted","Data":"729b68f439f13d0649352df5d3ad74b610a6071be57719e1c38aed4b81232f9e"} Sep 09 20:52:40.980965 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.980884 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" event={"ID":"9a547fdc-ea43-4192-8aa2-6d50e9484d9f","Type":"ContainerStarted","Data":"247f8d7188f34c776d9c7fac6ef67776c711bbe9bd135298f8d92a9a5b51b8b9"} Sep 09 20:52:40.980965 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.980933 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" event={"ID":"9a547fdc-ea43-4192-8aa2-6d50e9484d9f","Type":"ContainerStarted","Data":"02cb877863c340f13080d7dd4f2f74f53e59f19d9f476f822f22189fbdb051f4"} Sep 09 20:52:40.981088 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.980982 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" event={"ID":"9a547fdc-ea43-4192-8aa2-6d50e9484d9f","Type":"ContainerStarted","Data":"73967f04ab1e27d3eae8ea15beabbf9754329f3315d5529159955a5184e8edd2"} Sep 09 20:52:40.982068 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.982029 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqvhp" event={"ID":"fa94721b-9b0a-41c1-bcb2-5fbb0736c41c","Type":"ContainerStarted","Data":"d8878846b0d5228581d6363d2599cab4648ebbf970e87c10207e5950cd64b7e7"} Sep 09 20:52:40.983396 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.983374 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9fmt6" event={"ID":"3b9a3743-c66a-497c-935e-c79bb856e33d","Type":"ContainerStarted","Data":"1baa841c30fb72b5d9896ebab9cceecd769183116afee0409072ce097041f87c"} Sep 09 20:52:40.984591 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.984572 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l7zr9" event={"ID":"1917e841-81cf-49db-947d-40cd8c8c111e","Type":"ContainerStarted","Data":"dde5cc57aaf4db193f5b832227dcc5a3a09682210bde5a9e273f350d1b4c4af4"} Sep 09 20:52:40.994351 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:40.994313 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dd952" podStartSLOduration=3.013385902 podStartE2EDuration="21.994302337s" totalImagesPullingTime="18.980916435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:40.993943138 +0000 UTC m=+22.763002658" watchObservedRunningTime="2026-09-09 20:52:40.994302337 +0000 UTC m=+22.763361858" Sep 09 20:52:41.008753 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:41.008717 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9fmt6" podStartSLOduration=3.233934745 podStartE2EDuration="22.008705222s" totalImagesPullingTime="18.774770477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:41.008213489 +0000 UTC m=+22.777273009" watchObservedRunningTime="2026-09-09 20:52:41.008705222 +0000 UTC m=+22.777764771" Sep 09 20:52:41.235748 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:41.235717 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 20:52:41.667594 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:41.667496 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T20:52:41.235739331Z","UUID":"18d49a0e-78ff-4452-ae1d-6f8950e6bafd","Handler":null,"Name":"","Endpoint":""} Sep 09 20:52:41.668951 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:41.668932 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 20:52:41.669069 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:41.668959 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 20:52:41.988402 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:41.988322 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" event={"ID":"9833e798-bcb1-4e22-acf5-d26a7af10f9f","Type":"ContainerStarted","Data":"5f0dbbfe56766c6b8793ce5d4289f1cc783d513b3f92e096304a8fd1a499854c"} Sep 09 20:52:42.004796 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:42.004751 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8n2xs" podStartSLOduration=4.260004919 podStartE2EDuration="23.004737366s" totalImagesPullingTime="18.744732447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:42.004386601 +0000 UTC m=+23.773446127" watchObservedRunningTime="2026-09-09 20:52:42.004737366 +0000 UTC m=+23.773796939" Sep 09 20:52:42.690305 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:42.690104 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:42.690441 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:42.690152 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:42.690441 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:42.690389 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:42.690563 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:42.690205 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:42.690563 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:42.690460 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:42.690665 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:42.690601 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:42.992876 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:42.992836 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" event={"ID":"9833e798-bcb1-4e22-acf5-d26a7af10f9f","Type":"ContainerStarted","Data":"4ef847f6a268691461c26ce33039696cbac4fc065ce2452d2e73ca28740eb8b3"} Sep 09 20:52:42.996595 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:42.996564 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" event={"ID":"9a547fdc-ea43-4192-8aa2-6d50e9484d9f","Type":"ContainerStarted","Data":"e08a2b7faaedc7afd0070aab66a2553941e77ed2a4e50762898496bb29887a64"} Sep 09 20:52:43.013905 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:43.013859 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trvs2" podStartSLOduration=2.606151396 podStartE2EDuration="24.013844259s" totalImagesPullingTime="21.407692863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:43.012625342 +0000 UTC m=+24.781684864" watchObservedRunningTime="2026-09-09 20:52:43.013844259 +0000 UTC m=+24.782903780" Sep 09 20:52:43.366196 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:43.366155 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:43.366918 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:43.366897 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:43.999106 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:43.999047 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:43.999537 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:43.999466 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2x22v" Sep 09 20:52:44.690215 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:44.690189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:44.690370 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:44.690195 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:44.690370 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:44.690308 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:44.690479 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:44.690365 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:44.690479 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:44.690415 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:44.690580 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:44.690488 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:46.690328 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:46.690160 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:46.690805 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:46.690173 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:46.690805 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:46.690408 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:46.690805 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:46.690201 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:46.690805 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:46.690495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:46.690805 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:46.690575 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:47.006465 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.006386 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afca2ca-c4d4-4c76-88b4-d2e4e162936b" containerID="8eb0bf2e6478a80451ebdebf213dac5388e65a53a301056ba29430de2691060f" exitCode=0 Sep 09 20:52:47.006684 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.006474 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thdmf" event={"ID":"1afca2ca-c4d4-4c76-88b4-d2e4e162936b","Type":"ContainerDied","Data":"8eb0bf2e6478a80451ebdebf213dac5388e65a53a301056ba29430de2691060f"} Sep 09 20:52:47.010272 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.010248 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" event={"ID":"9a547fdc-ea43-4192-8aa2-6d50e9484d9f","Type":"ContainerStarted","Data":"ad44fa8bf29ccb649aaffeac3e311e15aa233f0c09d55290cdc1d81836a8cbe8"} Sep 09 20:52:47.010520 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.010501 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:47.010617 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.010556 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:47.010617 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.010600 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:47.025270 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.025246 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:47.025384 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.025349 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:52:47.993437 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.993381 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" podStartSLOduration=10.188869987 podStartE2EDuration="28.99336479s" totalImagesPullingTime="18.804494803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:47.111150263 +0000 UTC m=+28.880209785" watchObservedRunningTime="2026-09-09 20:52:47.99336479 +0000 UTC m=+29.762424311" Sep 09 20:52:47.994259 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.994238 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q5sw5"] Sep 09 20:52:47.994406 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.994392 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:47.994515 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:47.994497 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:47.997442 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.997420 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s86nr"] Sep 09 20:52:47.997544 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.997505 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:47.997592 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:47.997573 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:47.999386 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.999366 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kqq54"] Sep 09 20:52:47.999476 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:47.999468 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:47.999586 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:47.999568 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:49.015823 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:49.015755 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afca2ca-c4d4-4c76-88b4-d2e4e162936b" containerID="21d0a450ed4c97d8f908c1ff52fa651b2238debf120441bde0d6ed375f870d1d" exitCode=0 Sep 09 20:52:49.016272 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:49.015837 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thdmf" event={"ID":"1afca2ca-c4d4-4c76-88b4-d2e4e162936b","Type":"ContainerDied","Data":"21d0a450ed4c97d8f908c1ff52fa651b2238debf120441bde0d6ed375f870d1d"} Sep 09 20:52:49.690247 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:49.690080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:49.690390 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:49.690102 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:49.690390 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:49.690308 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:49.690390 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:49.690102 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:49.690495 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:49.690377 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:49.690495 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:49.690451 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:51.023172 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:51.023143 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afca2ca-c4d4-4c76-88b4-d2e4e162936b" containerID="f2bfaafa6061db94019dd37e1d10b2a23233d0b84632cd9352a17f7aca37d725" exitCode=0 Sep 09 20:52:51.023550 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:51.023182 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thdmf" event={"ID":"1afca2ca-c4d4-4c76-88b4-d2e4e162936b","Type":"ContainerDied","Data":"f2bfaafa6061db94019dd37e1d10b2a23233d0b84632cd9352a17f7aca37d725"} Sep 09 20:52:51.690367 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:51.690334 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:51.690584 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:51.690334 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:51.690584 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:51.690449 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5sw5" podUID="ed7e3aa3-1078-4f63-904a-ef4e84e1623c" Sep 09 20:52:51.690584 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:51.690551 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqq54" podUID="3e84cae0-3a97-4a52-b3d9-e447b551aac8" Sep 09 20:52:51.690584 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:51.690333 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:51.690800 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:51.690644 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s86nr" podUID="fee1d122-4edc-4e62-bddc-e30d307e5fbd" Sep 09 20:52:52.364094 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.364047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:52.364565 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.364139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:52.364565 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.364197 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:52.364565 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.364241 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:52.364565 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.364270 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs podName:3e84cae0-3a97-4a52-b3d9-e447b551aac8 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:24.364251947 +0000 UTC m=+66.133311448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs") pod "network-metrics-daemon-kqq54" (UID: "3e84cae0-3a97-4a52-b3d9-e447b551aac8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:52:52.364565 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.364285 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret podName:fee1d122-4edc-4e62-bddc-e30d307e5fbd nodeName:}" failed. No retries permitted until 2026-09-09 20:53:24.364279274 +0000 UTC m=+66.133338773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret") pod "global-pull-secret-syncer-s86nr" (UID: "fee1d122-4edc-4e62-bddc-e30d307e5fbd") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:52:52.465304 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.465274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:52.465480 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.465459 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:52:52.465529 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.465487 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:52:52.465529 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.465502 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ct5gn for pod openshift-network-diagnostics/network-check-target-q5sw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:52.465605 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.465562 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn podName:ed7e3aa3-1078-4f63-904a-ef4e84e1623c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:24.465543591 +0000 UTC m=+66.234603107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ct5gn" (UniqueName: "kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn") pod "network-check-target-q5sw5" (UID: "ed7e3aa3-1078-4f63-904a-ef4e84e1623c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:52:52.524649 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.524624 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeReady" Sep 09 20:52:52.524787 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.524768 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 20:52:52.565673 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.565643 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-646f44d6f8-ch8v5"] Sep 09 20:52:52.567744 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.567723 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.575084 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.575044 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 20:52:52.575179 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.575049 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 20:52:52.575231 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.575190 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 20:52:52.575580 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.575562 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bdddp\"" Sep 09 20:52:52.583567 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.583543 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 20:52:52.584688 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.584658 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-646f44d6f8-ch8v5"] Sep 09 20:52:52.599839 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.599818 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7gjmz"] Sep 09 20:52:52.602010 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.601989 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.603876 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.603855 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r8xr8"] Sep 09 20:52:52.605491 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.605474 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8xr8" Sep 09 20:52:52.611586 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.611460 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 20:52:52.611682 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.611583 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rcsnd\"" Sep 09 20:52:52.612070 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.611742 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 20:52:52.612070 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.611896 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 20:52:52.612070 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.611971 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 20:52:52.612070 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.611977 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 20:52:52.612070 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.611977 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6lpmt\"" Sep 09 20:52:52.618289 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.618128 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7gjmz"] Sep 09 20:52:52.630910 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.630862 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8xr8"] Sep 09 20:52:52.666321 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.666292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whdmz\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-kube-api-access-whdmz\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.666429 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.666330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-image-registry-private-configuration\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.666429 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.666349 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-certificates\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.666429 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.666367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.666429 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.666397 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0a199fa-3b0c-49fa-afb7-6199d7088c05-ca-trust-extracted\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.666603 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.666433 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-installation-pull-secrets\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.666603 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.666468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-bound-sa-token\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.666603 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.666508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-trusted-ca\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.767762 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.767738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c9605f-97ab-4575-bcb3-8eff0fe334f4-tmp-dir\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.767879 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.767770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjs2v\" (UniqueName: \"kubernetes.io/projected/29c9605f-97ab-4575-bcb3-8eff0fe334f4-kube-api-access-gjs2v\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.767879 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.767802 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.767988 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.767878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29c9605f-97ab-4575-bcb3-8eff0fe334f4-config-volume\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.767988 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.767953 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whdmz\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-kube-api-access-whdmz\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.767988 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.767977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87f0ad83-f00e-417b-9c17-dba8823441a3-cert\") pod \"ingress-canary-r8xr8\" (UID: \"87f0ad83-f00e-417b-9c17-dba8823441a3\") " pod="openshift-ingress-canary/ingress-canary-r8xr8" Sep 09 20:52:52.768180 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.767999 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-image-registry-private-configuration\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.768180 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.768044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-certificates\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.768180 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.768075 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.768180 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.768113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0a199fa-3b0c-49fa-afb7-6199d7088c05-ca-trust-extracted\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.768180 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.768135 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-installation-pull-secrets\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.768180 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.768157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-bound-sa-token\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.768399 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.768183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-trusted-ca\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.768399 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.768204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtp6z\" (UniqueName: \"kubernetes.io/projected/87f0ad83-f00e-417b-9c17-dba8823441a3-kube-api-access-wtp6z\") pod \"ingress-canary-r8xr8\" (UID: \"87f0ad83-f00e-417b-9c17-dba8823441a3\") " pod="openshift-ingress-canary/ingress-canary-r8xr8" Sep 09 20:52:52.768399 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.768391 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:52:52.768517 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.768405 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646f44d6f8-ch8v5: secret "image-registry-tls" not found Sep 09 20:52:52.768517 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.768463 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls podName:c0a199fa-3b0c-49fa-afb7-6199d7088c05 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:53.26844626 +0000 UTC m=+35.037505777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls") pod "image-registry-646f44d6f8-ch8v5" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05") : secret "image-registry-tls" not found Sep 09 20:52:52.768623 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.768580 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0a199fa-3b0c-49fa-afb7-6199d7088c05-ca-trust-extracted\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.769132 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.769095 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-certificates\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.769551 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.769529 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-trusted-ca\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.772370 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.772351 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-installation-pull-secrets\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.772488 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.772467 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-image-registry-private-configuration\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.782664 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.782644 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-bound-sa-token\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.790117 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.790096 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whdmz\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-kube-api-access-whdmz\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:52.869077 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.869002 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtp6z\" (UniqueName: \"kubernetes.io/projected/87f0ad83-f00e-417b-9c17-dba8823441a3-kube-api-access-wtp6z\") pod \"ingress-canary-r8xr8\" (UID: \"87f0ad83-f00e-417b-9c17-dba8823441a3\") " pod="openshift-ingress-canary/ingress-canary-r8xr8" Sep 09 20:52:52.869077 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.869070 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c9605f-97ab-4575-bcb3-8eff0fe334f4-tmp-dir\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.869239 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.869097 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjs2v\" (UniqueName: \"kubernetes.io/projected/29c9605f-97ab-4575-bcb3-8eff0fe334f4-kube-api-access-gjs2v\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.869239 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.869137 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.869239 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.869182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29c9605f-97ab-4575-bcb3-8eff0fe334f4-config-volume\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.869239 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.869213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87f0ad83-f00e-417b-9c17-dba8823441a3-cert\") pod \"ingress-canary-r8xr8\" (UID: \"87f0ad83-f00e-417b-9c17-dba8823441a3\") " pod="openshift-ingress-canary/ingress-canary-r8xr8" Sep 09 20:52:52.869381 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.869361 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:52:52.869441 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:52.869428 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls podName:29c9605f-97ab-4575-bcb3-8eff0fe334f4 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:53.369408749 +0000 UTC m=+35.138468255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls") pod "dns-default-7gjmz" (UID: "29c9605f-97ab-4575-bcb3-8eff0fe334f4") : secret "dns-default-metrics-tls" not found Sep 09 20:52:52.869494 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.869441 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c9605f-97ab-4575-bcb3-8eff0fe334f4-tmp-dir\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.869983 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.869960 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29c9605f-97ab-4575-bcb3-8eff0fe334f4-config-volume\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.871557 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.871535 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87f0ad83-f00e-417b-9c17-dba8823441a3-cert\") pod \"ingress-canary-r8xr8\" (UID: \"87f0ad83-f00e-417b-9c17-dba8823441a3\") " pod="openshift-ingress-canary/ingress-canary-r8xr8" Sep 09 20:52:52.880405 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.880380 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtp6z\" (UniqueName: \"kubernetes.io/projected/87f0ad83-f00e-417b-9c17-dba8823441a3-kube-api-access-wtp6z\") pod \"ingress-canary-r8xr8\" (UID: \"87f0ad83-f00e-417b-9c17-dba8823441a3\") " pod="openshift-ingress-canary/ingress-canary-r8xr8" Sep 09 20:52:52.881563 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.881545 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjs2v\" (UniqueName: \"kubernetes.io/projected/29c9605f-97ab-4575-bcb3-8eff0fe334f4-kube-api-access-gjs2v\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:52.920707 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:52.920685 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8xr8" Sep 09 20:52:53.205776 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.205505 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8xr8"] Sep 09 20:52:53.209988 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:53.209963 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f0ad83_f00e_417b_9c17_dba8823441a3.slice/crio-fd792a0a56c9f37bdd21b58199edf27ea27c59d6e84e344eaa15bb2a09276313 WatchSource:0}: Error finding container fd792a0a56c9f37bdd21b58199edf27ea27c59d6e84e344eaa15bb2a09276313: Status 404 returned error can't find the container with id fd792a0a56c9f37bdd21b58199edf27ea27c59d6e84e344eaa15bb2a09276313 Sep 09 20:52:53.272735 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.272706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:53.272867 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:53.272849 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:52:53.272921 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:53.272869 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646f44d6f8-ch8v5: secret "image-registry-tls" not found Sep 09 20:52:53.272965 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:53.272934 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls podName:c0a199fa-3b0c-49fa-afb7-6199d7088c05 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:54.272913576 +0000 UTC m=+36.041973093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls") pod "image-registry-646f44d6f8-ch8v5" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05") : secret "image-registry-tls" not found Sep 09 20:52:53.373964 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.373935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:53.374386 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:53.374101 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:52:53.374386 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:53.374161 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls podName:29c9605f-97ab-4575-bcb3-8eff0fe334f4 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:54.374145129 +0000 UTC m=+36.143204634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls") pod "dns-default-7gjmz" (UID: "29c9605f-97ab-4575-bcb3-8eff0fe334f4") : secret "dns-default-metrics-tls" not found Sep 09 20:52:53.438561 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.438525 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:53.530994 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.530916 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:53.690021 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.689991 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:52:53.690190 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.689991 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:52:53.690190 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.689991 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:52:53.693129 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.693105 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-thpvv\"" Sep 09 20:52:53.694088 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.694064 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 20:52:53.694181 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.694119 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 20:52:53.694181 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.694162 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pstzn\"" Sep 09 20:52:53.694304 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.694283 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 20:52:53.694435 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:53.694310 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 20:52:54.032209 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:54.032175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8xr8" event={"ID":"87f0ad83-f00e-417b-9c17-dba8823441a3","Type":"ContainerStarted","Data":"fd792a0a56c9f37bdd21b58199edf27ea27c59d6e84e344eaa15bb2a09276313"} Sep 09 20:52:54.281766 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:54.281725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:54.281939 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:54.281901 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:52:54.281939 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:54.281922 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646f44d6f8-ch8v5: secret "image-registry-tls" not found Sep 09 20:52:54.282047 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:54.281980 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls podName:c0a199fa-3b0c-49fa-afb7-6199d7088c05 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:56.281961932 +0000 UTC m=+38.051021432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls") pod "image-registry-646f44d6f8-ch8v5" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05") : secret "image-registry-tls" not found Sep 09 20:52:54.382079 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:54.382046 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:54.382476 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:54.382130 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:52:54.382476 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:54.382204 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls podName:29c9605f-97ab-4575-bcb3-8eff0fe334f4 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:56.382183271 +0000 UTC m=+38.151242785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls") pod "dns-default-7gjmz" (UID: "29c9605f-97ab-4575-bcb3-8eff0fe334f4") : secret "dns-default-metrics-tls" not found Sep 09 20:52:55.565772 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:55.565733 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:55.666045 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:55.666010 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:55.735576 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:55.735546 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:56.040551 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:56.040513 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afca2ca-c4d4-4c76-88b4-d2e4e162936b" containerID="b297910326241f068f410c479505d083ad135d2fd1893cff0a74f19032ca32db" exitCode=0 Sep 09 20:52:56.040713 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:56.040556 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thdmf" event={"ID":"1afca2ca-c4d4-4c76-88b4-d2e4e162936b","Type":"ContainerDied","Data":"b297910326241f068f410c479505d083ad135d2fd1893cff0a74f19032ca32db"} Sep 09 20:52:56.296392 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:56.296313 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:52:56.296531 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:56.296462 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:52:56.296531 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:56.296482 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646f44d6f8-ch8v5: secret "image-registry-tls" not found Sep 09 20:52:56.296616 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:56.296547 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls podName:c0a199fa-3b0c-49fa-afb7-6199d7088c05 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:00.296526008 +0000 UTC m=+42.065585535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls") pod "image-registry-646f44d6f8-ch8v5" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05") : secret "image-registry-tls" not found Sep 09 20:52:56.397218 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:56.397174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:52:56.397380 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:56.397355 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:52:56.397494 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:56.397424 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls podName:29c9605f-97ab-4575-bcb3-8eff0fe334f4 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:00.397409944 +0000 UTC m=+42.166469442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls") pod "dns-default-7gjmz" (UID: "29c9605f-97ab-4575-bcb3-8eff0fe334f4") : secret "dns-default-metrics-tls" not found Sep 09 20:52:56.694604 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:56.694572 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:56.775649 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:56.775619 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:56.851079 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:56.851048 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:57.048956 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.048919 2560 generic.go:356] "Generic (PLEG): container finished" podID="1afca2ca-c4d4-4c76-88b4-d2e4e162936b" containerID="8b7db6eb536b969aa24b4370519f9d39723c5dc5dbe03e176f0c53886ffd80c7" exitCode=0 Sep 09 20:52:57.048956 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.048950 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thdmf" event={"ID":"1afca2ca-c4d4-4c76-88b4-d2e4e162936b","Type":"ContainerDied","Data":"8b7db6eb536b969aa24b4370519f9d39723c5dc5dbe03e176f0c53886ffd80c7"} Sep 09 20:52:57.358270 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.358235 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9"] Sep 09 20:52:57.370069 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.370029 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.373394 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.373371 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:52:57.373518 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.373456 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 09 20:52:57.373518 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.373461 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 09 20:52:57.373731 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.373715 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4qxjf\"" Sep 09 20:52:57.373789 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.373773 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 09 20:52:57.383990 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.383167 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9"] Sep 09 20:52:57.452872 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.452851 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm"] Sep 09 20:52:57.475193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.475175 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm"] Sep 09 20:52:57.475270 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.475259 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:52:57.477859 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.477838 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:52:57.478125 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.478108 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 09 20:52:57.478224 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.478140 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bf64g\"" Sep 09 20:52:57.478224 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.478177 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 09 20:52:57.506541 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.506522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8htgr\" (UniqueName: \"kubernetes.io/projected/cd33146c-f1d4-45a5-89c0-4b0597287e62-kube-api-access-8htgr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4qfx9\" (UID: \"cd33146c-f1d4-45a5-89c0-4b0597287e62\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.506624 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.506583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd33146c-f1d4-45a5-89c0-4b0597287e62-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4qfx9\" (UID: \"cd33146c-f1d4-45a5-89c0-4b0597287e62\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.506664 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.506648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd33146c-f1d4-45a5-89c0-4b0597287e62-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4qfx9\" (UID: \"cd33146c-f1d4-45a5-89c0-4b0597287e62\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.551893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.551869 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp"] Sep 09 20:52:57.565502 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.565487 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm"] Sep 09 20:52:57.565585 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.565573 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp" Sep 09 20:52:57.568281 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.568247 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 09 20:52:57.568395 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.568340 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:52:57.568718 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.568532 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-p5gpx\"" Sep 09 20:52:57.577824 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.577802 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.577913 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.577826 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-nnf7c"] Sep 09 20:52:57.581091 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.580860 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 09 20:52:57.581091 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.580902 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sx47b\"" Sep 09 20:52:57.581091 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.580944 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 09 20:52:57.581369 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.581202 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 09 20:52:57.581516 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.581498 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:52:57.599916 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.599888 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj"] Sep 09 20:52:57.600065 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.600009 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-nnf7c" Sep 09 20:52:57.602668 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.602648 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7wdq2\"" Sep 09 20:52:57.607126 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.607106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd33146c-f1d4-45a5-89c0-4b0597287e62-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4qfx9\" (UID: \"cd33146c-f1d4-45a5-89c0-4b0597287e62\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.607197 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.607161 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8htgr\" (UniqueName: \"kubernetes.io/projected/cd33146c-f1d4-45a5-89c0-4b0597287e62-kube-api-access-8htgr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4qfx9\" (UID: \"cd33146c-f1d4-45a5-89c0-4b0597287e62\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.607261 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.607206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:52:57.607261 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.607247 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd33146c-f1d4-45a5-89c0-4b0597287e62-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4qfx9\" (UID: \"cd33146c-f1d4-45a5-89c0-4b0597287e62\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.607351 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.607292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhmc9\" (UniqueName: \"kubernetes.io/projected/1027aa12-9484-4415-8e85-85ba4b42788c-kube-api-access-qhmc9\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:52:57.607793 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.607773 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd33146c-f1d4-45a5-89c0-4b0597287e62-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4qfx9\" (UID: \"cd33146c-f1d4-45a5-89c0-4b0597287e62\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.611760 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.611740 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd33146c-f1d4-45a5-89c0-4b0597287e62-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4qfx9\" (UID: \"cd33146c-f1d4-45a5-89c0-4b0597287e62\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.619872 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.619855 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-npfsq"] Sep 09 20:52:57.619968 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.619951 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:57.623396 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.623376 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wzg75\"" Sep 09 20:52:57.624489 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.624471 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 09 20:52:57.624578 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.624493 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 20:52:57.624578 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.624471 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 20:52:57.624674 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.624578 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 09 20:52:57.628058 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.628015 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8htgr\" (UniqueName: \"kubernetes.io/projected/cd33146c-f1d4-45a5-89c0-4b0597287e62-kube-api-access-8htgr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4qfx9\" (UID: \"cd33146c-f1d4-45a5-89c0-4b0597287e62\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.640786 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.640765 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp"] Sep 09 20:52:57.640874 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.640803 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm"] Sep 09 20:52:57.640874 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.640823 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-nnf7c"] Sep 09 20:52:57.640874 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.640842 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj"] Sep 09 20:52:57.640874 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.640867 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-npfsq"] Sep 09 20:52:57.641093 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.640895 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.645120 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.645103 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 20:52:57.645252 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.645237 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-d5q7q\"" Sep 09 20:52:57.645725 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.645710 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 20:52:57.646758 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.646740 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 09 20:52:57.651169 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.651148 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 09 20:52:57.653685 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.653663 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 09 20:52:57.673818 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.673794 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-845fc486d8-rmtd8"] Sep 09 20:52:57.679107 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.679093 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" Sep 09 20:52:57.696216 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.696196 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-xk57q"] Sep 09 20:52:57.696637 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.696342 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.699685 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.699669 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 09 20:52:57.700296 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.700275 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 20:52:57.700395 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.700309 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qkvhm\"" Sep 09 20:52:57.700395 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.700286 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 09 20:52:57.701142 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.701121 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 20:52:57.701500 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.701470 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 09 20:52:57.701601 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.701471 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd2f5dff-7485-4ea6-8540-868484df235d-serving-cert\") pod \"service-ca-operator-859f94c4b-526sm\" (UID: \"fd2f5dff-7485-4ea6-8540-868484df235d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709115 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd2f5dff-7485-4ea6-8540-868484df235d-config\") pod \"service-ca-operator-859f94c4b-526sm\" (UID: \"fd2f5dff-7485-4ea6-8540-868484df235d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhmc9\" (UniqueName: \"kubernetes.io/projected/1027aa12-9484-4415-8e85-85ba4b42788c-kube-api-access-qhmc9\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709193 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs47j\" (UniqueName: \"kubernetes.io/projected/fd2f5dff-7485-4ea6-8540-868484df235d-kube-api-access-rs47j\") pod \"service-ca-operator-859f94c4b-526sm\" (UID: \"fd2f5dff-7485-4ea6-8540-868484df235d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709218 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86h4\" (UniqueName: \"kubernetes.io/projected/895ccf61-30c6-439b-a8f2-65930efa7c93-kube-api-access-c86h4\") pod \"network-check-source-685456655f-nnf7c\" (UID: \"895ccf61-30c6-439b-a8f2-65930efa7c93\") " pod="openshift-network-diagnostics/network-check-source-685456655f-nnf7c" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z776p\" (UniqueName: \"kubernetes.io/projected/8d3026c7-2a91-4e77-96df-dea0abb4cb26-kube-api-access-z776p\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8d3026c7-2a91-4e77-96df-dea0abb4cb26-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.709413 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j82mm\" (UniqueName: \"kubernetes.io/projected/8428ad43-5eef-4a01-9785-b45f130034f6-kube-api-access-j82mm\") pod \"volume-data-source-validator-695c895bd6-swfcp\" (UID: \"8428ad43-5eef-4a01-9785-b45f130034f6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp" Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:57.709804 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 20:52:57.710784 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:57.709860 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls podName:1027aa12-9484-4415-8e85-85ba4b42788c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:58.209842477 +0000 UTC m=+39.978901983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-qqstm" (UID: "1027aa12-9484-4415-8e85-85ba4b42788c") : secret "samples-operator-tls" not found Sep 09 20:52:57.716524 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.716503 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-845fc486d8-rmtd8"] Sep 09 20:52:57.716624 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.716537 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-xk57q"] Sep 09 20:52:57.716624 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.716611 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.720392 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.720374 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhmc9\" (UniqueName: \"kubernetes.io/projected/1027aa12-9484-4415-8e85-85ba4b42788c-kube-api-access-qhmc9\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:52:57.722489 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.722268 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 09 20:52:57.722489 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.722362 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tlqrf\"" Sep 09 20:52:57.722489 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.722375 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:52:57.722793 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.722576 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 09 20:52:57.722793 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.722600 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 09 20:52:57.727015 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.726999 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 09 20:52:57.810265 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc154768-9c43-4758-9b19-6e7fa687d32a-serving-cert\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.810393 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810270 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjqd6\" (UniqueName: \"kubernetes.io/projected/2051c290-d2f4-4169-9b3c-782a71b9dc65-kube-api-access-jjqd6\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.810393 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.810393 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810337 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2051c290-d2f4-4169-9b3c-782a71b9dc65-serving-cert\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.810393 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86h4\" (UniqueName: \"kubernetes.io/projected/895ccf61-30c6-439b-a8f2-65930efa7c93-kube-api-access-c86h4\") pod \"network-check-source-685456655f-nnf7c\" (UID: \"895ccf61-30c6-439b-a8f2-65930efa7c93\") " pod="openshift-network-diagnostics/network-check-source-685456655f-nnf7c" Sep 09 20:52:57.810638 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j82mm\" (UniqueName: \"kubernetes.io/projected/8428ad43-5eef-4a01-9785-b45f130034f6-kube-api-access-j82mm\") pod \"volume-data-source-validator-695c895bd6-swfcp\" (UID: \"8428ad43-5eef-4a01-9785-b45f130034f6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp" Sep 09 20:52:57.810638 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810492 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2051c290-d2f4-4169-9b3c-782a71b9dc65-trusted-ca\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.810638 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z776p\" (UniqueName: \"kubernetes.io/projected/8d3026c7-2a91-4e77-96df-dea0abb4cb26-kube-api-access-z776p\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:57.810638 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd2f5dff-7485-4ea6-8540-868484df235d-config\") pod \"service-ca-operator-859f94c4b-526sm\" (UID: \"fd2f5dff-7485-4ea6-8540-868484df235d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.810638 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810553 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.810638 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc154768-9c43-4758-9b19-6e7fa687d32a-snapshots\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.810638 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810603 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs47j\" (UniqueName: \"kubernetes.io/projected/fd2f5dff-7485-4ea6-8540-868484df235d-kube-api-access-rs47j\") pod \"service-ca-operator-859f94c4b-526sm\" (UID: \"fd2f5dff-7485-4ea6-8540-868484df235d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.810638 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpfqf\" (UniqueName: \"kubernetes.io/projected/d84a38d5-f187-4423-a046-be2f1ce20c6c-kube-api-access-rpfqf\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810647 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2051c290-d2f4-4169-9b3c-782a71b9dc65-config\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810699 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc154768-9c43-4758-9b19-6e7fa687d32a-tmp\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8d3026c7-2a91-4e77-96df-dea0abb4cb26-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810769 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-stats-auth\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:57.810771 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810787 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc154768-9c43-4758-9b19-6e7fa687d32a-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:57.810840 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls podName:8d3026c7-2a91-4e77-96df-dea0abb4cb26 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:58.310818916 +0000 UTC m=+40.079878432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4dtsj" (UID: "8d3026c7-2a91-4e77-96df-dea0abb4cb26") : secret "cluster-monitoring-operator-tls" not found Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810896 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd2f5dff-7485-4ea6-8540-868484df235d-serving-cert\") pod \"service-ca-operator-859f94c4b-526sm\" (UID: \"fd2f5dff-7485-4ea6-8540-868484df235d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810948 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc154768-9c43-4758-9b19-6e7fa687d32a-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.810998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.810982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-default-certificate\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.811364 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.811010 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fhjs\" (UniqueName: \"kubernetes.io/projected/cc154768-9c43-4758-9b19-6e7fa687d32a-kube-api-access-8fhjs\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.811364 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.811179 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd2f5dff-7485-4ea6-8540-868484df235d-config\") pod \"service-ca-operator-859f94c4b-526sm\" (UID: \"fd2f5dff-7485-4ea6-8540-868484df235d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.811588 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.811570 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8d3026c7-2a91-4e77-96df-dea0abb4cb26-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:57.812954 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.812938 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd2f5dff-7485-4ea6-8540-868484df235d-serving-cert\") pod \"service-ca-operator-859f94c4b-526sm\" (UID: \"fd2f5dff-7485-4ea6-8540-868484df235d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.821160 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.821140 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j82mm\" (UniqueName: \"kubernetes.io/projected/8428ad43-5eef-4a01-9785-b45f130034f6-kube-api-access-j82mm\") pod \"volume-data-source-validator-695c895bd6-swfcp\" (UID: \"8428ad43-5eef-4a01-9785-b45f130034f6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp" Sep 09 20:52:57.823103 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.823080 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z776p\" (UniqueName: \"kubernetes.io/projected/8d3026c7-2a91-4e77-96df-dea0abb4cb26-kube-api-access-z776p\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:57.823602 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.823584 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs47j\" (UniqueName: \"kubernetes.io/projected/fd2f5dff-7485-4ea6-8540-868484df235d-kube-api-access-rs47j\") pod \"service-ca-operator-859f94c4b-526sm\" (UID: \"fd2f5dff-7485-4ea6-8540-868484df235d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.824262 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.824248 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86h4\" (UniqueName: \"kubernetes.io/projected/895ccf61-30c6-439b-a8f2-65930efa7c93-kube-api-access-c86h4\") pod \"network-check-source-685456655f-nnf7c\" (UID: \"895ccf61-30c6-439b-a8f2-65930efa7c93\") " pod="openshift-network-diagnostics/network-check-source-685456655f-nnf7c" Sep 09 20:52:57.877166 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.877148 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp" Sep 09 20:52:57.879583 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.879562 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:57.887397 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.887383 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" Sep 09 20:52:57.908205 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.908187 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-nnf7c" Sep 09 20:52:57.911520 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.911509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc154768-9c43-4758-9b19-6e7fa687d32a-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.911563 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.911536 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-default-certificate\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.911617 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.911555 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fhjs\" (UniqueName: \"kubernetes.io/projected/cc154768-9c43-4758-9b19-6e7fa687d32a-kube-api-access-8fhjs\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.911708 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.911688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc154768-9c43-4758-9b19-6e7fa687d32a-serving-cert\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.911770 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.911736 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqd6\" (UniqueName: \"kubernetes.io/projected/2051c290-d2f4-4169-9b3c-782a71b9dc65-kube-api-access-jjqd6\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.911821 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.911775 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.911914 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:57.911898 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 20:52:57.911993 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.911921 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2051c290-d2f4-4169-9b3c-782a71b9dc65-serving-cert\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.911993 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:57.911974 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:58.411948409 +0000 UTC m=+40.181007921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : secret "router-metrics-certs-default" not found Sep 09 20:52:57.912130 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2051c290-d2f4-4169-9b3c-782a71b9dc65-trusted-ca\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.912130 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.912130 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912114 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc154768-9c43-4758-9b19-6e7fa687d32a-snapshots\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.912275 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpfqf\" (UniqueName: \"kubernetes.io/projected/d84a38d5-f187-4423-a046-be2f1ce20c6c-kube-api-access-rpfqf\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.912275 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2051c290-d2f4-4169-9b3c-782a71b9dc65-config\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.912275 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912230 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc154768-9c43-4758-9b19-6e7fa687d32a-tmp\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.912275 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912265 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-stats-auth\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.912441 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc154768-9c43-4758-9b19-6e7fa687d32a-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.912504 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912455 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc154768-9c43-4758-9b19-6e7fa687d32a-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.913345 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912810 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc154768-9c43-4758-9b19-6e7fa687d32a-snapshots\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.913345 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.913103 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc154768-9c43-4758-9b19-6e7fa687d32a-tmp\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.913345 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.913213 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2051c290-d2f4-4169-9b3c-782a71b9dc65-config\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.913345 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:57.913228 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:58.413210379 +0000 UTC m=+40.182269880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : configmap references non-existent config key: service-ca.crt Sep 09 20:52:57.913345 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.912817 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc154768-9c43-4758-9b19-6e7fa687d32a-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.913668 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.913432 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2051c290-d2f4-4169-9b3c-782a71b9dc65-trusted-ca\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.914360 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.914338 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-default-certificate\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.914436 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.914415 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2051c290-d2f4-4169-9b3c-782a71b9dc65-serving-cert\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.914565 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.914546 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc154768-9c43-4758-9b19-6e7fa687d32a-serving-cert\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.915013 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.914996 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-stats-auth\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.923315 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.923292 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fhjs\" (UniqueName: \"kubernetes.io/projected/cc154768-9c43-4758-9b19-6e7fa687d32a-kube-api-access-8fhjs\") pod \"insights-operator-76bcd6ccf5-npfsq\" (UID: \"cc154768-9c43-4758-9b19-6e7fa687d32a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.927972 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.927951 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjqd6\" (UniqueName: \"kubernetes.io/projected/2051c290-d2f4-4169-9b3c-782a71b9dc65-kube-api-access-jjqd6\") pod \"console-operator-85b454874b-xk57q\" (UID: \"2051c290-d2f4-4169-9b3c-782a71b9dc65\") " pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:57.928150 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.928133 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpfqf\" (UniqueName: \"kubernetes.io/projected/d84a38d5-f187-4423-a046-be2f1ce20c6c-kube-api-access-rpfqf\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:57.954184 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.954110 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" Sep 09 20:52:57.977657 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.977624 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9"] Sep 09 20:52:57.980588 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:57.980369 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd33146c_f1d4_45a5_89c0_4b0597287e62.slice/crio-c60c1111fde909fd5fb08b9f27c40856aa4f7365f84ce201fef623e82988136f WatchSource:0}: Error finding container c60c1111fde909fd5fb08b9f27c40856aa4f7365f84ce201fef623e82988136f: Status 404 returned error can't find the container with id c60c1111fde909fd5fb08b9f27c40856aa4f7365f84ce201fef623e82988136f Sep 09 20:52:57.982015 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:57.981983 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:58.026385 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.026352 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:52:58.054578 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.054550 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8xr8" event={"ID":"87f0ad83-f00e-417b-9c17-dba8823441a3","Type":"ContainerStarted","Data":"2acbac1e0038e9a8764233b90f0c8972420ed041a14f9e90f8dbd78cee1fcdef"} Sep 09 20:52:58.055782 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.055761 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" event={"ID":"cd33146c-f1d4-45a5-89c0-4b0597287e62","Type":"ContainerStarted","Data":"c60c1111fde909fd5fb08b9f27c40856aa4f7365f84ce201fef623e82988136f"} Sep 09 20:52:58.065140 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.065116 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thdmf" event={"ID":"1afca2ca-c4d4-4c76-88b4-d2e4e162936b","Type":"ContainerStarted","Data":"e82dd308430f6f787d592758f4bb53349ced0735e94d7218c41798fde60f1c80"} Sep 09 20:52:58.095376 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.095319 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r8xr8" podStartSLOduration=1.864857497 podStartE2EDuration="6.095299463s" totalImagesPullingTime="4.230441966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:58.088950979 +0000 UTC m=+39.858010500" watchObservedRunningTime="2026-09-09 20:52:58.095299463 +0000 UTC m=+39.864358984" Sep 09 20:52:58.155671 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.155487 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-thdmf" podStartSLOduration=9.007647376 podStartE2EDuration="39.155464923s" totalImagesPullingTime="30.147817547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:58.155286375 +0000 UTC m=+39.924345920" watchObservedRunningTime="2026-09-09 20:52:58.155464923 +0000 UTC m=+39.924524445" Sep 09 20:52:58.174381 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.174354 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp"] Sep 09 20:52:58.177843 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:58.177820 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8428ad43_5eef_4a01_9785_b45f130034f6.slice/crio-21e7d2d1e2ea61bc0fa8de51013af8fa47e09df191aacb1a07ad348e2d306a5e WatchSource:0}: Error finding container 21e7d2d1e2ea61bc0fa8de51013af8fa47e09df191aacb1a07ad348e2d306a5e: Status 404 returned error can't find the container with id 21e7d2d1e2ea61bc0fa8de51013af8fa47e09df191aacb1a07ad348e2d306a5e Sep 09 20:52:58.215582 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.215549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:52:58.215777 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.215741 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm"] Sep 09 20:52:58.216387 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:58.215943 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 20:52:58.216387 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:58.216055 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls podName:1027aa12-9484-4415-8e85-85ba4b42788c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:59.216012628 +0000 UTC m=+40.985072150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-qqstm" (UID: "1027aa12-9484-4415-8e85-85ba4b42788c") : secret "samples-operator-tls" not found Sep 09 20:52:58.218151 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:58.218131 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd2f5dff_7485_4ea6_8540_868484df235d.slice/crio-757898b1486ceb9ccbc76aa3124f2248858004dce275a7101c44d8ab729fde31 WatchSource:0}: Error finding container 757898b1486ceb9ccbc76aa3124f2248858004dce275a7101c44d8ab729fde31: Status 404 returned error can't find the container with id 757898b1486ceb9ccbc76aa3124f2248858004dce275a7101c44d8ab729fde31 Sep 09 20:52:58.247977 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.247952 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-nnf7c"] Sep 09 20:52:58.250411 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:58.250393 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895ccf61_30c6_439b_a8f2_65930efa7c93.slice/crio-704970c7c9fa96b859dafecf163f1351dba01314fd637c9360b7fddc751928b6 WatchSource:0}: Error finding container 704970c7c9fa96b859dafecf163f1351dba01314fd637c9360b7fddc751928b6: Status 404 returned error can't find the container with id 704970c7c9fa96b859dafecf163f1351dba01314fd637c9360b7fddc751928b6 Sep 09 20:52:58.263469 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.263447 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:58.275623 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.275597 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-npfsq"] Sep 09 20:52:58.278495 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:58.278473 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc154768_9c43_4758_9b19_6e7fa687d32a.slice/crio-0908ea6ece15545e1e56b4bc9985f8e8789a0b6b03097357ddcedcb85287965f WatchSource:0}: Error finding container 0908ea6ece15545e1e56b4bc9985f8e8789a0b6b03097357ddcedcb85287965f: Status 404 returned error can't find the container with id 0908ea6ece15545e1e56b4bc9985f8e8789a0b6b03097357ddcedcb85287965f Sep 09 20:52:58.316320 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.316301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:58.316409 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:58.316402 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 20:52:58.316458 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:58.316447 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls podName:8d3026c7-2a91-4e77-96df-dea0abb4cb26 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:59.316433113 +0000 UTC m=+41.085492619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4dtsj" (UID: "8d3026c7-2a91-4e77-96df-dea0abb4cb26") : secret "cluster-monitoring-operator-tls" not found Sep 09 20:52:58.327132 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.327114 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-xk57q"] Sep 09 20:52:58.329797 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:52:58.329770 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2051c290_d2f4_4169_9b3c_782a71b9dc65.slice/crio-52603e8f189ada86f84fcb4a5551ef889fd8febce6288e79d85c17b4ddc2f3c8 WatchSource:0}: Error finding container 52603e8f189ada86f84fcb4a5551ef889fd8febce6288e79d85c17b4ddc2f3c8: Status 404 returned error can't find the container with id 52603e8f189ada86f84fcb4a5551ef889fd8febce6288e79d85c17b4ddc2f3c8 Sep 09 20:52:58.331660 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.331634 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:58.417331 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.417299 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:58.417481 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.417351 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:58.417481 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:58.417447 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 20:52:58.417566 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:58.417507 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:59.417492871 +0000 UTC m=+41.186552369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : configmap references non-existent config key: service-ca.crt Sep 09 20:52:58.417566 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:58.417529 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:52:59.417520247 +0000 UTC m=+41.186579749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : secret "router-metrics-certs-default" not found Sep 09 20:52:58.474154 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:58.474129 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:59.070716 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.070634 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-nnf7c" event={"ID":"895ccf61-30c6-439b-a8f2-65930efa7c93","Type":"ContainerStarted","Data":"704970c7c9fa96b859dafecf163f1351dba01314fd637c9360b7fddc751928b6"} Sep 09 20:52:59.072882 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.072834 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" event={"ID":"cc154768-9c43-4758-9b19-6e7fa687d32a","Type":"ContainerStarted","Data":"0908ea6ece15545e1e56b4bc9985f8e8789a0b6b03097357ddcedcb85287965f"} Sep 09 20:52:59.074326 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.074270 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp" event={"ID":"8428ad43-5eef-4a01-9785-b45f130034f6","Type":"ContainerStarted","Data":"21e7d2d1e2ea61bc0fa8de51013af8fa47e09df191aacb1a07ad348e2d306a5e"} Sep 09 20:52:59.075952 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.075911 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" event={"ID":"fd2f5dff-7485-4ea6-8540-868484df235d","Type":"ContainerStarted","Data":"757898b1486ceb9ccbc76aa3124f2248858004dce275a7101c44d8ab729fde31"} Sep 09 20:52:59.079170 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.078562 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-xk57q" event={"ID":"2051c290-d2f4-4169-9b3c-782a71b9dc65","Type":"ContainerStarted","Data":"52603e8f189ada86f84fcb4a5551ef889fd8febce6288e79d85c17b4ddc2f3c8"} Sep 09 20:52:59.223852 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.223811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:52:59.224408 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:59.224259 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 20:52:59.224408 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:59.224334 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls podName:1027aa12-9484-4415-8e85-85ba4b42788c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:01.224314153 +0000 UTC m=+42.993373672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-qqstm" (UID: "1027aa12-9484-4415-8e85-85ba4b42788c") : secret "samples-operator-tls" not found Sep 09 20:52:59.325566 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.324938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:52:59.325566 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:59.325113 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 20:52:59.325566 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:59.325181 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls podName:8d3026c7-2a91-4e77-96df-dea0abb4cb26 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:01.325161908 +0000 UTC m=+43.094221409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4dtsj" (UID: "8d3026c7-2a91-4e77-96df-dea0abb4cb26") : secret "cluster-monitoring-operator-tls" not found Sep 09 20:52:59.417238 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.417156 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:59.426948 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.426164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:59.426948 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.426251 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:52:59.426948 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:59.426488 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:01.426470836 +0000 UTC m=+43.195530349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : configmap references non-existent config key: service-ca.crt Sep 09 20:52:59.426948 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:59.426866 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 20:52:59.426948 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:52:59.426915 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:01.426900455 +0000 UTC m=+43.195959957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : secret "router-metrics-certs-default" not found Sep 09 20:52:59.512575 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.512469 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:52:59.576270 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:52:59.576187 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:00.333674 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:00.333640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:53:00.334154 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:00.333839 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:53:00.334154 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:00.333856 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646f44d6f8-ch8v5: secret "image-registry-tls" not found Sep 09 20:53:00.334154 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:00.333978 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls podName:c0a199fa-3b0c-49fa-afb7-6199d7088c05 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:08.333957295 +0000 UTC m=+50.103016810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls") pod "image-registry-646f44d6f8-ch8v5" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05") : secret "image-registry-tls" not found Sep 09 20:53:00.434544 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:00.434508 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:53:00.434715 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:00.434687 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:53:00.434788 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:00.434770 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls podName:29c9605f-97ab-4575-bcb3-8eff0fe334f4 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:08.434748559 +0000 UTC m=+50.203808082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls") pod "dns-default-7gjmz" (UID: "29c9605f-97ab-4575-bcb3-8eff0fe334f4") : secret "dns-default-metrics-tls" not found Sep 09 20:53:01.056148 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.056111 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-t7bt8"] Sep 09 20:53:01.074373 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.074338 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-t7bt8"] Sep 09 20:53:01.074542 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.074434 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:01.077469 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.077442 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 09 20:53:01.077624 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.077607 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 09 20:53:01.077754 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.077738 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hbs99\"" Sep 09 20:53:01.210945 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.210911 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:01.242392 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.242360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:53:01.242510 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.242422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:01.242510 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.242496 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 20:53:01.242592 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.242551 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/032126d0-a62e-4778-8666-80af8a2fe5b6-nginx-conf\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:01.242592 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.242586 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls podName:1027aa12-9484-4415-8e85-85ba4b42788c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:05.242564658 +0000 UTC m=+47.011624165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-qqstm" (UID: "1027aa12-9484-4415-8e85-85ba4b42788c") : secret "samples-operator-tls" not found Sep 09 20:53:01.289012 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.288979 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:01.343367 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.343336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:01.343719 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.343385 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:53:01.343719 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.343476 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 20:53:01.343719 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.343477 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 20:53:01.343719 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.343526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/032126d0-a62e-4778-8666-80af8a2fe5b6-nginx-conf\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:01.343719 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.343540 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls podName:8d3026c7-2a91-4e77-96df-dea0abb4cb26 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:05.343522357 +0000 UTC m=+47.112581856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4dtsj" (UID: "8d3026c7-2a91-4e77-96df-dea0abb4cb26") : secret "cluster-monitoring-operator-tls" not found Sep 09 20:53:01.343719 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.343599 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert podName:032126d0-a62e-4778-8666-80af8a2fe5b6 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:01.843586651 +0000 UTC m=+43.612646167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-t7bt8" (UID: "032126d0-a62e-4778-8666-80af8a2fe5b6") : secret "networking-console-plugin-cert" not found Sep 09 20:53:01.344134 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.344113 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/032126d0-a62e-4778-8666-80af8a2fe5b6-nginx-conf\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:01.387904 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.387864 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:01.444279 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.444245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:01.444419 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.444298 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:01.444419 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.444384 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 20:53:01.444492 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.444444 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:05.444428565 +0000 UTC m=+47.213488065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : secret "router-metrics-certs-default" not found Sep 09 20:53:01.444492 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.444459 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:05.444453952 +0000 UTC m=+47.213513450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : configmap references non-existent config key: service-ca.crt Sep 09 20:53:01.501697 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.501667 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:01.848111 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:01.848060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:01.848268 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.848226 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 20:53:01.848328 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:01.848308 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert podName:032126d0-a62e-4778-8666-80af8a2fe5b6 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:02.848289314 +0000 UTC m=+44.617348825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-t7bt8" (UID: "032126d0-a62e-4778-8666-80af8a2fe5b6") : secret "networking-console-plugin-cert" not found Sep 09 20:53:02.856150 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:02.856108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:02.856552 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:02.856260 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 20:53:02.856552 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:02.856325 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert podName:032126d0-a62e-4778-8666-80af8a2fe5b6 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:04.856310944 +0000 UTC m=+46.625370444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-t7bt8" (UID: "032126d0-a62e-4778-8666-80af8a2fe5b6") : secret "networking-console-plugin-cert" not found Sep 09 20:53:04.873267 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:04.873241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:04.873587 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:04.873392 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 20:53:04.873587 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:04.873451 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert podName:032126d0-a62e-4778-8666-80af8a2fe5b6 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:08.873436776 +0000 UTC m=+50.642496280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-t7bt8" (UID: "032126d0-a62e-4778-8666-80af8a2fe5b6") : secret "networking-console-plugin-cert" not found Sep 09 20:53:04.933322 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:04.933298 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:05.098698 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.098663 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" event={"ID":"fd2f5dff-7485-4ea6-8540-868484df235d","Type":"ContainerStarted","Data":"dd9ded16102895571b37ae4297517019e2aa384cbaff69281c1a5f41588de3e5"} Sep 09 20:53:05.101087 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.101062 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/0.log" Sep 09 20:53:05.101221 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.101189 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-xk57q" event={"ID":"2051c290-d2f4-4169-9b3c-782a71b9dc65","Type":"ContainerStarted","Data":"2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083"} Sep 09 20:53:05.101379 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.101359 2560 scope.go:117] "RemoveContainer" containerID="2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083" Sep 09 20:53:05.103585 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.103294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-nnf7c" event={"ID":"895ccf61-30c6-439b-a8f2-65930efa7c93","Type":"ContainerStarted","Data":"9f9195545aba920fc08a65ebcf26e35fc62a3e40e5812b1dff05a8c809d06043"} Sep 09 20:53:05.105223 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.105177 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" event={"ID":"cd33146c-f1d4-45a5-89c0-4b0597287e62","Type":"ContainerStarted","Data":"1930199ffcc4df8a0fff35230b97ec98a067a0e706468c130bb555e6ab1415f7"} Sep 09 20:53:05.108102 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.108079 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" event={"ID":"cc154768-9c43-4758-9b19-6e7fa687d32a","Type":"ContainerStarted","Data":"89003753b2f436498a8149b51f1bf2239ff9f9daeadcc72679d9e7371cca85cf"} Sep 09 20:53:05.110233 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.110187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp" event={"ID":"8428ad43-5eef-4a01-9785-b45f130034f6","Type":"ContainerStarted","Data":"c717d0ac6738573f8dd471b9df74d0100afd78b22705fae96fe6bffc94ce8e4c"} Sep 09 20:53:05.120004 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.119842 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" podStartSLOduration=1.481892473 podStartE2EDuration="8.119826739s" totalImagesPullingTime="6.637934266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:05.118907118 +0000 UTC m=+46.887966640" watchObservedRunningTime="2026-09-09 20:53:05.119826739 +0000 UTC m=+46.888886276" Sep 09 20:53:05.143360 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.143296 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" podStartSLOduration=1.269089425 podStartE2EDuration="8.143276116s" totalImagesPullingTime="6.874186691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:05.140930393 +0000 UTC m=+46.909989927" watchObservedRunningTime="2026-09-09 20:53:05.143276116 +0000 UTC m=+46.912335634" Sep 09 20:53:05.161498 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.161441 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-swfcp" podStartSLOduration=1.483197125 podStartE2EDuration="8.161423665s" totalImagesPullingTime="6.67822654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:05.159141964 +0000 UTC m=+46.928201490" watchObservedRunningTime="2026-09-09 20:53:05.161423665 +0000 UTC m=+46.930483187" Sep 09 20:53:05.167863 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.167841 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:05.214678 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.214638 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-nnf7c" podStartSLOduration=1.595396965 podStartE2EDuration="8.214623346s" totalImagesPullingTime="6.619226381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:05.178920756 +0000 UTC m=+46.947980288" watchObservedRunningTime="2026-09-09 20:53:05.214623346 +0000 UTC m=+46.983682906" Sep 09 20:53:05.236493 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.235422 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" podStartSLOduration=1.657886463 podStartE2EDuration="8.235404374s" totalImagesPullingTime="6.577517911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:05.234744478 +0000 UTC m=+47.003804000" watchObservedRunningTime="2026-09-09 20:53:05.235404374 +0000 UTC m=+47.004463895" Sep 09 20:53:05.261326 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.261300 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:05.278675 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.276179 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:53:05.278675 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:05.276940 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 20:53:05.278675 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:05.276997 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls podName:1027aa12-9484-4415-8e85-85ba4b42788c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:13.276980374 +0000 UTC m=+55.046039886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-qqstm" (UID: "1027aa12-9484-4415-8e85-85ba4b42788c") : secret "samples-operator-tls" not found Sep 09 20:53:05.360226 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.360181 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:05.377637 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.377612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:53:05.377783 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:05.377765 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 20:53:05.377849 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:05.377838 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls podName:8d3026c7-2a91-4e77-96df-dea0abb4cb26 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:13.377819245 +0000 UTC m=+55.146878751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4dtsj" (UID: "8d3026c7-2a91-4e77-96df-dea0abb4cb26") : secret "cluster-monitoring-operator-tls" not found Sep 09 20:53:05.478085 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.478052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:05.478232 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.478118 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:05.478232 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:05.478213 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 20:53:05.478338 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:05.478259 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:13.478246056 +0000 UTC m=+55.247305558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : configmap references non-existent config key: service-ca.crt Sep 09 20:53:05.478338 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:05.478282 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:13.478271618 +0000 UTC m=+55.247331121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : secret "router-metrics-certs-default" not found Sep 09 20:53:05.674758 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.674665 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:05.745904 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:05.745879 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:06.115799 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.115773 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 20:53:06.116344 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.116321 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/0.log" Sep 09 20:53:06.116412 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.116368 2560 generic.go:356] "Generic (PLEG): container finished" podID="2051c290-d2f4-4169-9b3c-782a71b9dc65" containerID="2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083" exitCode=255 Sep 09 20:53:06.116412 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.116386 2560 generic.go:356] "Generic (PLEG): container finished" podID="2051c290-d2f4-4169-9b3c-782a71b9dc65" containerID="1a6d1eded072177c2e05f7e0ee96f4a53c8a0d1dd46045819242e537b6d4f84a" exitCode=255 Sep 09 20:53:06.116503 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.116473 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-xk57q" event={"ID":"2051c290-d2f4-4169-9b3c-782a71b9dc65","Type":"ContainerDied","Data":"2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083"} Sep 09 20:53:06.116577 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.116562 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-xk57q" event={"ID":"2051c290-d2f4-4169-9b3c-782a71b9dc65","Type":"ContainerDied","Data":"1a6d1eded072177c2e05f7e0ee96f4a53c8a0d1dd46045819242e537b6d4f84a"} Sep 09 20:53:06.116636 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.116594 2560 scope.go:117] "RemoveContainer" containerID="2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083" Sep 09 20:53:06.116877 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.116863 2560 scope.go:117] "RemoveContainer" containerID="1a6d1eded072177c2e05f7e0ee96f4a53c8a0d1dd46045819242e537b6d4f84a" Sep 09 20:53:06.117076 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:06.117056 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-xk57q_openshift-console-operator(2051c290-d2f4-4169-9b3c-782a71b9dc65)\"" pod="openshift-console-operator/console-operator-85b454874b-xk57q" podUID="2051c290-d2f4-4169-9b3c-782a71b9dc65" Sep 09 20:53:06.147495 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.147459 2560 scope.go:117] "RemoveContainer" containerID="2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083" Sep 09 20:53:06.147793 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:06.147772 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083\": container with ID starting with 2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083 not found: ID does not exist" containerID="2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083" Sep 09 20:53:06.147865 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.147828 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083"} err="failed to get container status \"2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083\": rpc error: code = NotFound desc = could not find container \"2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083\": container with ID starting with 2d2cd3967955a16822ef67c4b207675db5071983363deefc7694a0a1fa3d6083 not found: ID does not exist" Sep 09 20:53:06.208602 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.208575 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:06.593283 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.593236 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2vtbd"] Sep 09 20:53:06.627500 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.627466 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2vtbd"] Sep 09 20:53:06.627671 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.627595 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.629998 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.629974 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fptv8\"" Sep 09 20:53:06.630221 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.630205 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 20:53:06.630280 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.630224 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 20:53:06.689932 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.689898 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-crio-socket\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.690100 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.689985 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.690100 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.690082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.690224 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.690131 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zswdb\" (UniqueName: \"kubernetes.io/projected/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-api-access-zswdb\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.690224 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.690189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-data-volume\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.790736 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.790708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-crio-socket\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.790847 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.790743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.790847 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.790786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.790847 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.790819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zswdb\" (UniqueName: \"kubernetes.io/projected/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-api-access-zswdb\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.790847 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.790848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-data-volume\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.791092 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:06.790910 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:53:06.791092 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:06.790937 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:53:06.791092 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.790914 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-crio-socket\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.791092 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:06.790979 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm podName:7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:07.290958104 +0000 UTC m=+49.060017619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2vtbd" (UID: "7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c") : configmap "kube-rbac-proxy" not found Sep 09 20:53:06.791092 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:06.791067 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls podName:7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:07.291054672 +0000 UTC m=+49.060114177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vtbd" (UID: "7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c") : secret "insights-runtime-extractor-tls" not found Sep 09 20:53:06.791259 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.791161 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-data-volume\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.804525 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.804499 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zswdb\" (UniqueName: \"kubernetes.io/projected/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-api-access-zswdb\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:06.843153 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.843127 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:06.950173 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:06.950099 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:07.044890 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:07.044860 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:07.120871 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:07.120843 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 20:53:07.121287 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:07.121189 2560 scope.go:117] "RemoveContainer" containerID="1a6d1eded072177c2e05f7e0ee96f4a53c8a0d1dd46045819242e537b6d4f84a" Sep 09 20:53:07.121354 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:07.121339 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-xk57q_openshift-console-operator(2051c290-d2f4-4169-9b3c-782a71b9dc65)\"" pod="openshift-console-operator/console-operator-85b454874b-xk57q" podUID="2051c290-d2f4-4169-9b3c-782a71b9dc65" Sep 09 20:53:07.295583 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:07.295505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:07.295583 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:07.295577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:07.295758 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:07.295623 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:53:07.295758 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:07.295685 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm podName:7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:08.295668237 +0000 UTC m=+50.064727756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2vtbd" (UID: "7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c") : configmap "kube-rbac-proxy" not found Sep 09 20:53:07.295758 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:07.295723 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:53:07.295872 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:07.295788 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls podName:7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:08.295770365 +0000 UTC m=+50.064829878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vtbd" (UID: "7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c") : secret "insights-runtime-extractor-tls" not found Sep 09 20:53:07.467724 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:07.467676 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:07.567279 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:07.567180 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:08.026925 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.026882 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:53:08.027088 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.026973 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:53:08.114767 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.114738 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7zr9_1917e841-81cf-49db-947d-40cd8c8c111e/dns-node-resolver/0.log" Sep 09 20:53:08.123906 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.123887 2560 scope.go:117] "RemoveContainer" containerID="1a6d1eded072177c2e05f7e0ee96f4a53c8a0d1dd46045819242e537b6d4f84a" Sep 09 20:53:08.124315 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.124140 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-xk57q_openshift-console-operator(2051c290-d2f4-4169-9b3c-782a71b9dc65)\"" pod="openshift-console-operator/console-operator-85b454874b-xk57q" podUID="2051c290-d2f4-4169-9b3c-782a71b9dc65" Sep 09 20:53:08.307389 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.307311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:08.307528 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.307428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:08.307528 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.307474 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:53:08.307528 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.307493 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:53:08.307626 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.307543 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm podName:7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:10.307530625 +0000 UTC m=+52.076590143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2vtbd" (UID: "7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c") : configmap "kube-rbac-proxy" not found Sep 09 20:53:08.307626 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.307559 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls podName:7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:10.307553388 +0000 UTC m=+52.076612887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vtbd" (UID: "7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c") : secret "insights-runtime-extractor-tls" not found Sep 09 20:53:08.393460 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.393430 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:08.408707 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.408685 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:53:08.408840 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.408823 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:53:08.408887 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.408841 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646f44d6f8-ch8v5: secret "image-registry-tls" not found Sep 09 20:53:08.408922 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.408888 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls podName:c0a199fa-3b0c-49fa-afb7-6199d7088c05 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:24.408875458 +0000 UTC m=+66.177934957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls") pod "image-registry-646f44d6f8-ch8v5" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05") : secret "image-registry-tls" not found Sep 09 20:53:08.497606 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.497576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:08.509988 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.509967 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:53:08.510108 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.510094 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:53:08.510149 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.510144 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls podName:29c9605f-97ab-4575-bcb3-8eff0fe334f4 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:24.510132292 +0000 UTC m=+66.279191792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls") pod "dns-default-7gjmz" (UID: "29c9605f-97ab-4575-bcb3-8eff0fe334f4") : secret "dns-default-metrics-tls" not found Sep 09 20:53:08.659105 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.659072 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:08.912740 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.912659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:08.912881 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.912808 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 20:53:08.912881 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:08.912870 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert podName:032126d0-a62e-4778-8666-80af8a2fe5b6 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:16.912855353 +0000 UTC m=+58.681914852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-t7bt8" (UID: "032126d0-a62e-4778-8666-80af8a2fe5b6") : secret "networking-console-plugin-cert" not found Sep 09 20:53:08.915688 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.915670 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9fmt6_3b9a3743-c66a-497c-935e-c79bb856e33d/node-ca/0.log" Sep 09 20:53:08.923682 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:08.923654 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:09.026121 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:09.026091 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:09.132745 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:09.132714 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:09.915173 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:09.915143 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8xr8_87f0ad83-f00e-417b-9c17-dba8823441a3/serve-healthcheck-canary/0.log" Sep 09 20:53:10.326943 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:10.326868 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:10.326943 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:10.326928 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:10.327335 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:10.327025 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:53:10.327335 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:10.327099 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls podName:7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:14.327083334 +0000 UTC m=+56.096142838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vtbd" (UID: "7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c") : secret "insights-runtime-extractor-tls" not found Sep 09 20:53:10.327407 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:10.327374 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:10.334632 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:10.334610 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:13.164813 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:13.164776 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:13.265804 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:13.265772 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:13.352388 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:13.352344 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:53:13.352537 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:13.352490 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 20:53:13.352576 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:13.352568 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls podName:1027aa12-9484-4415-8e85-85ba4b42788c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:29.352552576 +0000 UTC m=+71.121612075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-qqstm" (UID: "1027aa12-9484-4415-8e85-85ba4b42788c") : secret "samples-operator-tls" not found Sep 09 20:53:13.453333 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:13.453240 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:53:13.453482 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:13.453390 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 20:53:13.453482 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:13.453464 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls podName:8d3026c7-2a91-4e77-96df-dea0abb4cb26 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:29.45344747 +0000 UTC m=+71.222506969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4dtsj" (UID: "8d3026c7-2a91-4e77-96df-dea0abb4cb26") : secret "cluster-monitoring-operator-tls" not found Sep 09 20:53:13.554598 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:13.554559 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:13.554772 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:13.554632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:13.554772 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:13.554710 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 20:53:13.554848 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:13.554780 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:29.554764159 +0000 UTC m=+71.323823676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : secret "router-metrics-certs-default" not found Sep 09 20:53:13.554848 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:13.554796 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle podName:d84a38d5-f187-4423-a046-be2f1ce20c6c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:29.554790064 +0000 UTC m=+71.323849563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle") pod "router-default-845fc486d8-rmtd8" (UID: "d84a38d5-f187-4423-a046-be2f1ce20c6c") : configmap references non-existent config key: service-ca.crt Sep 09 20:53:13.803895 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:13.803817 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:14.058577 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:14.058494 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:14.360983 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:14.360959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:14.361432 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:14.361144 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:53:14.361432 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:14.361235 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls podName:7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c nodeName:}" failed. No retries permitted until 2026-09-09 20:53:22.36121397 +0000 UTC m=+64.130273492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2vtbd" (UID: "7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c") : secret "insights-runtime-extractor-tls" not found Sep 09 20:53:14.419004 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:14.418976 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:14.520874 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:14.520846 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:14.618816 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:14.618745 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:14.764548 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:14.764516 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:14.903942 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:14.903865 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:15.812533 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:15.812501 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:16.000743 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:16.000711 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:16.413930 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:16.413898 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:16.617191 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:16.617161 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:16.985336 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:16.985301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:16.985718 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:16.985430 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 20:53:16.985718 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:16.985492 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert podName:032126d0-a62e-4778-8666-80af8a2fe5b6 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:32.985478222 +0000 UTC m=+74.754537721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-t7bt8" (UID: "032126d0-a62e-4778-8666-80af8a2fe5b6") : secret "networking-console-plugin-cert" not found Sep 09 20:53:17.242612 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:17.242536 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:17.597940 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:17.597907 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:17.774210 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:17.774180 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:17.872089 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:17.871996 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:18.224084 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:18.224003 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:18.307005 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:18.306976 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:19.032465 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:19.032440 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx4j8" Sep 09 20:53:19.683427 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:19.683389 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:19.778204 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:19.778172 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:19.971488 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:19.971408 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:20.063296 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:20.063266 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:20.204317 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:20.204264 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:21.431431 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:21.431397 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:21.494200 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:21.494169 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:22.430434 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:22.430392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:22.432646 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:22.432616 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vtbd\" (UID: \"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c\") " pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:22.540542 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:22.540520 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fptv8\"" Sep 09 20:53:22.547724 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:22.547707 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2vtbd" Sep 09 20:53:22.679389 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:22.679338 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:22.759289 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:22.759189 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:22.819981 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:22.819949 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2vtbd"] Sep 09 20:53:22.824461 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:22.824436 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9f8b32_2ad6_4d42_a334_9e61a4aaf25c.slice/crio-6ea453695ad0f0f128856972bf76df477819acf266954615fb6f3530a71c0b82 WatchSource:0}: Error finding container 6ea453695ad0f0f128856972bf76df477819acf266954615fb6f3530a71c0b82: Status 404 returned error can't find the container with id 6ea453695ad0f0f128856972bf76df477819acf266954615fb6f3530a71c0b82 Sep 09 20:53:23.012264 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:23.012183 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:23.171520 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:23.171479 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vtbd" event={"ID":"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c","Type":"ContainerStarted","Data":"a1205ac7a3d3b2b50e13675a3eda42c52798fab6a3bbce380e8ecee40fdd343d"} Sep 09 20:53:23.171663 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:23.171542 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vtbd" event={"ID":"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c","Type":"ContainerStarted","Data":"6ea453695ad0f0f128856972bf76df477819acf266954615fb6f3530a71c0b82"} Sep 09 20:53:23.690762 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:23.690737 2560 scope.go:117] "RemoveContainer" containerID="1a6d1eded072177c2e05f7e0ee96f4a53c8a0d1dd46045819242e537b6d4f84a" Sep 09 20:53:23.818840 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:23.818735 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:24.014064 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.013995 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:24.177018 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.176989 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 20:53:24.177208 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.177076 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-xk57q" event={"ID":"2051c290-d2f4-4169-9b3c-782a71b9dc65","Type":"ContainerStarted","Data":"de8c048ebfeb833c3996882d9058b3cb7edac1943db77316b7b4c5019ff6a5c7"} Sep 09 20:53:24.177413 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.177391 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:53:24.179329 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.179310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vtbd" event={"ID":"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c","Type":"ContainerStarted","Data":"374a5389760f803403e9f7fadd899d36488df31ada5fb477795dd300f133e31d"} Sep 09 20:53:24.204428 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.204382 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-xk57q" podStartSLOduration=20.67799419 podStartE2EDuration="27.204368848s" totalImagesPullingTime="6.526374658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:24.203701209 +0000 UTC m=+65.972760735" watchObservedRunningTime="2026-09-09 20:53:24.204368848 +0000 UTC m=+65.973428370" Sep 09 20:53:24.243430 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.243377 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-xk57q" Sep 09 20:53:24.449239 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.449166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:53:24.449511 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.449299 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:53:24.449511 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.449399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:53:24.452102 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.452076 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"image-registry-646f44d6f8-ch8v5\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:53:24.454177 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.454158 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 20:53:24.454447 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.454425 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 20:53:24.461594 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.461573 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e84cae0-3a97-4a52-b3d9-e447b551aac8-metrics-certs\") pod \"network-metrics-daemon-kqq54\" (UID: \"3e84cae0-3a97-4a52-b3d9-e447b551aac8\") " pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:53:24.461825 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.461802 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fee1d122-4edc-4e62-bddc-e30d307e5fbd-original-pull-secret\") pod \"global-pull-secret-syncer-s86nr\" (UID: \"fee1d122-4edc-4e62-bddc-e30d307e5fbd\") " pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:53:24.465978 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.465946 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:24.550565 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.550528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:53:24.550713 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.550632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:53:24.553176 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.553150 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29c9605f-97ab-4575-bcb3-8eff0fe334f4-metrics-tls\") pod \"dns-default-7gjmz\" (UID: \"29c9605f-97ab-4575-bcb3-8eff0fe334f4\") " pod="openshift-dns/dns-default-7gjmz" Sep 09 20:53:24.553374 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.553355 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct5gn\" (UniqueName: \"kubernetes.io/projected/ed7e3aa3-1078-4f63-904a-ef4e84e1623c-kube-api-access-ct5gn\") pod \"network-check-target-q5sw5\" (UID: \"ed7e3aa3-1078-4f63-904a-ef4e84e1623c\") " pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:53:24.590405 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.590375 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:24.605748 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.605726 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pstzn\"" Sep 09 20:53:24.608877 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.608854 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s86nr" Sep 09 20:53:24.611929 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.611463 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqq54" Sep 09 20:53:24.618696 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.618676 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-thpvv\"" Sep 09 20:53:24.624147 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.624121 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:53:24.679336 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.679310 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:24.682485 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.682466 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bdddp\"" Sep 09 20:53:24.688861 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.688843 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:53:24.717345 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.717293 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6lpmt\"" Sep 09 20:53:24.725408 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.725391 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7gjmz" Sep 09 20:53:24.789499 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.789396 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:24.893129 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.893105 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:24.990294 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:24.990227 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:25.049298 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.049272 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s86nr"] Sep 09 20:53:25.053013 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:25.052990 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee1d122_4edc_4e62_bddc_e30d307e5fbd.slice/crio-35f90557f4a991c61dab0a99f1e5a6d6ce6bcc08d329cb8047c140cebbdba56e WatchSource:0}: Error finding container 35f90557f4a991c61dab0a99f1e5a6d6ce6bcc08d329cb8047c140cebbdba56e: Status 404 returned error can't find the container with id 35f90557f4a991c61dab0a99f1e5a6d6ce6bcc08d329cb8047c140cebbdba56e Sep 09 20:53:25.071465 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.071364 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-646f44d6f8-ch8v5"] Sep 09 20:53:25.073733 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:25.073707 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a199fa_3b0c_49fa_afb7_6199d7088c05.slice/crio-334d09277fe269eb46673590ea89715d83dd460d89b5fbed35a05fc9fbe3da40 WatchSource:0}: Error finding container 334d09277fe269eb46673590ea89715d83dd460d89b5fbed35a05fc9fbe3da40: Status 404 returned error can't find the container with id 334d09277fe269eb46673590ea89715d83dd460d89b5fbed35a05fc9fbe3da40 Sep 09 20:53:25.088611 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.088518 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7gjmz"] Sep 09 20:53:25.092069 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:25.091933 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c9605f_97ab_4575_bcb3_8eff0fe334f4.slice/crio-3aa847441f2a8802e1224992ae01564f021d4b470e3609629c68d6d99772fcb7 WatchSource:0}: Error finding container 3aa847441f2a8802e1224992ae01564f021d4b470e3609629c68d6d99772fcb7: Status 404 returned error can't find the container with id 3aa847441f2a8802e1224992ae01564f021d4b470e3609629c68d6d99772fcb7 Sep 09 20:53:25.092350 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.092316 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q5sw5"] Sep 09 20:53:25.093743 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.093646 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kqq54"] Sep 09 20:53:25.095428 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:25.095402 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e84cae0_3a97_4a52_b3d9_e447b551aac8.slice/crio-26aa26d71d69c8a2975101470d927ef1818b0f85851ae3f23f25414566b6c33f WatchSource:0}: Error finding container 26aa26d71d69c8a2975101470d927ef1818b0f85851ae3f23f25414566b6c33f: Status 404 returned error can't find the container with id 26aa26d71d69c8a2975101470d927ef1818b0f85851ae3f23f25414566b6c33f Sep 09 20:53:25.096226 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:25.096147 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7e3aa3_1078_4f63_904a_ef4e84e1623c.slice/crio-32adb69b23462adee33490286bc183dea23846e53943f8c930d9bcabc3613c02 WatchSource:0}: Error finding container 32adb69b23462adee33490286bc183dea23846e53943f8c930d9bcabc3613c02: Status 404 returned error can't find the container with id 32adb69b23462adee33490286bc183dea23846e53943f8c930d9bcabc3613c02 Sep 09 20:53:25.183941 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.183909 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" event={"ID":"c0a199fa-3b0c-49fa-afb7-6199d7088c05","Type":"ContainerStarted","Data":"8e0c9bdaccf025d0f8f21e01351fda45c198ac36562dc96b62d017f51a980ba8"} Sep 09 20:53:25.184088 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.183974 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" event={"ID":"c0a199fa-3b0c-49fa-afb7-6199d7088c05","Type":"ContainerStarted","Data":"334d09277fe269eb46673590ea89715d83dd460d89b5fbed35a05fc9fbe3da40"} Sep 09 20:53:25.184088 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.184018 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:53:25.185126 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.185103 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7gjmz" event={"ID":"29c9605f-97ab-4575-bcb3-8eff0fe334f4","Type":"ContainerStarted","Data":"3aa847441f2a8802e1224992ae01564f021d4b470e3609629c68d6d99772fcb7"} Sep 09 20:53:25.186477 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.186460 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q5sw5" event={"ID":"ed7e3aa3-1078-4f63-904a-ef4e84e1623c","Type":"ContainerStarted","Data":"8e96df07cf9dd9741aa328b66b0ca3f9e8293d099a0540bd89e7486c063eae8e"} Sep 09 20:53:25.186562 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.186490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q5sw5" event={"ID":"ed7e3aa3-1078-4f63-904a-ef4e84e1623c","Type":"ContainerStarted","Data":"32adb69b23462adee33490286bc183dea23846e53943f8c930d9bcabc3613c02"} Sep 09 20:53:25.186562 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.186507 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:53:25.187578 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.187559 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqq54" event={"ID":"3e84cae0-3a97-4a52-b3d9-e447b551aac8","Type":"ContainerStarted","Data":"26aa26d71d69c8a2975101470d927ef1818b0f85851ae3f23f25414566b6c33f"} Sep 09 20:53:25.188687 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.188665 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s86nr" event={"ID":"fee1d122-4edc-4e62-bddc-e30d307e5fbd","Type":"ContainerStarted","Data":"35f90557f4a991c61dab0a99f1e5a6d6ce6bcc08d329cb8047c140cebbdba56e"} Sep 09 20:53:25.190848 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.190826 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vtbd" event={"ID":"7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c","Type":"ContainerStarted","Data":"1c5609d5ed4d65e74f3f74902942ce3b322d301f47535efb1e015ee7ef4246b7"} Sep 09 20:53:25.217201 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.217154 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" podStartSLOduration=66.21713859 podStartE2EDuration="1m6.21713859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:25.216346582 +0000 UTC m=+66.985406128" watchObservedRunningTime="2026-09-09 20:53:25.21713859 +0000 UTC m=+66.986198128" Sep 09 20:53:25.273748 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.273660 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2vtbd" podStartSLOduration=17.432903842 podStartE2EDuration="19.273645453s" totalImagesPullingTime="1.840741611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:53:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:25.25046539 +0000 UTC m=+67.019524910" watchObservedRunningTime="2026-09-09 20:53:25.273645453 +0000 UTC m=+67.042704974" Sep 09 20:53:25.273911 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.273884 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q5sw5" podStartSLOduration=66.273876651 podStartE2EDuration="1m6.273876651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:25.272223612 +0000 UTC m=+67.041283127" watchObservedRunningTime="2026-09-09 20:53:25.273876651 +0000 UTC m=+67.042936165" Sep 09 20:53:25.326792 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.326762 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:25.530628 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:25.530555 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:26.127753 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:26.127692 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:26.239870 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:26.239838 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:26.336820 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:26.336785 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:26.409986 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:26.409910 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:28.210735 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:28.210700 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7gjmz" event={"ID":"29c9605f-97ab-4575-bcb3-8eff0fe334f4","Type":"ContainerStarted","Data":"5ad35bb06ca1f8cf07ad1ad5ed82019444e6b6daf346c8a844d8ad193f9f08b9"} Sep 09 20:53:28.212881 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:28.212852 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqq54" event={"ID":"3e84cae0-3a97-4a52-b3d9-e447b551aac8","Type":"ContainerStarted","Data":"5541a42bd44a4e91dddd99f50c10e166f8987dfea5c2d6491d08331bbc619e0b"} Sep 09 20:53:28.213007 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:28.212907 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqq54" event={"ID":"3e84cae0-3a97-4a52-b3d9-e447b551aac8","Type":"ContainerStarted","Data":"a283605e3e8949b7a7db8abf5842bce536839f6945b165018410dfe1eaec83ce"} Sep 09 20:53:28.243330 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:28.243272 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kqq54" podStartSLOduration=66.778768215 podStartE2EDuration="1m9.243258286s" totalImagesPullingTime="2.464490071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:28.241159159 +0000 UTC m=+70.010218679" watchObservedRunningTime="2026-09-09 20:53:28.243258286 +0000 UTC m=+70.012317845" Sep 09 20:53:29.391839 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.391802 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:53:29.394335 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.394306 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1027aa12-9484-4415-8e85-85ba4b42788c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-qqstm\" (UID: \"1027aa12-9484-4415-8e85-85ba4b42788c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:53:29.493269 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.493195 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:53:29.495394 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.495377 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3026c7-2a91-4e77-96df-dea0abb4cb26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4dtsj\" (UID: \"8d3026c7-2a91-4e77-96df-dea0abb4cb26\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:53:29.593605 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.593574 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:29.593739 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.593620 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:29.594203 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.594181 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d84a38d5-f187-4423-a046-be2f1ce20c6c-service-ca-bundle\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:29.595759 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.595732 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d84a38d5-f187-4423-a046-be2f1ce20c6c-metrics-certs\") pod \"router-default-845fc486d8-rmtd8\" (UID: \"d84a38d5-f187-4423-a046-be2f1ce20c6c\") " pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:29.602300 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.602280 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bf64g\"" Sep 09 20:53:29.610473 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.610459 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" Sep 09 20:53:29.732257 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.732230 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wzg75\"" Sep 09 20:53:29.739708 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.739685 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" Sep 09 20:53:29.816141 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.816116 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qkvhm\"" Sep 09 20:53:29.824417 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.824401 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:29.886133 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:29.886099 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm"] Sep 09 20:53:30.009586 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.009563 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj"] Sep 09 20:53:30.011842 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:30.011817 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3026c7_2a91_4e77_96df_dea0abb4cb26.slice/crio-22b66e137ca715c52624552f9e20e9d4bf4f0d1fe587cce430407e9f7730ad52 WatchSource:0}: Error finding container 22b66e137ca715c52624552f9e20e9d4bf4f0d1fe587cce430407e9f7730ad52: Status 404 returned error can't find the container with id 22b66e137ca715c52624552f9e20e9d4bf4f0d1fe587cce430407e9f7730ad52 Sep 09 20:53:30.095527 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.095487 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-845fc486d8-rmtd8"] Sep 09 20:53:30.099071 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:30.099025 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84a38d5_f187_4423_a046_be2f1ce20c6c.slice/crio-852696609ccc1b08c462d97fcf8576e96f4ae17220c09196f7fa35a433a503b9 WatchSource:0}: Error finding container 852696609ccc1b08c462d97fcf8576e96f4ae17220c09196f7fa35a433a503b9: Status 404 returned error can't find the container with id 852696609ccc1b08c462d97fcf8576e96f4ae17220c09196f7fa35a433a503b9 Sep 09 20:53:30.224297 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.224266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" event={"ID":"8d3026c7-2a91-4e77-96df-dea0abb4cb26","Type":"ContainerStarted","Data":"22b66e137ca715c52624552f9e20e9d4bf4f0d1fe587cce430407e9f7730ad52"} Sep 09 20:53:30.226172 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.226142 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7gjmz" event={"ID":"29c9605f-97ab-4575-bcb3-8eff0fe334f4","Type":"ContainerStarted","Data":"19ef6cf17977fa494fbc0354bd0f8507a034a434348a828e809b18276f238bbe"} Sep 09 20:53:30.226306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.226260 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7gjmz" Sep 09 20:53:30.227666 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.227646 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-845fc486d8-rmtd8" event={"ID":"d84a38d5-f187-4423-a046-be2f1ce20c6c","Type":"ContainerStarted","Data":"f6cae7fa7139065ab75b44c428dc841438ae51ef4f9d9177654e053631b03e65"} Sep 09 20:53:30.227741 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.227684 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-845fc486d8-rmtd8" event={"ID":"d84a38d5-f187-4423-a046-be2f1ce20c6c","Type":"ContainerStarted","Data":"852696609ccc1b08c462d97fcf8576e96f4ae17220c09196f7fa35a433a503b9"} Sep 09 20:53:30.229131 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.229110 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s86nr" event={"ID":"fee1d122-4edc-4e62-bddc-e30d307e5fbd","Type":"ContainerStarted","Data":"8f67ced12dcd687d6c62ba46221d63b537995d2eaf9727b9a8b05ee69399d36a"} Sep 09 20:53:30.230361 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.230341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" event={"ID":"1027aa12-9484-4415-8e85-85ba4b42788c","Type":"ContainerStarted","Data":"0603a95278b202136253a4e4c0252c3737be7737c53410eb5fac44e4e41eda0b"} Sep 09 20:53:30.245020 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.244978 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7gjmz" podStartSLOduration=35.772044771 podStartE2EDuration="38.244965931s" totalImagesPullingTime="2.47292116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:30.244163651 +0000 UTC m=+72.013223172" watchObservedRunningTime="2026-09-09 20:53:30.244965931 +0000 UTC m=+72.014025491" Sep 09 20:53:30.265567 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.265497 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-845fc486d8-rmtd8" podStartSLOduration=33.265479797 podStartE2EDuration="33.265479797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:30.264850598 +0000 UTC m=+72.033910116" watchObservedRunningTime="2026-09-09 20:53:30.265479797 +0000 UTC m=+72.034539318" Sep 09 20:53:30.280773 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.280733 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s86nr" podStartSLOduration=67.101733774 podStartE2EDuration="1m11.280722395s" totalImagesPullingTime="4.178988621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:30.279901482 +0000 UTC m=+72.048961013" watchObservedRunningTime="2026-09-09 20:53:30.280722395 +0000 UTC m=+72.049781917" Sep 09 20:53:30.586402 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.586360 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:30.691847 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.691792 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:30.825004 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.824967 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:30.828707 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:30.828682 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:31.236481 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:31.236451 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:31.238026 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:31.237999 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-845fc486d8-rmtd8" Sep 09 20:53:31.546939 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:31.546909 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:31.677299 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:31.677254 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:31.871768 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:31.871721 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:31.991718 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:31.991682 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:32.118164 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:32.118134 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:32.242757 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:32.242668 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" event={"ID":"1027aa12-9484-4415-8e85-85ba4b42788c","Type":"ContainerStarted","Data":"0745c1fff8c9770e3d041923126be10180386886bcc83bacee69fd9ffbcf1e57"} Sep 09 20:53:32.242757 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:32.242738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" event={"ID":"1027aa12-9484-4415-8e85-85ba4b42788c","Type":"ContainerStarted","Data":"76da5cd06a397b8a5f32f7b671ac05ee18feefaeac9f18e549f0623812604df6"} Sep 09 20:53:32.272330 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:32.272282 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-qqstm" podStartSLOduration=33.852319922 podStartE2EDuration="35.272263769s" totalImagesPullingTime="1.419943847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:32.266509232 +0000 UTC m=+74.035568768" watchObservedRunningTime="2026-09-09 20:53:32.272263769 +0000 UTC m=+74.041323291" Sep 09 20:53:32.619280 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:32.619254 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:32.719370 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:32.719342 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:32.833274 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:32.833243 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:32.979767 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:32.979682 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:33.025852 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.025816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:33.028249 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.028224 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032126d0-a62e-4778-8666-80af8a2fe5b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-t7bt8\" (UID: \"032126d0-a62e-4778-8666-80af8a2fe5b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:33.100338 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.100305 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:33.191407 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.191384 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hbs99\"" Sep 09 20:53:33.198498 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.198476 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" Sep 09 20:53:33.254127 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.254088 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" event={"ID":"8d3026c7-2a91-4e77-96df-dea0abb4cb26","Type":"ContainerStarted","Data":"e77f719903393e2dc925c3addc11446245e85c2c98dfa50ae37c08f162ea9290"} Sep 09 20:53:33.296080 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.295987 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4dtsj" podStartSLOduration=33.722814523 podStartE2EDuration="36.295964197s" totalImagesPullingTime="2.573149674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:33.293258919 +0000 UTC m=+75.062318441" watchObservedRunningTime="2026-09-09 20:53:33.295964197 +0000 UTC m=+75.065023719" Sep 09 20:53:33.358524 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.358491 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:33.437164 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.437134 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94"] Sep 09 20:53:33.440488 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.440471 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" Sep 09 20:53:33.443681 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.443665 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mktqq\"" Sep 09 20:53:33.444276 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.444262 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 09 20:53:33.460738 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.460713 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94"] Sep 09 20:53:33.491166 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.491148 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-t7bt8"] Sep 09 20:53:33.493852 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:33.493834 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032126d0_a62e_4778_8666_80af8a2fe5b6.slice/crio-18c444b0bc7e23fb2580028212da4f7855b62114227aa4bde4b9f9b153d25d61 WatchSource:0}: Error finding container 18c444b0bc7e23fb2580028212da4f7855b62114227aa4bde4b9f9b153d25d61: Status 404 returned error can't find the container with id 18c444b0bc7e23fb2580028212da4f7855b62114227aa4bde4b9f9b153d25d61 Sep 09 20:53:33.529791 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.529772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xfd94\" (UID: \"cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" Sep 09 20:53:33.630890 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.630865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xfd94\" (UID: \"cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" Sep 09 20:53:33.631027 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:33.631007 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 09 20:53:33.631097 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:33.631090 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24-tls-certificates podName:cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:34.13107343 +0000 UTC m=+75.900132929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-xfd94" (UID: "cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24") : secret "prometheus-operator-admission-webhook-tls" not found Sep 09 20:53:33.752487 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:33.752419 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:34.136507 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:34.136472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xfd94\" (UID: \"cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" Sep 09 20:53:34.138972 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:34.138944 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xfd94\" (UID: \"cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" Sep 09 20:53:34.264195 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:34.264123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" event={"ID":"032126d0-a62e-4778-8666-80af8a2fe5b6","Type":"ContainerStarted","Data":"18c444b0bc7e23fb2580028212da4f7855b62114227aa4bde4b9f9b153d25d61"} Sep 09 20:53:34.349764 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:34.349729 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" Sep 09 20:53:34.762516 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:34.762447 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:34.833380 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:34.833357 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94"] Sep 09 20:53:34.847010 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:34.846982 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:34.909303 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:34.909280 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb13cd8d_7f51_4c32_bc3c_c43ce6a98c24.slice/crio-b46766e8e2f36c21c2b73d65c46f52afd052ea1170ac11811869fdf9b3f810f1 WatchSource:0}: Error finding container b46766e8e2f36c21c2b73d65c46f52afd052ea1170ac11811869fdf9b3f810f1: Status 404 returned error can't find the container with id b46766e8e2f36c21c2b73d65c46f52afd052ea1170ac11811869fdf9b3f810f1 Sep 09 20:53:35.268628 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:35.268598 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" event={"ID":"cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24","Type":"ContainerStarted","Data":"b46766e8e2f36c21c2b73d65c46f52afd052ea1170ac11811869fdf9b3f810f1"} Sep 09 20:53:35.270012 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:35.269986 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" event={"ID":"032126d0-a62e-4778-8666-80af8a2fe5b6","Type":"ContainerStarted","Data":"892b352784219180256bbb12b6d022074178da121bfc3cecd17c9de61ec585ea"} Sep 09 20:53:35.291273 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:35.291198 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-t7bt8" podStartSLOduration=32.847660358 podStartE2EDuration="34.291183934s" totalImagesPullingTime="1.443523576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:35.289411619 +0000 UTC m=+77.058471141" watchObservedRunningTime="2026-09-09 20:53:35.291183934 +0000 UTC m=+77.060243455" Sep 09 20:53:35.464020 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:35.463979 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:35.558788 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:35.558712 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:35.628554 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:35.628517 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:35.703901 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:35.703867 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:37.166469 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.166438 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:37.238630 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.238600 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7gjmz" Sep 09 20:53:37.279926 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.279786 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" event={"ID":"cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24","Type":"ContainerStarted","Data":"f9fc9d607bbf95de80491bef4e9ed4102b8499e099033450a57021cac0cc7ea1"} Sep 09 20:53:37.280098 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.279966 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" Sep 09 20:53:37.284850 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.284819 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" Sep 09 20:53:37.299398 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.299347 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xfd94" podStartSLOduration=2.787204725 podStartE2EDuration="4.299333115s" totalImagesPullingTime="1.51212839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:37.298924149 +0000 UTC m=+79.067983673" watchObservedRunningTime="2026-09-09 20:53:37.299333115 +0000 UTC m=+79.068392636" Sep 09 20:53:37.425290 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.425217 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:37.479258 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.479226 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-kmrnf"] Sep 09 20:53:37.500901 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.500871 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-kmrnf"] Sep 09 20:53:37.501062 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.500997 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.504329 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.504303 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xkz96\"" Sep 09 20:53:37.504546 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.504529 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 09 20:53:37.504852 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.504835 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 09 20:53:37.505303 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.505278 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 20:53:37.604176 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.604137 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:37.661834 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.661807 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d85b9\" (UniqueName: \"kubernetes.io/projected/e301926b-0dc5-4c8e-8948-c7b685adb882-kube-api-access-d85b9\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.661965 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.661839 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e301926b-0dc5-4c8e-8948-c7b685adb882-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.661965 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.661859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e301926b-0dc5-4c8e-8948-c7b685adb882-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.661965 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.661936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e301926b-0dc5-4c8e-8948-c7b685adb882-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.746233 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.746163 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:37.763288 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.763260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d85b9\" (UniqueName: \"kubernetes.io/projected/e301926b-0dc5-4c8e-8948-c7b685adb882-kube-api-access-d85b9\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.763389 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.763293 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e301926b-0dc5-4c8e-8948-c7b685adb882-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.763389 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.763311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e301926b-0dc5-4c8e-8948-c7b685adb882-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.763389 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.763351 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e301926b-0dc5-4c8e-8948-c7b685adb882-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.763933 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.763911 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e301926b-0dc5-4c8e-8948-c7b685adb882-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.765656 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.765636 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e301926b-0dc5-4c8e-8948-c7b685adb882-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.765734 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.765722 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e301926b-0dc5-4c8e-8948-c7b685adb882-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.776433 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.776408 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d85b9\" (UniqueName: \"kubernetes.io/projected/e301926b-0dc5-4c8e-8948-c7b685adb882-kube-api-access-d85b9\") pod \"prometheus-operator-6f4946db56-kmrnf\" (UID: \"e301926b-0dc5-4c8e-8948-c7b685adb882\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:37.812402 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:37.812381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" Sep 09 20:53:38.099505 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:38.099483 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-kmrnf"] Sep 09 20:53:38.102001 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:38.101975 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode301926b_0dc5_4c8e_8948_c7b685adb882.slice/crio-80f317bf3012d443c9175dd41a6dad0ea2f83a4d586d404a544447aa0b72949a WatchSource:0}: Error finding container 80f317bf3012d443c9175dd41a6dad0ea2f83a4d586d404a544447aa0b72949a: Status 404 returned error can't find the container with id 80f317bf3012d443c9175dd41a6dad0ea2f83a4d586d404a544447aa0b72949a Sep 09 20:53:38.289448 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:38.289408 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" event={"ID":"e301926b-0dc5-4c8e-8948-c7b685adb882","Type":"ContainerStarted","Data":"80f317bf3012d443c9175dd41a6dad0ea2f83a4d586d404a544447aa0b72949a"} Sep 09 20:53:40.173747 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:40.173667 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:40.298296 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:40.298268 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" event={"ID":"e301926b-0dc5-4c8e-8948-c7b685adb882","Type":"ContainerStarted","Data":"b2522e78e3203f23939d81c3adfa8d305ce6c2fbd143f46b59f5f6b089f5a9e5"} Sep 09 20:53:40.298449 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:40.298318 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" event={"ID":"e301926b-0dc5-4c8e-8948-c7b685adb882","Type":"ContainerStarted","Data":"e51aca895f36c08b1988ef11bcaeb589b3ff37a884c6e02e68535bb099fa000d"} Sep 09 20:53:40.327820 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:40.327774 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-kmrnf" podStartSLOduration=2.039434999 podStartE2EDuration="3.327760997s" totalImagesPullingTime="1.288325998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:40.327183571 +0000 UTC m=+82.096243103" watchObservedRunningTime="2026-09-09 20:53:40.327760997 +0000 UTC m=+82.096820578" Sep 09 20:53:40.406448 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:40.406420 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:40.472404 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:40.472321 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:40.761027 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:40.760920 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:40.861778 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:40.861748 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:41.663595 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:41.663559 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:41.913875 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:41.913804 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:42.074135 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.074102 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:42.148021 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.147990 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c"] Sep 09 20:53:42.150973 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.150955 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.157734 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.157708 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 20:53:42.158400 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.158381 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lgdsw\"" Sep 09 20:53:42.160832 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.160816 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 20:53:42.188321 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.188263 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c"] Sep 09 20:53:42.203321 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.203297 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:42.300733 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.300701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f7044bb-297e-4f0b-b69a-482b8bedb660-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.300873 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.300743 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ntdq\" (UniqueName: \"kubernetes.io/projected/1f7044bb-297e-4f0b-b69a-482b8bedb660-kube-api-access-4ntdq\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.300873 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.300763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f7044bb-297e-4f0b-b69a-482b8bedb660-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.300873 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.300852 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f7044bb-297e-4f0b-b69a-482b8bedb660-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.361611 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.361580 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:42.391306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.391272 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xffcq"] Sep 09 20:53:42.394804 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.394784 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.401387 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.401353 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f7044bb-297e-4f0b-b69a-482b8bedb660-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.401493 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.401409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ntdq\" (UniqueName: \"kubernetes.io/projected/1f7044bb-297e-4f0b-b69a-482b8bedb660-kube-api-access-4ntdq\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.401493 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.401437 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f7044bb-297e-4f0b-b69a-482b8bedb660-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.401493 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.401476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f7044bb-297e-4f0b-b69a-482b8bedb660-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.401646 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:42.401613 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 09 20:53:42.401692 ip-10-0-140-67 kubenswrapper[2560]: E0909 20:53:42.401680 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f7044bb-297e-4f0b-b69a-482b8bedb660-openshift-state-metrics-tls podName:1f7044bb-297e-4f0b-b69a-482b8bedb660 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:42.901660707 +0000 UTC m=+84.670720226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1f7044bb-297e-4f0b-b69a-482b8bedb660-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-vnf4c" (UID: "1f7044bb-297e-4f0b-b69a-482b8bedb660") : secret "openshift-state-metrics-tls" not found Sep 09 20:53:42.402244 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.402227 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f7044bb-297e-4f0b-b69a-482b8bedb660-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.403591 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.403576 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f7044bb-297e-4f0b-b69a-482b8bedb660-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.404508 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.404491 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 20:53:42.404707 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.404690 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vrjqf\"" Sep 09 20:53:42.404769 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.404730 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 20:53:42.404848 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.404823 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 20:53:42.418252 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.418225 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ntdq\" (UniqueName: \"kubernetes.io/projected/1f7044bb-297e-4f0b-b69a-482b8bedb660-kube-api-access-4ntdq\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.502379 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.502315 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-wtmp\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.502379 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.502349 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.502539 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.502382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-root\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.502539 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.502412 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-metrics-client-ca\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.502539 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.502500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-textfile\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.502670 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.502542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-sys\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.502670 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.502644 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45ffs\" (UniqueName: \"kubernetes.io/projected/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-kube-api-access-45ffs\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.502814 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.502715 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-tls\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.502814 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.502745 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.582772 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.582747 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:42.603952 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.603926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45ffs\" (UniqueName: \"kubernetes.io/projected/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-kube-api-access-45ffs\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604092 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.603971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-tls\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604092 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.603993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604092 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604024 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-wtmp\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604092 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604068 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604099 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-root\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604130 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-metrics-client-ca\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-textfile\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-sys\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604203 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-wtmp\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604239 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-root\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604272 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-sys\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604659 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604531 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-textfile\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604659 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604644 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.604765 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.604731 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-metrics-client-ca\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.606348 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.606330 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-tls\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.606435 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.606373 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.615850 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.615824 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45ffs\" (UniqueName: \"kubernetes.io/projected/348c3975-ca17-4b4c-8cb2-3cb4d4e969c7-kube-api-access-45ffs\") pod \"node-exporter-xffcq\" (UID: \"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7\") " pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.704090 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.704068 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xffcq" Sep 09 20:53:42.714675 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:42.714625 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348c3975_ca17_4b4c_8cb2_3cb4d4e969c7.slice/crio-c6aa1d25cc3b64f804b3be23099aa440c86bd9fde7be70d8db27dc65c50bfa46 WatchSource:0}: Error finding container c6aa1d25cc3b64f804b3be23099aa440c86bd9fde7be70d8db27dc65c50bfa46: Status 404 returned error can't find the container with id c6aa1d25cc3b64f804b3be23099aa440c86bd9fde7be70d8db27dc65c50bfa46 Sep 09 20:53:42.719914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.719892 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:42.897504 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.897443 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:42.907625 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.907598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f7044bb-297e-4f0b-b69a-482b8bedb660-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:42.909965 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:42.909943 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f7044bb-297e-4f0b-b69a-482b8bedb660-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vnf4c\" (UID: \"1f7044bb-297e-4f0b-b69a-482b8bedb660\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:43.026418 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.026391 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:43.060159 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.060134 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" Sep 09 20:53:43.137342 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.137314 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:43.254359 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.254286 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:43.310891 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.310862 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xffcq" event={"ID":"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7","Type":"ContainerStarted","Data":"c6aa1d25cc3b64f804b3be23099aa440c86bd9fde7be70d8db27dc65c50bfa46"} Sep 09 20:53:43.354789 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.354756 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c"] Sep 09 20:53:43.366280 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.366256 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:43.368977 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:43.368949 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7044bb_297e_4f0b_b69a_482b8bedb660.slice/crio-9070e2513261f73b80ec81bc7661e860079b0639632febc66257bc7b0fd0ec79 WatchSource:0}: Error finding container 9070e2513261f73b80ec81bc7661e860079b0639632febc66257bc7b0fd0ec79: Status 404 returned error can't find the container with id 9070e2513261f73b80ec81bc7661e860079b0639632febc66257bc7b0fd0ec79 Sep 09 20:53:43.420017 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.419995 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:53:43.423533 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.423518 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.434633 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.434615 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 20:53:43.434734 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.434720 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 20:53:43.434780 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.434731 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 20:53:43.435370 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.435352 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 20:53:43.435440 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.435430 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 20:53:43.435517 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.435502 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 20:53:43.435573 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.435535 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sfx2h\"" Sep 09 20:53:43.435702 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.435686 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 20:53:43.435781 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.435758 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 20:53:43.436123 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.436107 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 20:53:43.467804 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.466859 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:53:43.514595 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef93ac1a-4231-4216-971b-b635f57da6d7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514728 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514606 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef93ac1a-4231-4216-971b-b635f57da6d7-config-out\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514728 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514728 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514649 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514728 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef93ac1a-4231-4216-971b-b635f57da6d7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514728 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef93ac1a-4231-4216-971b-b635f57da6d7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514976 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514746 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514976 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514775 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514976 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-web-config\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514976 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514824 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef93ac1a-4231-4216-971b-b635f57da6d7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514976 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514881 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514976 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514907 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.514976 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.514927 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnnhg\" (UniqueName: \"kubernetes.io/projected/ef93ac1a-4231-4216-971b-b635f57da6d7-kube-api-access-wnnhg\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.525170 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.525150 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:43.616137 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616137 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616316 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616155 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-web-config\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616316 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef93ac1a-4231-4216-971b-b635f57da6d7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616316 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616316 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616534 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616320 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnnhg\" (UniqueName: \"kubernetes.io/projected/ef93ac1a-4231-4216-971b-b635f57da6d7-kube-api-access-wnnhg\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616534 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef93ac1a-4231-4216-971b-b635f57da6d7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616534 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef93ac1a-4231-4216-971b-b635f57da6d7-config-out\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616740 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616740 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616731 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616876 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef93ac1a-4231-4216-971b-b635f57da6d7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.616876 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.616788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef93ac1a-4231-4216-971b-b635f57da6d7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.618384 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.618021 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef93ac1a-4231-4216-971b-b635f57da6d7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.619276 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.619256 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef93ac1a-4231-4216-971b-b635f57da6d7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.619419 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.619396 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.619489 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.619388 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.619489 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.619302 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef93ac1a-4231-4216-971b-b635f57da6d7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.619698 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.619673 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-web-config\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.619777 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.619753 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef93ac1a-4231-4216-971b-b635f57da6d7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.619777 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.619770 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef93ac1a-4231-4216-971b-b635f57da6d7-config-out\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.619777 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.619773 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.620118 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.620098 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.621163 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.621144 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.621235 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.621220 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef93ac1a-4231-4216-971b-b635f57da6d7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.629862 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.629841 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnnhg\" (UniqueName: \"kubernetes.io/projected/ef93ac1a-4231-4216-971b-b635f57da6d7-kube-api-access-wnnhg\") pod \"alertmanager-main-0\" (UID: \"ef93ac1a-4231-4216-971b-b635f57da6d7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:43.735291 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:43.735255 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:44.065144 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:44.065117 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:53:44.066066 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:44.065996 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef93ac1a_4231_4216_971b_b635f57da6d7.slice/crio-860b9a568fcbc163c46563ad8293d3428f380fdeb3384b9d67eb5e93ef3785ec WatchSource:0}: Error finding container 860b9a568fcbc163c46563ad8293d3428f380fdeb3384b9d67eb5e93ef3785ec: Status 404 returned error can't find the container with id 860b9a568fcbc163c46563ad8293d3428f380fdeb3384b9d67eb5e93ef3785ec Sep 09 20:53:44.317294 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:44.317215 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef93ac1a-4231-4216-971b-b635f57da6d7","Type":"ContainerStarted","Data":"860b9a568fcbc163c46563ad8293d3428f380fdeb3384b9d67eb5e93ef3785ec"} Sep 09 20:53:44.319578 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:44.319551 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" event={"ID":"1f7044bb-297e-4f0b-b69a-482b8bedb660","Type":"ContainerStarted","Data":"f0c842c8bdd9b9ac8c8ad4d0ada6f8017c55a256f25d28efc6bcf59cd0f9b71d"} Sep 09 20:53:44.319697 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:44.319609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" event={"ID":"1f7044bb-297e-4f0b-b69a-482b8bedb660","Type":"ContainerStarted","Data":"a533c7a3aeb12567a1632ee236938f5ddd885fe2e2452d943632a24ed6f3e3a3"} Sep 09 20:53:44.319697 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:44.319633 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" event={"ID":"1f7044bb-297e-4f0b-b69a-482b8bedb660","Type":"ContainerStarted","Data":"9070e2513261f73b80ec81bc7661e860079b0639632febc66257bc7b0fd0ec79"} Sep 09 20:53:45.117918 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:45.117878 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:45.327018 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:45.326941 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" event={"ID":"1f7044bb-297e-4f0b-b69a-482b8bedb660","Type":"ContainerStarted","Data":"5dbb177555ba1cde8070e7644b05a4cbf2baeeb30fdbb0a4ba62eb69be83222c"} Sep 09 20:53:45.365806 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:45.365744 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnf4c" podStartSLOduration=2.450179655 podStartE2EDuration="3.365721365s" totalImagesPullingTime="915.54171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:45.364664831 +0000 UTC m=+87.133724345" watchObservedRunningTime="2026-09-09 20:53:45.365721365 +0000 UTC m=+87.134780887" Sep 09 20:53:45.409607 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:45.409536 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:45.529528 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:45.529500 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:45.615395 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:45.615370 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:45.821140 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:45.821058 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:46.201906 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:46.201876 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:53:46.332202 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:46.332171 2560 generic.go:356] "Generic (PLEG): container finished" podID="ef93ac1a-4231-4216-971b-b635f57da6d7" containerID="4673d07fef71380508b14e3409f645e5720c40a8b11067bf8942b544966907c9" exitCode=0 Sep 09 20:53:46.332390 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:46.332253 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef93ac1a-4231-4216-971b-b635f57da6d7","Type":"ContainerDied","Data":"4673d07fef71380508b14e3409f645e5720c40a8b11067bf8942b544966907c9"} Sep 09 20:53:46.452909 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:46.452835 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:46.547895 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:46.547862 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:46.672403 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:46.672373 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:46.786833 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:46.786735 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:47.694444 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:47.694410 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:48.344646 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.344609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef93ac1a-4231-4216-971b-b635f57da6d7","Type":"ContainerStarted","Data":"4c80b918faea843f1122be1ba23ac50ac3a42ac39a80080adc6452c019d18aa0"} Sep 09 20:53:48.344798 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.344733 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef93ac1a-4231-4216-971b-b635f57da6d7","Type":"ContainerStarted","Data":"da34e8b1f77684d5b3e0608ca2b00ba4481b179e16f6c2ba1f123ec0bbea3177"} Sep 09 20:53:48.344851 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.344798 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef93ac1a-4231-4216-971b-b635f57da6d7","Type":"ContainerStarted","Data":"4251ad38ecb9175d329eb03c30b88c7cb43e6d8646f4f87e9b489021fc4e00a4"} Sep 09 20:53:48.344851 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.344838 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef93ac1a-4231-4216-971b-b635f57da6d7","Type":"ContainerStarted","Data":"0d3c20879a6c84872f4dea04c3e5636c15372903fa034baed2bc49cbeffad1dd"} Sep 09 20:53:48.344924 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.344879 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef93ac1a-4231-4216-971b-b635f57da6d7","Type":"ContainerStarted","Data":"d0463718576fbbf43d46afabff228f10f75bfc197d2f81e65ee35bc434e0f7d0"} Sep 09 20:53:48.807603 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.807569 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:48.808306 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.808287 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:53:48.812853 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.812602 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.815713 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.815695 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bj6s6\"" Sep 09 20:53:48.818778 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.818761 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 20:53:48.818957 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.818934 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 20:53:48.819104 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.819060 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 20:53:48.819345 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.819329 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 20:53:48.819974 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.819721 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 20:53:48.819974 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.819749 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 20:53:48.819974 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.819800 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 20:53:48.819974 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.819819 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 20:53:48.819974 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.819832 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 20:53:48.819974 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.819843 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 20:53:48.820467 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.820230 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 20:53:48.820467 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.820245 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 20:53:48.820467 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.820304 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9d3iddhi72idf\"" Sep 09 20:53:48.821233 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.821216 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 20:53:48.821614 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.821592 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 20:53:48.821978 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.821957 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 20:53:48.836806 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.835226 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:53:48.961761 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.961732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.961909 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.961776 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.961909 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.961873 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptng8\" (UniqueName: \"kubernetes.io/projected/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-kube-api-access-ptng8\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962029 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.961913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-web-config\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962029 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.961969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962160 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-config-out\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962160 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962104 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962160 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962312 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962312 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962217 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962312 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-config\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962312 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962262 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962312 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962278 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962312 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962305 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962602 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962602 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962602 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962400 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962602 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962602 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:48.962602 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:48.962543 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.063431 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.063337 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.063431 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.063381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.063431 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.063406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.063693 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.063442 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.063693 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.063471 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.063693 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.063494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.063541 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.064144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.064199 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptng8\" (UniqueName: \"kubernetes.io/projected/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-kube-api-access-ptng8\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.064673 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-web-config\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.064737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.064786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-config-out\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.064845 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.064886 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.064951 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.064970 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.065007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.066157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-config\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.066192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.066290 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.068893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.068156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.069681 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.069162 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.069681 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.069646 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.071778 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.069712 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.071778 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.071456 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.072367 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.072339 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.072772 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.072747 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.073240 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.073217 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-config\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.076286 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.073357 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-config-out\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.076286 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.073834 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.076286 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.074448 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.076286 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.074750 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.076616 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.076590 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.076752 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.076651 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.077367 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.077345 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-web-config\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.077894 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.077875 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.078174 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.078126 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptng8\" (UniqueName: \"kubernetes.io/projected/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-kube-api-access-ptng8\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.078377 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.078331 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.079346 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.079325 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.079724 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.079703 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/975fcd98-9db5-4fa4-9e13-070cbe2a5d83-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"975fcd98-9db5-4fa4-9e13-070cbe2a5d83\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.137551 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.137523 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:49.352277 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.352240 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef93ac1a-4231-4216-971b-b635f57da6d7","Type":"ContainerStarted","Data":"3159a53a47e6545adf9b509b995e535ac6f72db441aabe446fadaafd4c9eb7b0"} Sep 09 20:53:49.353763 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.353736 2560 generic.go:356] "Generic (PLEG): container finished" podID="348c3975-ca17-4b4c-8cb2-3cb4d4e969c7" containerID="229c93a17d688a558022b044b16bcee8c7fc9a636ac26d784999121d5ab79961" exitCode=0 Sep 09 20:53:49.353873 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.353772 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xffcq" event={"ID":"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7","Type":"ContainerDied","Data":"229c93a17d688a558022b044b16bcee8c7fc9a636ac26d784999121d5ab79961"} Sep 09 20:53:49.404668 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.404625 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.477466318 podStartE2EDuration="6.404602709s" totalImagesPullingTime="3.912002147s" totalInitContainerRuntime="15.134244ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:49.402460519 +0000 UTC m=+91.171520038" watchObservedRunningTime="2026-09-09 20:53:49.404602709 +0000 UTC m=+91.173662230" Sep 09 20:53:49.465599 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:49.465575 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:53:49.467457 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:53:49.467432 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975fcd98_9db5_4fa4_9e13_070cbe2a5d83.slice/crio-4350a6ae512bf722b4d8e4aba4f063d00a5b5888ea3fdaacad04182ce7f71d16 WatchSource:0}: Error finding container 4350a6ae512bf722b4d8e4aba4f063d00a5b5888ea3fdaacad04182ce7f71d16: Status 404 returned error can't find the container with id 4350a6ae512bf722b4d8e4aba4f063d00a5b5888ea3fdaacad04182ce7f71d16 Sep 09 20:53:50.359745 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:50.359712 2560 generic.go:356] "Generic (PLEG): container finished" podID="975fcd98-9db5-4fa4-9e13-070cbe2a5d83" containerID="632c9904a3d0fd5805ce85d7649d0a6c250cf96bdeed4f391894caa2635c7829" exitCode=0 Sep 09 20:53:50.360237 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:50.359799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"975fcd98-9db5-4fa4-9e13-070cbe2a5d83","Type":"ContainerDied","Data":"632c9904a3d0fd5805ce85d7649d0a6c250cf96bdeed4f391894caa2635c7829"} Sep 09 20:53:50.360237 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:50.359888 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"975fcd98-9db5-4fa4-9e13-070cbe2a5d83","Type":"ContainerStarted","Data":"4350a6ae512bf722b4d8e4aba4f063d00a5b5888ea3fdaacad04182ce7f71d16"} Sep 09 20:53:50.362542 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:50.362517 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xffcq" event={"ID":"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7","Type":"ContainerStarted","Data":"57f9a7070d443137f38a9941a260a6394e91cf89815e78d6d8b5ca778d17a631"} Sep 09 20:53:50.362629 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:50.362568 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xffcq" event={"ID":"348c3975-ca17-4b4c-8cb2-3cb4d4e969c7","Type":"ContainerStarted","Data":"441cefa9c54d779f6ee866b7e4124f5a4466d69333b8ffe3331b7a3c881832cc"} Sep 09 20:53:50.376414 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:50.376390 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:50.458211 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:50.458169 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xffcq" podStartSLOduration=2.325308981 podStartE2EDuration="8.458154877s" totalImagesPullingTime="6.058442243s" totalInitContainerRuntime="74.403653ms" isStatefulPod=true podCreationTimestamp="2026-09-09 20:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:50.457317184 +0000 UTC m=+92.226376717" watchObservedRunningTime="2026-09-09 20:53:50.458154877 +0000 UTC m=+92.227214397" Sep 09 20:53:50.483888 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:50.483862 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:51.337000 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:51.336959 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:54.036914 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.036880 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:54.169192 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.169137 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:54.247189 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.247155 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-646f44d6f8-ch8v5"] Sep 09 20:53:54.266423 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.266384 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:54.375329 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.375291 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:54.385835 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.385783 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"975fcd98-9db5-4fa4-9e13-070cbe2a5d83","Type":"ContainerStarted","Data":"fe1ad8bb81b6be930179b4ffac6b8f4785f085734e8075d076bc65c1e3760e63"} Sep 09 20:53:54.385968 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.385886 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"975fcd98-9db5-4fa4-9e13-070cbe2a5d83","Type":"ContainerStarted","Data":"e4aef1989880fb1208276db3841a1daccf828aa6d9c3dc4806be703dfa5ec90c"} Sep 09 20:53:54.490672 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.490637 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:54.637477 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.637400 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:54.876549 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.876512 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:54.976088 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:54.975994 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:55.394080 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:55.394051 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"975fcd98-9db5-4fa4-9e13-070cbe2a5d83","Type":"ContainerStarted","Data":"40379c440ba919d442e158df34d75159aaa7f9977d0b961a2b6bc13b5764f105"} Sep 09 20:53:55.394355 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:55.394140 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"975fcd98-9db5-4fa4-9e13-070cbe2a5d83","Type":"ContainerStarted","Data":"c7ee6b35a8be9dde88412e9864ce3be77c15274b5b13b84e8fc503181f3bb5c1"} Sep 09 20:53:55.394355 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:55.394166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"975fcd98-9db5-4fa4-9e13-070cbe2a5d83","Type":"ContainerStarted","Data":"db230d9883e217809b04467bd865a5db940f72b183807fe02cc7caa8e526f764"} Sep 09 20:53:56.200253 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:56.200224 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q5sw5" Sep 09 20:53:56.402207 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:56.402176 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"975fcd98-9db5-4fa4-9e13-070cbe2a5d83","Type":"ContainerStarted","Data":"f5b5535b50e686ed70ba8e3a79acf0f158b70978af3e6055ed5fdcb22b05749e"} Sep 09 20:53:56.451120 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:56.451004 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.780180826 podStartE2EDuration="8.450983321s" totalImagesPullingTime="4.653162919s" totalInitContainerRuntime="17.639576ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:56.44619637 +0000 UTC m=+98.215255893" watchObservedRunningTime="2026-09-09 20:53:56.450983321 +0000 UTC m=+98.220042843" Sep 09 20:53:59.138710 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:59.138681 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:53:59.645136 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:59.645100 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:53:59.751253 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:53:59.751225 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:01.284940 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:01.284910 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:01.488531 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:01.488498 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:01.596382 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:01.596354 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:04.422178 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:04.422106 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:04.516344 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:04.516308 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:05.696443 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:05.696407 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:05.799933 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:05.799905 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:11.465645 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:11.465609 2560 generic.go:356] "Generic (PLEG): container finished" podID="cd33146c-f1d4-45a5-89c0-4b0597287e62" containerID="1930199ffcc4df8a0fff35230b97ec98a067a0e706468c130bb555e6ab1415f7" exitCode=0 Sep 09 20:54:11.466129 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:11.465685 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" event={"ID":"cd33146c-f1d4-45a5-89c0-4b0597287e62","Type":"ContainerDied","Data":"1930199ffcc4df8a0fff35230b97ec98a067a0e706468c130bb555e6ab1415f7"} Sep 09 20:54:11.466201 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:11.466127 2560 scope.go:117] "RemoveContainer" containerID="1930199ffcc4df8a0fff35230b97ec98a067a0e706468c130bb555e6ab1415f7" Sep 09 20:54:11.467291 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:11.467270 2560 generic.go:356] "Generic (PLEG): container finished" podID="fd2f5dff-7485-4ea6-8540-868484df235d" containerID="dd9ded16102895571b37ae4297517019e2aa384cbaff69281c1a5f41588de3e5" exitCode=0 Sep 09 20:54:11.467369 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:11.467326 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" event={"ID":"fd2f5dff-7485-4ea6-8540-868484df235d","Type":"ContainerDied","Data":"dd9ded16102895571b37ae4297517019e2aa384cbaff69281c1a5f41588de3e5"} Sep 09 20:54:11.467572 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:11.467556 2560 scope.go:117] "RemoveContainer" containerID="dd9ded16102895571b37ae4297517019e2aa384cbaff69281c1a5f41588de3e5" Sep 09 20:54:12.473893 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:12.473844 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4qfx9" event={"ID":"cd33146c-f1d4-45a5-89c0-4b0597287e62","Type":"ContainerStarted","Data":"836038a8d2e046860cac76c4f5bd5505ab4f7b338a86c5d1fccbfda8c5cfef77"} Sep 09 20:54:12.475644 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:12.475619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-526sm" event={"ID":"fd2f5dff-7485-4ea6-8540-868484df235d","Type":"ContainerStarted","Data":"8b377a59786674832d2b62701354c4f12aed6163b3332cf8e254865a31be4ba0"} Sep 09 20:54:19.271865 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.271827 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" podUID="c0a199fa-3b0c-49fa-afb7-6199d7088c05" containerName="registry" containerID="cri-o://8e0c9bdaccf025d0f8f21e01351fda45c198ac36562dc96b62d017f51a980ba8" gracePeriod=30 Sep 09 20:54:19.512258 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.512224 2560 generic.go:356] "Generic (PLEG): container finished" podID="c0a199fa-3b0c-49fa-afb7-6199d7088c05" containerID="8e0c9bdaccf025d0f8f21e01351fda45c198ac36562dc96b62d017f51a980ba8" exitCode=0 Sep 09 20:54:19.512373 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.512266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" event={"ID":"c0a199fa-3b0c-49fa-afb7-6199d7088c05","Type":"ContainerDied","Data":"8e0c9bdaccf025d0f8f21e01351fda45c198ac36562dc96b62d017f51a980ba8"} Sep 09 20:54:19.512373 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.512320 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" event={"ID":"c0a199fa-3b0c-49fa-afb7-6199d7088c05","Type":"ContainerDied","Data":"334d09277fe269eb46673590ea89715d83dd460d89b5fbed35a05fc9fbe3da40"} Sep 09 20:54:19.512373 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.512335 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="334d09277fe269eb46673590ea89715d83dd460d89b5fbed35a05fc9fbe3da40" Sep 09 20:54:19.514388 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.514369 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:54:19.623937 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.623909 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-installation-pull-secrets\") pod \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " Sep 09 20:54:19.624089 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.623963 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") pod \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " Sep 09 20:54:19.624089 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.624010 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-bound-sa-token\") pod \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " Sep 09 20:54:19.624089 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.624052 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0a199fa-3b0c-49fa-afb7-6199d7088c05-ca-trust-extracted\") pod \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " Sep 09 20:54:19.624089 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.624078 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-certificates\") pod \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " Sep 09 20:54:19.624302 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.624120 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-image-registry-private-configuration\") pod \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " Sep 09 20:54:19.624302 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.624157 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-trusted-ca\") pod \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " Sep 09 20:54:19.624302 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.624226 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whdmz\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-kube-api-access-whdmz\") pod \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\" (UID: \"c0a199fa-3b0c-49fa-afb7-6199d7088c05\") " Sep 09 20:54:19.624704 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.624562 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c0a199fa-3b0c-49fa-afb7-6199d7088c05" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:54:19.624819 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.624785 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c0a199fa-3b0c-49fa-afb7-6199d7088c05" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:54:19.626503 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.626480 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c0a199fa-3b0c-49fa-afb7-6199d7088c05" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:54:19.626666 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.626642 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c0a199fa-3b0c-49fa-afb7-6199d7088c05" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:54:19.626717 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.626688 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c0a199fa-3b0c-49fa-afb7-6199d7088c05" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:54:19.626920 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.626899 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-kube-api-access-whdmz" (OuterVolumeSpecName: "kube-api-access-whdmz") pod "c0a199fa-3b0c-49fa-afb7-6199d7088c05" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05"). InnerVolumeSpecName "kube-api-access-whdmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:54:19.626963 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.626917 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c0a199fa-3b0c-49fa-afb7-6199d7088c05" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:54:19.634912 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.634886 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0a199fa-3b0c-49fa-afb7-6199d7088c05-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c0a199fa-3b0c-49fa-afb7-6199d7088c05" (UID: "c0a199fa-3b0c-49fa-afb7-6199d7088c05"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:54:19.725830 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.725793 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whdmz\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-kube-api-access-whdmz\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 20:54:19.725830 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.725828 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-installation-pull-secrets\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 20:54:19.725830 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.725838 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 20:54:19.726005 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.725847 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0a199fa-3b0c-49fa-afb7-6199d7088c05-bound-sa-token\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 20:54:19.726005 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.725855 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0a199fa-3b0c-49fa-afb7-6199d7088c05-ca-trust-extracted\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 20:54:19.726005 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.725864 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-registry-certificates\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 20:54:19.726005 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.725874 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0a199fa-3b0c-49fa-afb7-6199d7088c05-image-registry-private-configuration\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 20:54:19.726005 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:19.725883 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0a199fa-3b0c-49fa-afb7-6199d7088c05-trusted-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 20:54:20.516460 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:20.516429 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646f44d6f8-ch8v5" Sep 09 20:54:20.541522 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:20.541496 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-646f44d6f8-ch8v5"] Sep 09 20:54:20.544615 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:20.544566 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-646f44d6f8-ch8v5"] Sep 09 20:54:20.681403 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:20.681377 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:20.695082 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:20.695061 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0a199fa-3b0c-49fa-afb7-6199d7088c05" path="/var/lib/kubelet/pods/c0a199fa-3b0c-49fa-afb7-6199d7088c05/volumes" Sep 09 20:54:20.753765 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:20.753733 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:36.584012 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:36.583976 2560 generic.go:356] "Generic (PLEG): container finished" podID="cc154768-9c43-4758-9b19-6e7fa687d32a" containerID="89003753b2f436498a8149b51f1bf2239ff9f9daeadcc72679d9e7371cca85cf" exitCode=0 Sep 09 20:54:36.584514 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:36.584057 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" event={"ID":"cc154768-9c43-4758-9b19-6e7fa687d32a","Type":"ContainerDied","Data":"89003753b2f436498a8149b51f1bf2239ff9f9daeadcc72679d9e7371cca85cf"} Sep 09 20:54:36.584514 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:36.584427 2560 scope.go:117] "RemoveContainer" containerID="89003753b2f436498a8149b51f1bf2239ff9f9daeadcc72679d9e7371cca85cf" Sep 09 20:54:37.589662 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:37.589629 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-npfsq" event={"ID":"cc154768-9c43-4758-9b19-6e7fa687d32a","Type":"ContainerStarted","Data":"1f2de99728f4b57887d4ec43de8cff41244a6a1495533b3a79800cc9da7515ab"} Sep 09 20:54:49.138718 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:49.138684 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:54:49.154693 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:49.154668 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:54:49.655114 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:54:49.655084 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:55:01.752510 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:01.752474 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:02.038176 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:02.038098 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:07.010623 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.010583 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c7744596f-lrlrd"] Sep 09 20:55:07.011123 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.010996 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a199fa-3b0c-49fa-afb7-6199d7088c05" containerName="registry" Sep 09 20:55:07.011123 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.011015 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a199fa-3b0c-49fa-afb7-6199d7088c05" containerName="registry" Sep 09 20:55:07.011242 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.011142 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0a199fa-3b0c-49fa-afb7-6199d7088c05" containerName="registry" Sep 09 20:55:07.014793 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.014770 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.025989 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.025967 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 09 20:55:07.026809 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.026784 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 09 20:55:07.027131 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.027106 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 09 20:55:07.027233 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.027127 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 09 20:55:07.027233 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.027106 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 09 20:55:07.032312 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.032277 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z5546\"" Sep 09 20:55:07.035042 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.035012 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 09 20:55:07.054933 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.054887 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7744596f-lrlrd"] Sep 09 20:55:07.102412 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.102377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-federate-client-tls\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.102554 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.102418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3decd-e3f3-49f5-b072-97621800fa8f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.102554 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.102456 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.102554 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.102491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab3decd-e3f3-49f5-b072-97621800fa8f-metrics-client-ca\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.102554 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.102529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-secret-telemeter-client\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.102742 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.102554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-telemeter-client-tls\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.102742 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.102593 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5twd\" (UniqueName: \"kubernetes.io/projected/dab3decd-e3f3-49f5-b072-97621800fa8f-kube-api-access-x5twd\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.102742 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.102641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3decd-e3f3-49f5-b072-97621800fa8f-serving-certs-ca-bundle\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.203153 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.203119 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3decd-e3f3-49f5-b072-97621800fa8f-serving-certs-ca-bundle\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.203326 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.203172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-federate-client-tls\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.203326 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.203193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3decd-e3f3-49f5-b072-97621800fa8f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.203326 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.203221 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.203326 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.203247 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab3decd-e3f3-49f5-b072-97621800fa8f-metrics-client-ca\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.203326 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.203274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-secret-telemeter-client\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.203326 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.203304 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-telemeter-client-tls\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.203627 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.203347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5twd\" (UniqueName: \"kubernetes.io/projected/dab3decd-e3f3-49f5-b072-97621800fa8f-kube-api-access-x5twd\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.203956 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.203930 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3decd-e3f3-49f5-b072-97621800fa8f-serving-certs-ca-bundle\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.204147 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.204118 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3decd-e3f3-49f5-b072-97621800fa8f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.204266 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.204022 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab3decd-e3f3-49f5-b072-97621800fa8f-metrics-client-ca\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.205818 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.205790 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-secret-telemeter-client\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.205938 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.205918 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-federate-client-tls\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.206142 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.206123 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.206267 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.206249 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dab3decd-e3f3-49f5-b072-97621800fa8f-telemeter-client-tls\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.212475 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.212451 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5twd\" (UniqueName: \"kubernetes.io/projected/dab3decd-e3f3-49f5-b072-97621800fa8f-kube-api-access-x5twd\") pod \"telemeter-client-5c7744596f-lrlrd\" (UID: \"dab3decd-e3f3-49f5-b072-97621800fa8f\") " pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.323983 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.323903 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" Sep 09 20:55:07.609519 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.609484 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7744596f-lrlrd"] Sep 09 20:55:07.616803 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:55:07.616766 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab3decd_e3f3_49f5_b072_97621800fa8f.slice/crio-e952ba7c7d6e0c1d317ead01702129e58c884b9527fdcab347eab1ecd8c95474 WatchSource:0}: Error finding container e952ba7c7d6e0c1d317ead01702129e58c884b9527fdcab347eab1ecd8c95474: Status 404 returned error can't find the container with id e952ba7c7d6e0c1d317ead01702129e58c884b9527fdcab347eab1ecd8c95474 Sep 09 20:55:07.729193 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:07.729159 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" event={"ID":"dab3decd-e3f3-49f5-b072-97621800fa8f","Type":"ContainerStarted","Data":"e952ba7c7d6e0c1d317ead01702129e58c884b9527fdcab347eab1ecd8c95474"} Sep 09 20:55:09.739714 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:09.739682 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" event={"ID":"dab3decd-e3f3-49f5-b072-97621800fa8f","Type":"ContainerStarted","Data":"ca626b329ba0b80b2bb68176a7c349512907a32c31ce6ad3891b8245871e8e50"} Sep 09 20:55:09.740143 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:09.739756 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" event={"ID":"dab3decd-e3f3-49f5-b072-97621800fa8f","Type":"ContainerStarted","Data":"e74c1c0f7539151d3c90c41318a5d51c404e101b45d6d4cd1d7a19186122e999"} Sep 09 20:55:09.740143 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:09.739777 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" event={"ID":"dab3decd-e3f3-49f5-b072-97621800fa8f","Type":"ContainerStarted","Data":"d7dd0b69510c52f39cec9f24c48507b51d9883ad8db20a98b0557f353a2b7cba"} Sep 09 20:55:09.766477 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:09.766414 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c7744596f-lrlrd" podStartSLOduration=2.064417653 podStartE2EDuration="3.766396263s" totalImagesPullingTime="1.70197861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:55:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:55:09.765186323 +0000 UTC m=+171.534245856" watchObservedRunningTime="2026-09-09 20:55:09.766396263 +0000 UTC m=+171.535455783" Sep 09 20:55:09.959064 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:09.958862 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:10.040355 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:10.040273 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:17.347385 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:17.347298 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:17.441400 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:17.441364 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:19.877581 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:19.877507 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:29.237849 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:29.237815 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:29.311212 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:29.311182 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:31.784612 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:31.784584 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:31.884435 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:31.884380 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:31.946926 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:31.946896 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:35.677450 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:35.677411 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:35.775632 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:35.775594 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:45.955760 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:45.955725 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:52.026052 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:52.025974 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:55:59.894088 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:55:59.894049 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:07.720234 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:07.720198 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:17.930886 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:17.930849 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:18.033616 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:18.033585 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:18.131110 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:18.131075 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:50.384390 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:50.384315 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:50.480921 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:50.480891 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:56.454444 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:56.454406 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:56.798591 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:56.798513 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:57.165051 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:57.165000 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:57.309456 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:57.309422 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:57.531127 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:57.531027 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:57.629217 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:57.629188 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:57.730580 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:57.730545 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:57.832824 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:57.832794 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:57.968716 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:57.968684 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:58.232607 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:58.232532 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:58.434821 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:58.434788 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:58.543446 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:56:58.543358 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:57:18.612907 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:57:18.612881 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 20:57:18.616593 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:57:18.616569 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 20:57:18.633152 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:57:18.633128 2560 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 20:57:49.406711 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:57:49.406676 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:57:49.466903 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:57:49.466871 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:58:18.389406 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:58:18.389327 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:58:20.045094 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:58:20.045059 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:58:29.303992 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:58:29.303957 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:58:37.416016 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:58:37.415987 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:58:37.652889 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:58:37.652859 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:58:48.002423 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:58:48.002387 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:58:48.105929 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:58:48.105868 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:58:48.173847 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:58:48.173802 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:59:36.653585 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:36.653553 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:59:36.733377 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:36.733339 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:59:36.791080 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:36.791048 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:59:36.999713 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:36.999630 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:59:37.097750 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:37.097716 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:59:38.077635 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:38.077597 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:59:38.137598 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:38.137569 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 20:59:53.455999 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.455918 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-swxb2"] Sep 09 20:59:53.458321 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.458306 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-swxb2" Sep 09 20:59:53.462608 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.462582 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 09 20:59:53.463530 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.463504 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-xh647\"" Sep 09 20:59:53.463530 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.463520 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 09 20:59:53.463690 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.463558 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 09 20:59:53.463690 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.463520 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 09 20:59:53.473237 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.473214 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-swxb2"] Sep 09 20:59:53.542015 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.541992 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9lnp\" (UniqueName: \"kubernetes.io/projected/2501782e-8e9c-47a1-a6de-22d73c1e4d97-kube-api-access-l9lnp\") pod \"s3-init-swxb2\" (UID: \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\") " pod="kserve/s3-init-swxb2" Sep 09 20:59:53.542146 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.542123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2501782e-8e9c-47a1-a6de-22d73c1e4d97-model-cache\") pod \"s3-init-swxb2\" (UID: \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\") " pod="kserve/s3-init-swxb2" Sep 09 20:59:53.643550 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.643522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2501782e-8e9c-47a1-a6de-22d73c1e4d97-model-cache\") pod \"s3-init-swxb2\" (UID: \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\") " pod="kserve/s3-init-swxb2" Sep 09 20:59:53.643652 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.643594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lnp\" (UniqueName: \"kubernetes.io/projected/2501782e-8e9c-47a1-a6de-22d73c1e4d97-kube-api-access-l9lnp\") pod \"s3-init-swxb2\" (UID: \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\") " pod="kserve/s3-init-swxb2" Sep 09 20:59:53.643866 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.643849 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2501782e-8e9c-47a1-a6de-22d73c1e4d97-model-cache\") pod \"s3-init-swxb2\" (UID: \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\") " pod="kserve/s3-init-swxb2" Sep 09 20:59:53.653060 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.653028 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9lnp\" (UniqueName: \"kubernetes.io/projected/2501782e-8e9c-47a1-a6de-22d73c1e4d97-kube-api-access-l9lnp\") pod \"s3-init-swxb2\" (UID: \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\") " pod="kserve/s3-init-swxb2" Sep 09 20:59:53.781666 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:53.781600 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-swxb2" Sep 09 20:59:54.052822 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:54.052792 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-swxb2"] Sep 09 20:59:54.055441 ip-10-0-140-67 kubenswrapper[2560]: W0909 20:59:54.055407 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2501782e_8e9c_47a1_a6de_22d73c1e4d97.slice/crio-e64c1380649265665c15c340e31f605c9c092b9334cb70df1cf0101cc69dc1ae WatchSource:0}: Error finding container e64c1380649265665c15c340e31f605c9c092b9334cb70df1cf0101cc69dc1ae: Status 404 returned error can't find the container with id e64c1380649265665c15c340e31f605c9c092b9334cb70df1cf0101cc69dc1ae Sep 09 20:59:54.057424 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:54.057403 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:59:54.979740 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:54.979694 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-swxb2" event={"ID":"2501782e-8e9c-47a1-a6de-22d73c1e4d97","Type":"ContainerStarted","Data":"e64c1380649265665c15c340e31f605c9c092b9334cb70df1cf0101cc69dc1ae"} Sep 09 20:59:57.996218 ip-10-0-140-67 kubenswrapper[2560]: I0909 20:59:57.996175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-swxb2" event={"ID":"2501782e-8e9c-47a1-a6de-22d73c1e4d97","Type":"ContainerStarted","Data":"7fefbf2fd5d2034e43abf58b3267edfa6d6501a5292cfe08946ee416709c3887"} Sep 09 21:00:00.012232 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:00:00.012195 2560 generic.go:356] "Generic (PLEG): container finished" podID="2501782e-8e9c-47a1-a6de-22d73c1e4d97" containerID="7fefbf2fd5d2034e43abf58b3267edfa6d6501a5292cfe08946ee416709c3887" exitCode=0 Sep 09 21:00:00.012608 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:00:00.012267 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-swxb2" event={"ID":"2501782e-8e9c-47a1-a6de-22d73c1e4d97","Type":"ContainerDied","Data":"7fefbf2fd5d2034e43abf58b3267edfa6d6501a5292cfe08946ee416709c3887"} Sep 09 21:00:05.040694 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:00:05.040664 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-swxb2" event={"ID":"2501782e-8e9c-47a1-a6de-22d73c1e4d97","Type":"ContainerStarted","Data":"39cc556e51038058e6e50dcb327f26005e95e3b95ac363e8819ad54b4345a27b"} Sep 09 21:00:05.059934 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:00:05.059886 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-swxb2" podStartSLOduration=2.688527135 podStartE2EDuration="12.05987003s" totalImagesPullingTime="7.6510141s" totalInitContainerRuntime="1.720328795s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:59:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:05.058558652 +0000 UTC m=+466.827618173" watchObservedRunningTime="2026-09-09 21:00:05.05987003 +0000 UTC m=+466.828929551" Sep 09 21:00:18.651791 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:00:18.651761 2560 scope.go:117] "RemoveContainer" containerID="8e0c9bdaccf025d0f8f21e01351fda45c198ac36562dc96b62d017f51a980ba8" Sep 09 21:00:47.248877 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:00:47.248846 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:09.329020 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:09.328988 2560 generic.go:356] "Generic (PLEG): container finished" podID="2501782e-8e9c-47a1-a6de-22d73c1e4d97" containerID="39cc556e51038058e6e50dcb327f26005e95e3b95ac363e8819ad54b4345a27b" exitCode=0 Sep 09 21:01:09.329421 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:09.329066 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-swxb2" event={"ID":"2501782e-8e9c-47a1-a6de-22d73c1e4d97","Type":"ContainerDied","Data":"39cc556e51038058e6e50dcb327f26005e95e3b95ac363e8819ad54b4345a27b"} Sep 09 21:01:10.453245 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:10.453223 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-swxb2" Sep 09 21:01:10.593450 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:10.593364 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9lnp\" (UniqueName: \"kubernetes.io/projected/2501782e-8e9c-47a1-a6de-22d73c1e4d97-kube-api-access-l9lnp\") pod \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\" (UID: \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\") " Sep 09 21:01:10.593450 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:10.593415 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2501782e-8e9c-47a1-a6de-22d73c1e4d97-model-cache\") pod \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\" (UID: \"2501782e-8e9c-47a1-a6de-22d73c1e4d97\") " Sep 09 21:01:10.595561 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:10.595527 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2501782e-8e9c-47a1-a6de-22d73c1e4d97-kube-api-access-l9lnp" (OuterVolumeSpecName: "kube-api-access-l9lnp") pod "2501782e-8e9c-47a1-a6de-22d73c1e4d97" (UID: "2501782e-8e9c-47a1-a6de-22d73c1e4d97"). InnerVolumeSpecName "kube-api-access-l9lnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 21:01:10.611853 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:10.611829 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2501782e-8e9c-47a1-a6de-22d73c1e4d97-model-cache" (OuterVolumeSpecName: "model-cache") pod "2501782e-8e9c-47a1-a6de-22d73c1e4d97" (UID: "2501782e-8e9c-47a1-a6de-22d73c1e4d97"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 21:01:10.693876 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:10.693848 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9lnp\" (UniqueName: \"kubernetes.io/projected/2501782e-8e9c-47a1-a6de-22d73c1e4d97-kube-api-access-l9lnp\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 21:01:10.693876 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:10.693870 2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2501782e-8e9c-47a1-a6de-22d73c1e4d97-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 21:01:11.339050 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:11.339011 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-swxb2" Sep 09 21:01:11.339208 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:11.339003 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-swxb2" event={"ID":"2501782e-8e9c-47a1-a6de-22d73c1e4d97","Type":"ContainerDied","Data":"e64c1380649265665c15c340e31f605c9c092b9334cb70df1cf0101cc69dc1ae"} Sep 09 21:01:11.339208 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:11.339142 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e64c1380649265665c15c340e31f605c9c092b9334cb70df1cf0101cc69dc1ae" Sep 09 21:01:11.721428 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:11.721337 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:12.133303 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:12.133265 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:23.893068 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:23.892996 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:24.290410 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.290340 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:24.376557 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.376485 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:24.491132 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.491101 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9"] Sep 09 21:01:24.491454 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.491442 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2501782e-8e9c-47a1-a6de-22d73c1e4d97" containerName="download-hf-model" Sep 09 21:01:24.491499 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.491456 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2501782e-8e9c-47a1-a6de-22d73c1e4d97" containerName="download-hf-model" Sep 09 21:01:24.491499 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.491464 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2501782e-8e9c-47a1-a6de-22d73c1e4d97" containerName="s3-init" Sep 09 21:01:24.491499 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.491469 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2501782e-8e9c-47a1-a6de-22d73c1e4d97" containerName="s3-init" Sep 09 21:01:24.491588 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.491522 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2501782e-8e9c-47a1-a6de-22d73c1e4d97" containerName="s3-init" Sep 09 21:01:24.494545 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.494529 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.496995 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.496973 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 09 21:01:24.497142 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.496998 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Sep 09 21:01:24.497960 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.497940 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 09 21:01:24.497960 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.497952 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 09 21:01:24.498137 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.497953 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-c7qlq\"" Sep 09 21:01:24.498137 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.497983 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Sep 09 21:01:24.498137 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.497978 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 09 21:01:24.508969 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.508951 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9"] Sep 09 21:01:24.607321 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.607298 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.607441 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.607339 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.607441 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.607421 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.607516 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.607458 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvggv\" (UniqueName: \"kubernetes.io/projected/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-api-access-hvggv\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.607516 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.607480 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.708530 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.708502 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.708676 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.708563 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.708676 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.708602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvggv\" (UniqueName: \"kubernetes.io/projected/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-api-access-hvggv\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.708676 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.708630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.708803 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.708697 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.709055 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.709018 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.709294 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.709276 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.709338 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.709282 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.711071 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.711051 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.721395 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.721367 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvggv\" (UniqueName: \"kubernetes.io/projected/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-api-access-hvggv\") pod \"isvc-xgboost-graph-predictor-555fc69d56-sgtc9\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.804471 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.804446 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:24.987240 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:24.987167 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:25.077151 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:25.077115 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9"] Sep 09 21:01:25.079484 ip-10-0-140-67 kubenswrapper[2560]: W0909 21:01:25.079460 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbc1bf7_dd1b_42f0_bcfc_68e7a504fb71.slice/crio-d1a482a085acc4ef1968fc4bd50777aed8ab88acd6cce5d150a04db8b7f63da8 WatchSource:0}: Error finding container d1a482a085acc4ef1968fc4bd50777aed8ab88acd6cce5d150a04db8b7f63da8: Status 404 returned error can't find the container with id d1a482a085acc4ef1968fc4bd50777aed8ab88acd6cce5d150a04db8b7f63da8 Sep 09 21:01:25.079910 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:25.079887 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:25.149573 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:25.149551 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:25.400230 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:25.400192 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" event={"ID":"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71","Type":"ContainerStarted","Data":"58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f"} Sep 09 21:01:25.400396 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:25.400262 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" event={"ID":"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71","Type":"ContainerStarted","Data":"d1a482a085acc4ef1968fc4bd50777aed8ab88acd6cce5d150a04db8b7f63da8"} Sep 09 21:01:29.419439 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:29.419402 2560 generic.go:356] "Generic (PLEG): container finished" podID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerID="58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f" exitCode=0 Sep 09 21:01:29.419880 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:29.419476 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" event={"ID":"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71","Type":"ContainerDied","Data":"58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f"} Sep 09 21:01:49.524472 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:49.524437 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" event={"ID":"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71","Type":"ContainerStarted","Data":"c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670"} Sep 09 21:01:53.547649 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:53.547615 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" event={"ID":"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71","Type":"ContainerStarted","Data":"2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2"} Sep 09 21:01:53.548046 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:53.547732 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:53.570176 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:53.570131 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podStartSLOduration=2.781512472 podStartE2EDuration="29.57011669s" totalImagesPullingTime="23.195250884s" totalInitContainerRuntime="3.593353334s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:01:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:53.568908664 +0000 UTC m=+575.337968200" watchObservedRunningTime="2026-09-09 21:01:53.57011669 +0000 UTC m=+575.339176211" Sep 09 21:01:54.551914 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:54.551873 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:01:54.553188 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:54.553148 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Sep 09 21:01:55.556132 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:01:55.556089 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Sep 09 21:02:00.560417 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:00.560388 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:02:00.560923 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:00.560805 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Sep 09 21:02:10.561731 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:10.561689 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Sep 09 21:02:18.656394 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:18.656363 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:02:18.657363 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:18.657342 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:02:20.561414 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:20.561376 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Sep 09 21:02:30.561355 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:30.561314 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Sep 09 21:02:40.561118 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:40.561075 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Sep 09 21:02:43.891103 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:43.891066 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:02:44.470353 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:44.470321 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:02:50.561175 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:50.561147 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:02:54.298698 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:54.298658 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:02:54.506675 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:54.506646 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:02:54.631555 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:54.631519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:02:54.729378 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:54.729345 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:02:54.895449 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:54.895353 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:02:55.562259 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:55.562228 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:02:55.732932 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:02:55.732904 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:33.914102 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:33.914068 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:36.281240 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:36.281205 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:44.021604 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.021569 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:44.102025 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.101996 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9"] Sep 09 21:03:44.102350 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.102315 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" containerID="cri-o://c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670" gracePeriod=30 Sep 09 21:03:44.102350 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.102337 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kube-rbac-proxy" containerID="cri-o://2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2" gracePeriod=30 Sep 09 21:03:44.102530 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.102410 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:44.217551 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.217524 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:44.359385 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.359352 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:44.436927 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.436887 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:44.556789 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.556759 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:44.653553 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:44.653463 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:03:45.058810 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:45.058730 2560 generic.go:356] "Generic (PLEG): container finished" podID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerID="2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2" exitCode=2 Sep 09 21:03:45.058810 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:45.058801 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" event={"ID":"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71","Type":"ContainerDied","Data":"2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2"} Sep 09 21:03:45.556764 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:45.556722 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.27:8643/healthz\": dial tcp 10.132.0.27:8643: connect: connection refused" Sep 09 21:03:47.338538 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.338518 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:03:47.409773 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.409707 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-cabundle-cert\") pod \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " Sep 09 21:03:47.409773 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.409760 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvggv\" (UniqueName: \"kubernetes.io/projected/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-api-access-hvggv\") pod \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " Sep 09 21:03:47.409919 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.409816 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-rbac-proxy-sar-config\") pod \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " Sep 09 21:03:47.409919 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.409864 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-proxy-tls\") pod \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " Sep 09 21:03:47.409919 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.409893 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kserve-provision-location\") pod \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\" (UID: \"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71\") " Sep 09 21:03:47.410150 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.410120 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" (UID: "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:03:47.410256 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.410231 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" (UID: "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 21:03:47.410306 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.410275 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" (UID: "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 21:03:47.412093 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.412065 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" (UID: "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 21:03:47.412193 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.412174 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-api-access-hvggv" (OuterVolumeSpecName: "kube-api-access-hvggv") pod "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" (UID: "5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71"). InnerVolumeSpecName "kube-api-access-hvggv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 21:03:47.510866 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.510835 2560 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-cabundle-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 21:03:47.510866 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.510861 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvggv\" (UniqueName: \"kubernetes.io/projected/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-api-access-hvggv\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 21:03:47.510866 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.510872 2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 21:03:47.511100 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.510882 2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-proxy-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 21:03:47.511100 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:47.510891 2560 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71-kserve-provision-location\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 21:03:48.080095 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.080052 2560 generic.go:356] "Generic (PLEG): container finished" podID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerID="c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670" exitCode=0 Sep 09 21:03:48.080286 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.080109 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" event={"ID":"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71","Type":"ContainerDied","Data":"c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670"} Sep 09 21:03:48.080286 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.080126 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" Sep 09 21:03:48.080286 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.080197 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9" event={"ID":"5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71","Type":"ContainerDied","Data":"d1a482a085acc4ef1968fc4bd50777aed8ab88acd6cce5d150a04db8b7f63da8"} Sep 09 21:03:48.080286 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.080237 2560 scope.go:117] "RemoveContainer" containerID="2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2" Sep 09 21:03:48.089092 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.089075 2560 scope.go:117] "RemoveContainer" containerID="c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670" Sep 09 21:03:48.096256 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.096240 2560 scope.go:117] "RemoveContainer" containerID="58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f" Sep 09 21:03:48.103664 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.103649 2560 scope.go:117] "RemoveContainer" containerID="2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2" Sep 09 21:03:48.103720 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.103703 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9"] Sep 09 21:03:48.103911 ip-10-0-140-67 kubenswrapper[2560]: E0909 21:03:48.103895 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2\": container with ID starting with 2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2 not found: ID does not exist" containerID="2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2" Sep 09 21:03:48.103953 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.103918 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2"} err="failed to get container status \"2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2\": rpc error: code = NotFound desc = could not find container \"2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2\": container with ID starting with 2e93279e01bc0ff3ab5987ca9dbf185570875f86bc17e9f4d5d58aedd98891e2 not found: ID does not exist" Sep 09 21:03:48.103953 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.103933 2560 scope.go:117] "RemoveContainer" containerID="c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670" Sep 09 21:03:48.104193 ip-10-0-140-67 kubenswrapper[2560]: E0909 21:03:48.104179 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670\": container with ID starting with c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670 not found: ID does not exist" containerID="c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670" Sep 09 21:03:48.104240 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.104197 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670"} err="failed to get container status \"c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670\": rpc error: code = NotFound desc = could not find container \"c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670\": container with ID starting with c5032b3894a2b8a9a25c002ab318dbceff2c787e88384e42c0111aa6bd0c5670 not found: ID does not exist" Sep 09 21:03:48.104240 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.104209 2560 scope.go:117] "RemoveContainer" containerID="58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f" Sep 09 21:03:48.104387 ip-10-0-140-67 kubenswrapper[2560]: E0909 21:03:48.104373 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f\": container with ID starting with 58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f not found: ID does not exist" containerID="58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f" Sep 09 21:03:48.104427 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.104389 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f"} err="failed to get container status \"58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f\": rpc error: code = NotFound desc = could not find container \"58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f\": container with ID starting with 58d17a444bbd921921e90a375fe092562cd1b5a6a3bb5d67c917c5bfcf38628f not found: ID does not exist" Sep 09 21:03:48.108501 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.108479 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-sgtc9"] Sep 09 21:03:48.695737 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:03:48.695706 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" path="/var/lib/kubelet/pods/5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71/volumes" Sep 09 21:04:04.578593 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:04:04.578561 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:05.376101 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:04:05.376062 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:25.992307 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:04:25.992268 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:44.245843 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:04:44.245806 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:44.549065 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:04:44.548971 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:55.230018 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:04:55.229983 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:05:55.932098 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:05:55.932000 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:05:56.028235 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:05:56.028209 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:06:53.518385 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:06:53.518337 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:06:53.583514 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:06:53.583486 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:07:18.686971 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:07:18.686891 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:07:18.687750 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:07:18.687729 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:08:48.210748 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:08:48.210680 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:18.717302 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:18.717273 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:12:18.718014 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:18.717997 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:12:19.295569 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:19.295529 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:19.408891 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:19.408857 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:19.500954 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:19.500921 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:19.596528 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:19.596496 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:19.671218 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:19.671192 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:20.085470 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:20.085434 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:43.067649 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:43.067616 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:58.894544 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:58.894503 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:59.019128 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:59.019065 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:59.185283 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:59.185203 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:59.315253 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:59.315214 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:12:59.716058 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:12:59.716010 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:19.544975 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:19.544901 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:19.832182 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:19.832154 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:29.673701 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:29.673668 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:30.124611 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:30.124579 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:30.251162 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:30.251126 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:30.465211 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:30.465128 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:30.652132 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:30.652087 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:30.865575 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:30.865543 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:30.968665 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:30.968635 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:13:59.151456 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:13:59.151428 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:00.587522 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:00.587488 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:09.233844 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:09.233812 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:09.352393 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:09.352355 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:09.479645 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:09.479619 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:09.593475 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:09.593445 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:09.694697 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:09.694661 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:09.858634 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:09.858556 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:40.141426 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:40.141390 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:40.786008 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:40.785977 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:14:53.331072 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:14:53.331029 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:15:09.584293 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:15:09.584261 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:15:09.895728 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:15:09.895650 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:16:48.036240 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:16:48.036209 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:17:18.745807 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:17:18.745772 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:17:18.747867 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:17:18.747842 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:18:35.070534 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:18:35.070501 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:18:42.375207 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:18:42.375171 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:19:30.121327 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:19:30.121249 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:21:24.733481 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:21:24.733450 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:21:24.795923 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:21:24.795890 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:22:18.777263 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:22:18.777232 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:22:18.779339 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:22:18.779312 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:22:54.749352 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:22:54.749322 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:22:54.915280 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:22:54.915231 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:22:55.012691 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:22:55.012626 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:22:55.120658 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:22:55.120622 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:22:55.767661 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:22:55.767619 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:22:56.099152 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:22:56.099122 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:12.253759 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:12.253726 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:24.164299 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:24.164262 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:24.278875 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:24.278832 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:24.373219 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:24.373186 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:24.470655 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:24.470571 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:24.553749 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:24.553719 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:24.852876 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:24.852841 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:24.950231 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:24.950199 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:55.024133 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:55.024028 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:23:55.348386 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:23:55.348355 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:24:05.102941 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:24:05.102911 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:24:05.205177 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:24:05.205123 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:24:05.276197 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:24:05.276153 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:24:05.360220 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:24:05.360139 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:24:05.437536 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:24:05.437507 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:24:05.921146 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:24:05.921114 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:24:24.406852 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:24:24.406810 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:24:24.880090 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:24:24.880053 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:25:05.366917 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:25:05.366881 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:25:06.999228 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:25:06.999193 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:27:18.811686 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:27:18.811607 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:27:18.815251 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:27:18.815228 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:30:32.142150 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:30:32.142114 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:30:55.086272 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:30:55.086233 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:30:55.169606 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:30:55.169570 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:31:50.789568 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:31:50.789508 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:32:02.304751 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:32:02.304707 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:32:18.841910 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:32:18.841880 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:32:18.848573 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:32:18.848551 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:33:19.966771 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:33:19.966676 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:33:20.160563 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:33:20.160528 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:33:20.242136 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:33:20.242054 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:36:20.770322 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:36:20.770242 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:37:18.871650 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:37:18.871575 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:37:18.879064 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:37:18.879024 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:38:17.214522 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:38:17.214488 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:40:43.711981 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:43.711945 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:40:43.874876 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:43.874833 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:40:43.988251 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:43.988157 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:40:44.544613 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.544581 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7q6jn/must-gather-4v98b"] Sep 09 21:40:44.544912 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.544901 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kube-rbac-proxy" Sep 09 21:40:44.544956 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.544914 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kube-rbac-proxy" Sep 09 21:40:44.544956 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.544931 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="storage-initializer" Sep 09 21:40:44.544956 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.544937 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="storage-initializer" Sep 09 21:40:44.544956 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.544949 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" Sep 09 21:40:44.544956 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.544955 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" Sep 09 21:40:44.545135 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.545016 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kserve-container" Sep 09 21:40:44.545135 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.545023 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dbc1bf7-dd1b-42f0-bcfc-68e7a504fb71" containerName="kube-rbac-proxy" Sep 09 21:40:44.548262 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.548240 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:40:44.550614 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.550593 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7q6jn\"/\"kube-root-ca.crt\"" Sep 09 21:40:44.551599 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.551583 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7q6jn\"/\"default-dockercfg-tgm66\"" Sep 09 21:40:44.551694 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.551610 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7q6jn\"/\"openshift-service-ca.crt\"" Sep 09 21:40:44.559180 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.559161 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7q6jn/must-gather-4v98b"] Sep 09 21:40:44.627982 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.627954 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvwzc\" (UniqueName: \"kubernetes.io/projected/338baead-6a4d-4e7a-8aca-06e83dc400c2-kube-api-access-nvwzc\") pod \"must-gather-4v98b\" (UID: \"338baead-6a4d-4e7a-8aca-06e83dc400c2\") " pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:40:44.628117 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.627996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/338baead-6a4d-4e7a-8aca-06e83dc400c2-must-gather-output\") pod \"must-gather-4v98b\" (UID: \"338baead-6a4d-4e7a-8aca-06e83dc400c2\") " pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:40:44.729224 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.729190 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwzc\" (UniqueName: \"kubernetes.io/projected/338baead-6a4d-4e7a-8aca-06e83dc400c2-kube-api-access-nvwzc\") pod \"must-gather-4v98b\" (UID: \"338baead-6a4d-4e7a-8aca-06e83dc400c2\") " pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:40:44.729580 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.729235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/338baead-6a4d-4e7a-8aca-06e83dc400c2-must-gather-output\") pod \"must-gather-4v98b\" (UID: \"338baead-6a4d-4e7a-8aca-06e83dc400c2\") " pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:40:44.729580 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.729528 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/338baead-6a4d-4e7a-8aca-06e83dc400c2-must-gather-output\") pod \"must-gather-4v98b\" (UID: \"338baead-6a4d-4e7a-8aca-06e83dc400c2\") " pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:40:44.741071 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.741045 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvwzc\" (UniqueName: \"kubernetes.io/projected/338baead-6a4d-4e7a-8aca-06e83dc400c2-kube-api-access-nvwzc\") pod \"must-gather-4v98b\" (UID: \"338baead-6a4d-4e7a-8aca-06e83dc400c2\") " pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:40:44.865550 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:44.865515 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:40:45.036957 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:45.036922 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:40:45.114431 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:45.114400 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:40:45.138121 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:45.138049 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7q6jn/must-gather-4v98b"] Sep 09 21:40:45.141385 ip-10-0-140-67 kubenswrapper[2560]: W0909 21:40:45.141359 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod338baead_6a4d_4e7a_8aca_06e83dc400c2.slice/crio-47233cdcd040b743a8cf24e2e162926ae895a4fb2ec16f145dc5e03e90b04e93 WatchSource:0}: Error finding container 47233cdcd040b743a8cf24e2e162926ae895a4fb2ec16f145dc5e03e90b04e93: Status 404 returned error can't find the container with id 47233cdcd040b743a8cf24e2e162926ae895a4fb2ec16f145dc5e03e90b04e93 Sep 09 21:40:45.143329 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:45.143314 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 21:40:45.942184 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:45.942147 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7q6jn/must-gather-4v98b" event={"ID":"338baead-6a4d-4e7a-8aca-06e83dc400c2","Type":"ContainerStarted","Data":"47233cdcd040b743a8cf24e2e162926ae895a4fb2ec16f145dc5e03e90b04e93"} Sep 09 21:40:51.976194 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:51.976158 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7q6jn/must-gather-4v98b" event={"ID":"338baead-6a4d-4e7a-8aca-06e83dc400c2","Type":"ContainerStarted","Data":"899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f"} Sep 09 21:40:51.976656 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:51.976202 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7q6jn/must-gather-4v98b" event={"ID":"338baead-6a4d-4e7a-8aca-06e83dc400c2","Type":"ContainerStarted","Data":"e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f"} Sep 09 21:40:52.003952 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:40:52.003903 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7q6jn/must-gather-4v98b" podStartSLOduration=1.832555403 podStartE2EDuration="8.00388797s" totalImagesPullingTime="6.171332567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:40:52.000835233 +0000 UTC m=+2913.769894780" watchObservedRunningTime="2026-09-09 21:40:52.00388797 +0000 UTC m=+2913.772947491" Sep 09 21:41:15.089131 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:15.089088 2560 generic.go:356] "Generic (PLEG): container finished" podID="338baead-6a4d-4e7a-8aca-06e83dc400c2" containerID="e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f" exitCode=0 Sep 09 21:41:15.089577 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:15.089158 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7q6jn/must-gather-4v98b" event={"ID":"338baead-6a4d-4e7a-8aca-06e83dc400c2","Type":"ContainerDied","Data":"e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f"} Sep 09 21:41:15.089577 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:15.089520 2560 scope.go:117] "RemoveContainer" containerID="e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f" Sep 09 21:41:15.272811 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:15.272781 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7q6jn_must-gather-4v98b_338baead-6a4d-4e7a-8aca-06e83dc400c2/gather/0.log" Sep 09 21:41:15.833066 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:15.833013 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:41:16.019832 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:16.019790 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:41:16.120872 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:16.120788 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:41:19.091314 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:19.091285 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s86nr_fee1d122-4edc-4e62-bddc-e30d307e5fbd/global-pull-secret-syncer/0.log" Sep 09 21:41:19.170453 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:19.170431 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" Sep 09 21:41:19.342999 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:19.342928 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-67.ec2.internal_6fdb7123ceb0203ddf37a480d40e184b/haproxy/0.log" Sep 09 21:41:20.808849 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:20.808747 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-7q6jn/must-gather-4v98b"] Sep 09 21:41:20.813483 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:20.808916 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-7q6jn/must-gather-4v98b" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" containerName="copy" containerID="cri-o://899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f" gracePeriod=2 Sep 09 21:41:20.816080 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:20.816024 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-7q6jn/must-gather-4v98b"] Sep 09 21:41:21.034828 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.034806 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7q6jn_must-gather-4v98b_338baead-6a4d-4e7a-8aca-06e83dc400c2/copy/0.log" Sep 09 21:41:21.036395 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.036374 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:41:21.038970 ip-10-0-140-67 kubenswrapper[2560]: E0909 21:41:21.038948 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-4v98b\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7q6jn\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:41:21.115773 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.115755 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7q6jn_must-gather-4v98b_338baead-6a4d-4e7a-8aca-06e83dc400c2/copy/0.log" Sep 09 21:41:21.116140 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.116116 2560 generic.go:356] "Generic (PLEG): container finished" podID="338baead-6a4d-4e7a-8aca-06e83dc400c2" containerID="899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f" exitCode=143 Sep 09 21:41:21.116219 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.116173 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:41:21.116266 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.116216 2560 scope.go:117] "RemoveContainer" containerID="899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f" Sep 09 21:41:21.119640 ip-10-0-140-67 kubenswrapper[2560]: E0909 21:41:21.119617 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-4v98b\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7q6jn\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:41:21.123678 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.123663 2560 scope.go:117] "RemoveContainer" containerID="e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f" Sep 09 21:41:21.134769 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.134754 2560 scope.go:117] "RemoveContainer" containerID="899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f" Sep 09 21:41:21.134999 ip-10-0-140-67 kubenswrapper[2560]: E0909 21:41:21.134981 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f\": container with ID starting with 899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f not found: ID does not exist" containerID="899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f" Sep 09 21:41:21.135069 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.135007 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f"} err="failed to get container status \"899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f\": rpc error: code = NotFound desc = could not find container \"899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f\": container with ID starting with 899af948a8069b4aedcc1478c2ac946b791d1e5520ecbb9e677a3270ca94cb8f not found: ID does not exist" Sep 09 21:41:21.135069 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.135025 2560 scope.go:117] "RemoveContainer" containerID="e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f" Sep 09 21:41:21.135295 ip-10-0-140-67 kubenswrapper[2560]: E0909 21:41:21.135279 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f\": container with ID starting with e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f not found: ID does not exist" containerID="e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f" Sep 09 21:41:21.135343 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.135301 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f"} err="failed to get container status \"e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f\": rpc error: code = NotFound desc = could not find container \"e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f\": container with ID starting with e7d040e066bfba07cc664030b182e32a31f3aae069bd3700c29987801028e45f not found: ID does not exist" Sep 09 21:41:21.154434 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.154415 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvwzc\" (UniqueName: \"kubernetes.io/projected/338baead-6a4d-4e7a-8aca-06e83dc400c2-kube-api-access-nvwzc\") pod \"338baead-6a4d-4e7a-8aca-06e83dc400c2\" (UID: \"338baead-6a4d-4e7a-8aca-06e83dc400c2\") " Sep 09 21:41:21.154536 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.154447 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/338baead-6a4d-4e7a-8aca-06e83dc400c2-must-gather-output\") pod \"338baead-6a4d-4e7a-8aca-06e83dc400c2\" (UID: \"338baead-6a4d-4e7a-8aca-06e83dc400c2\") " Sep 09 21:41:21.155879 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.155858 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338baead-6a4d-4e7a-8aca-06e83dc400c2-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "338baead-6a4d-4e7a-8aca-06e83dc400c2" (UID: "338baead-6a4d-4e7a-8aca-06e83dc400c2"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 21:41:21.156421 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.156400 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/338baead-6a4d-4e7a-8aca-06e83dc400c2-kube-api-access-nvwzc" (OuterVolumeSpecName: "kube-api-access-nvwzc") pod "338baead-6a4d-4e7a-8aca-06e83dc400c2" (UID: "338baead-6a4d-4e7a-8aca-06e83dc400c2"). InnerVolumeSpecName "kube-api-access-nvwzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 21:41:21.254967 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.254944 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvwzc\" (UniqueName: \"kubernetes.io/projected/338baead-6a4d-4e7a-8aca-06e83dc400c2-kube-api-access-nvwzc\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 21:41:21.254967 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:21.254966 2560 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/338baead-6a4d-4e7a-8aca-06e83dc400c2-must-gather-output\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\"" Sep 09 21:41:21.427173 ip-10-0-140-67 kubenswrapper[2560]: E0909 21:41:21.427143 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-4v98b\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7q6jn\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" pod="openshift-must-gather-7q6jn/must-gather-4v98b" Sep 09 21:41:22.042419 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:22.042386 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:41:22.154314 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:22.154285 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x22v_c9eed9dc-a6b3-4488-8fc0-6b44cc3abb41/konnectivity-agent/0.log" limit=1024 Sep 09 21:41:22.695744 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:22.695698 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" path="/var/lib/kubelet/pods/338baead-6a4d-4e7a-8aca-06e83dc400c2/volumes" Sep 09 21:41:22.925149 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:22.925117 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef93ac1a-4231-4216-971b-b635f57da6d7/alertmanager/0.log" Sep 09 21:41:22.956417 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:22.956347 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef93ac1a-4231-4216-971b-b635f57da6d7/config-reloader/0.log" Sep 09 21:41:23.007456 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.007429 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef93ac1a-4231-4216-971b-b635f57da6d7/kube-rbac-proxy-web/0.log" Sep 09 21:41:23.070660 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.070627 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef93ac1a-4231-4216-971b-b635f57da6d7/kube-rbac-proxy/0.log" Sep 09 21:41:23.108498 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.108459 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef93ac1a-4231-4216-971b-b635f57da6d7/kube-rbac-proxy-metric/0.log" Sep 09 21:41:23.154168 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.154144 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef93ac1a-4231-4216-971b-b635f57da6d7/prom-label-proxy/0.log" Sep 09 21:41:23.181868 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.181844 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef93ac1a-4231-4216-971b-b635f57da6d7/init-config-reloader/0.log" Sep 09 21:41:23.240478 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.240418 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-4dtsj_8d3026c7-2a91-4e77-96df-dea0abb4cb26/cluster-monitoring-operator/0.log" Sep 09 21:41:23.849089 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.849064 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xffcq_348c3975-ca17-4b4c-8cb2-3cb4d4e969c7/node-exporter/0.log" Sep 09 21:41:23.880833 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.880808 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xffcq_348c3975-ca17-4b4c-8cb2-3cb4d4e969c7/kube-rbac-proxy/0.log" Sep 09 21:41:23.917767 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.917708 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xffcq_348c3975-ca17-4b4c-8cb2-3cb4d4e969c7/init-textfile/0.log" Sep 09 21:41:23.969402 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:23.969382 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vnf4c_1f7044bb-297e-4f0b-b69a-482b8bedb660/kube-rbac-proxy-main/0.log" Sep 09 21:41:24.006959 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.006938 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vnf4c_1f7044bb-297e-4f0b-b69a-482b8bedb660/kube-rbac-proxy-self/0.log" Sep 09 21:41:24.033921 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.033890 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vnf4c_1f7044bb-297e-4f0b-b69a-482b8bedb660/openshift-state-metrics/0.log" Sep 09 21:41:24.090410 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.090386 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_975fcd98-9db5-4fa4-9e13-070cbe2a5d83/prometheus/0.log" Sep 09 21:41:24.113523 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.113498 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_975fcd98-9db5-4fa4-9e13-070cbe2a5d83/config-reloader/0.log" Sep 09 21:41:24.145637 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.145615 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_975fcd98-9db5-4fa4-9e13-070cbe2a5d83/thanos-sidecar/0.log" Sep 09 21:41:24.174740 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.174681 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_975fcd98-9db5-4fa4-9e13-070cbe2a5d83/kube-rbac-proxy-web/0.log" Sep 09 21:41:24.207898 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.207868 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_975fcd98-9db5-4fa4-9e13-070cbe2a5d83/kube-rbac-proxy/0.log" Sep 09 21:41:24.239214 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.239193 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_975fcd98-9db5-4fa4-9e13-070cbe2a5d83/kube-rbac-proxy-thanos/0.log" Sep 09 21:41:24.270301 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.270283 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_975fcd98-9db5-4fa4-9e13-070cbe2a5d83/init-config-reloader/0.log" Sep 09 21:41:24.311054 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.311016 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-kmrnf_e301926b-0dc5-4c8e-8948-c7b685adb882/prometheus-operator/0.log" Sep 09 21:41:24.347996 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.347975 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-kmrnf_e301926b-0dc5-4c8e-8948-c7b685adb882/kube-rbac-proxy/0.log" Sep 09 21:41:24.383779 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.383749 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-xfd94_cb13cd8d-7f51-4c32-bc3c-c43ce6a98c24/prometheus-operator-admission-webhook/0.log" Sep 09 21:41:24.445474 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.445416 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7744596f-lrlrd_dab3decd-e3f3-49f5-b072-97621800fa8f/telemeter-client/0.log" Sep 09 21:41:24.494294 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.494268 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7744596f-lrlrd_dab3decd-e3f3-49f5-b072-97621800fa8f/reload/0.log" Sep 09 21:41:24.528934 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:24.528912 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7744596f-lrlrd_dab3decd-e3f3-49f5-b072-97621800fa8f/kube-rbac-proxy/0.log" Sep 09 21:41:26.071375 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.071294 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-t7bt8_032126d0-a62e-4778-8666-80af8a2fe5b6/networking-console-plugin/0.log" Sep 09 21:41:26.580360 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.580335 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/1.log" Sep 09 21:41:26.589342 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.589316 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk57q_2051c290-d2f4-4169-9b3c-782a71b9dc65/console-operator/2.log" Sep 09 21:41:26.946561 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.946525 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff"] Sep 09 21:41:26.946865 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.946853 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" containerName="copy" Sep 09 21:41:26.946920 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.946867 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" containerName="copy" Sep 09 21:41:26.946920 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.946874 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" containerName="gather" Sep 09 21:41:26.946920 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.946880 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" containerName="gather" Sep 09 21:41:26.947014 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.946945 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" containerName="copy" Sep 09 21:41:26.947014 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.946957 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="338baead-6a4d-4e7a-8aca-06e83dc400c2" containerName="gather" Sep 09 21:41:26.951229 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.951208 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:26.955465 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.955445 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kmz7m\"/\"default-dockercfg-ss6ds\"" Sep 09 21:41:26.956410 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.956392 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kmz7m\"/\"openshift-service-ca.crt\"" Sep 09 21:41:26.956502 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.956445 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kmz7m\"/\"kube-root-ca.crt\"" Sep 09 21:41:26.968184 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:26.968152 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff"] Sep 09 21:41:27.001206 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.001183 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-podres\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.001307 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.001216 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-sys\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.001373 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.001309 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-lib-modules\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.001373 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.001363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-proc\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.001470 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.001388 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f42xg\" (UniqueName: \"kubernetes.io/projected/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-kube-api-access-f42xg\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.102458 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.102424 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-proc\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.102458 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.102463 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f42xg\" (UniqueName: \"kubernetes.io/projected/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-kube-api-access-f42xg\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.102934 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.102517 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-podres\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.102934 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.102549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-sys\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.102934 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.102553 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-proc\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.102934 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.102613 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-sys\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.102934 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.102641 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-lib-modules\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.102934 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.102750 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-podres\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.102934 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.102762 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-lib-modules\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.111361 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.111332 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f42xg\" (UniqueName: \"kubernetes.io/projected/94efccec-fbc8-4c4c-ab7e-56b62c7233d4-kube-api-access-f42xg\") pod \"perf-node-gather-daemonset-fvlff\" (UID: \"94efccec-fbc8-4c4c-ab7e-56b62c7233d4\") " pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.261152 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.261064 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:27.530892 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.530855 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff"] Sep 09 21:41:27.533087 ip-10-0-140-67 kubenswrapper[2560]: W0909 21:41:27.533058 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod94efccec_fbc8_4c4c_ab7e_56b62c7233d4.slice/crio-c5bb9b5bfaa654878ad1dee6bfe10d7597ca414ef6516aa40672bf8c212e95cb WatchSource:0}: Error finding container c5bb9b5bfaa654878ad1dee6bfe10d7597ca414ef6516aa40672bf8c212e95cb: Status 404 returned error can't find the container with id c5bb9b5bfaa654878ad1dee6bfe10d7597ca414ef6516aa40672bf8c212e95cb Sep 09 21:41:27.677502 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:27.677477 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-swfcp_8428ad43-5eef-4a01-9785-b45f130034f6/volume-data-source-validator/0.log" Sep 09 21:41:28.149468 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:28.149427 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" event={"ID":"94efccec-fbc8-4c4c-ab7e-56b62c7233d4","Type":"ContainerStarted","Data":"541fd986f88dfee79ea77ca1e19b0a7b9d09956a693dd5a23a68b36a6cd0e402"} Sep 09 21:41:28.149904 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:28.149509 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" event={"ID":"94efccec-fbc8-4c4c-ab7e-56b62c7233d4","Type":"ContainerStarted","Data":"c5bb9b5bfaa654878ad1dee6bfe10d7597ca414ef6516aa40672bf8c212e95cb"} Sep 09 21:41:28.149904 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:28.149573 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:28.169253 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:28.169202 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" podStartSLOduration=2.169186656 podStartE2EDuration="2.169186656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:41:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:41:28.167188393 +0000 UTC m=+2949.936247937" watchObservedRunningTime="2026-09-09 21:41:28.169186656 +0000 UTC m=+2949.938246177" Sep 09 21:41:28.624391 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:28.624363 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7gjmz_29c9605f-97ab-4575-bcb3-8eff0fe334f4/dns/0.log" Sep 09 21:41:28.646546 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:28.646520 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7gjmz_29c9605f-97ab-4575-bcb3-8eff0fe334f4/kube-rbac-proxy/0.log" Sep 09 21:41:28.794698 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:28.794671 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7zr9_1917e841-81cf-49db-947d-40cd8c8c111e/dns-node-resolver/0.log" Sep 09 21:41:29.359816 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:29.359786 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9fmt6_3b9a3743-c66a-497c-935e-c79bb856e33d/node-ca/0.log" Sep 09 21:41:30.134826 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:30.134796 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-845fc486d8-rmtd8_d84a38d5-f187-4423-a046-be2f1ce20c6c/router/0.log" Sep 09 21:41:30.568732 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:30.568643 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8xr8_87f0ad83-f00e-417b-9c17-dba8823441a3/serve-healthcheck-canary/0.log" Sep 09 21:41:30.935973 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:30.935927 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-npfsq_cc154768-9c43-4758-9b19-6e7fa687d32a/insights-operator/0.log" Sep 09 21:41:30.937088 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:30.937065 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-npfsq_cc154768-9c43-4758-9b19-6e7fa687d32a/insights-operator/1.log" Sep 09 21:41:30.958360 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:30.958341 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vtbd_7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c/kube-rbac-proxy/0.log" Sep 09 21:41:30.980266 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:30.980241 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vtbd_7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c/exporter/0.log" Sep 09 21:41:31.003000 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:31.002980 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vtbd_7c9f8b32-2ad6-4d42-a334-9e61a4aaf25c/extractor/0.log" Sep 09 21:41:33.596614 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:33.596583 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-swxb2_2501782e-8e9c-47a1-a6de-22d73c1e4d97/s3-init/0.log" Sep 09 21:41:33.615509 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:33.615482 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-swxb2_2501782e-8e9c-47a1-a6de-22d73c1e4d97/download-hf-model/0.log" Sep 09 21:41:34.162970 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:34.162946 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kmz7m/perf-node-gather-daemonset-fvlff" Sep 09 21:41:38.336413 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:38.336376 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-4qfx9_cd33146c-f1d4-45a5-89c0-4b0597287e62/kube-storage-version-migrator-operator/1.log" Sep 09 21:41:38.337750 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:38.337729 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-4qfx9_cd33146c-f1d4-45a5-89c0-4b0597287e62/kube-storage-version-migrator-operator/0.log" Sep 09 21:41:39.439700 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.439668 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-thdmf_1afca2ca-c4d4-4c76-88b4-d2e4e162936b/kube-multus-additional-cni-plugins/0.log" Sep 09 21:41:39.464877 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.464851 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-thdmf_1afca2ca-c4d4-4c76-88b4-d2e4e162936b/egress-router-binary-copy/0.log" Sep 09 21:41:39.486738 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.486711 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-thdmf_1afca2ca-c4d4-4c76-88b4-d2e4e162936b/cni-plugins/0.log" Sep 09 21:41:39.507402 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.507380 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-thdmf_1afca2ca-c4d4-4c76-88b4-d2e4e162936b/bond-cni-plugin/0.log" Sep 09 21:41:39.527928 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.527908 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-thdmf_1afca2ca-c4d4-4c76-88b4-d2e4e162936b/routeoverride-cni/0.log" Sep 09 21:41:39.556641 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.556620 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-thdmf_1afca2ca-c4d4-4c76-88b4-d2e4e162936b/whereabouts-cni-bincopy/0.log" Sep 09 21:41:39.578422 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.578401 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-thdmf_1afca2ca-c4d4-4c76-88b4-d2e4e162936b/whereabouts-cni/0.log" Sep 09 21:41:39.773288 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.773215 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dd952_5fd5e31e-fb66-452c-a0da-2fb04573d32b/kube-multus/0.log" Sep 09 21:41:39.908908 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.908879 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kqq54_3e84cae0-3a97-4a52-b3d9-e447b551aac8/network-metrics-daemon/0.log" Sep 09 21:41:39.927850 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:39.927828 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kqq54_3e84cae0-3a97-4a52-b3d9-e447b551aac8/kube-rbac-proxy/0.log" Sep 09 21:41:41.184568 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:41.184485 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx4j8_9a547fdc-ea43-4192-8aa2-6d50e9484d9f/ovn-controller/0.log" Sep 09 21:41:41.200690 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:41.200665 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx4j8_9a547fdc-ea43-4192-8aa2-6d50e9484d9f/ovn-acl-logging/0.log" Sep 09 21:41:41.225681 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:41.225656 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx4j8_9a547fdc-ea43-4192-8aa2-6d50e9484d9f/kube-rbac-proxy-node/0.log" Sep 09 21:41:41.247425 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:41.247359 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx4j8_9a547fdc-ea43-4192-8aa2-6d50e9484d9f/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 21:41:41.266586 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:41.266563 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx4j8_9a547fdc-ea43-4192-8aa2-6d50e9484d9f/northd/0.log" Sep 09 21:41:41.288413 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:41.288395 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx4j8_9a547fdc-ea43-4192-8aa2-6d50e9484d9f/nbdb/0.log" Sep 09 21:41:41.309689 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:41.309667 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx4j8_9a547fdc-ea43-4192-8aa2-6d50e9484d9f/sbdb/0.log" Sep 09 21:41:41.361789 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:41.361769 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx4j8_9a547fdc-ea43-4192-8aa2-6d50e9484d9f/ovnkube-controller/0.log" Sep 09 21:41:42.331303 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:42.331279 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-nnf7c_895ccf61-30c6-439b-a8f2-65930efa7c93/check-endpoints/0.log" Sep 09 21:41:42.407909 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:42.407883 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q5sw5_ed7e3aa3-1078-4f63-904a-ef4e84e1623c/network-check-target-container/0.log" Sep 09 21:41:43.378526 ip-10-0-140-67 kubenswrapper[2560]: I0909 21:41:43.378495 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8n2xs_ebb71af5-7ff5-4491-bd81-c449ea4cf608/iptables-alerter/0.log"