May 26 16:01:32.758338 ip-10-0-140-223 systemd[1]: Starting Kubernetes Kubelet...
May 26 16:01:33.261567 ip-10-0-140-223 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 16:01:33.261567 ip-10-0-140-223 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 16:01:33.261567 ip-10-0-140-223 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 16:01:33.261567 ip-10-0-140-223 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 16:01:33.261567 ip-10-0-140-223 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 16:01:33.263453 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.263366    2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 16:01:33.270654 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270631    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:01:33.270654 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270650    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:01:33.270654 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270654    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:01:33.270654 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270657    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:01:33.270654 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270661    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270664    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270668    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270671    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270674    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270677    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270680    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270682    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270685    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270688    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270690    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270693    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270695    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270698    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270701    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270704    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270706    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270709    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270711    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270714    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:01:33.270862 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270724    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270726    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270729    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270732    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270734    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270737    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270739    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270742    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270744    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270747    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270749    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270752    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270755    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270758    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270761    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270763    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270766    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270769    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270771    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270774    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:01:33.271346 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270777    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270803    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270807    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270810    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270812    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270815    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270828    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270832    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270834    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270839    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270843    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270846    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270849    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270852    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270856    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270860    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270863    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270866    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:01:33.271825 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270869    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270872    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270875    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270878    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270881    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270883    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270886    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270888    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270892    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270895    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270897    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270900    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270903    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270905    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270908    2567 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270910    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270915    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270918    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270921    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270924    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:01:33.272314 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270926    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270929    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270931    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.270934    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272621    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272629    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272632    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272635    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272639    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272641    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272644    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272647    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272649    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272652    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272655    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272657    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272660    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272662    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272665    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:01:33.272796 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272667    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272670    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272673    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272677    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272680    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272683    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272685    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272688    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272691    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272694    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272697    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272699    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272702    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272704    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272706    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272711    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272714    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272716    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272719    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:01:33.273289 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272721    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272724    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272726    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272729    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272731    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272734    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272736    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272740    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272743    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272746    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272749    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272752    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272755    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272757    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272760    2567 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272763    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272766    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272768    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272770    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272774    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:01:33.273766 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272776    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272779    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272781    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272785    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272787    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272790    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272794    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272796    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272800    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272803    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272805    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272808    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272811    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272813    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272816    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272819    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272822    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272824    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272827    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272829    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:01:33.274268 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272832    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272835    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272837    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272840    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272842    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272845    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272847    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272850    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272852    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272855    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272857    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.272860    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272929    2567 flags.go:64] FLAG: --address="0.0.0.0"
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272936    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272942    2567 flags.go:64] FLAG: --anonymous-auth="true"
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272946    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272953    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272958    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272965    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272971    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272977    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 16:01:33.274758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272980    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272984    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272987    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.272990    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273006    2567 flags.go:64] FLAG: --cgroup-root=""
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273009    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273012    2567 flags.go:64] FLAG: --client-ca-file=""
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273015    2567 flags.go:64] FLAG: --cloud-config=""
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273018    2567 flags.go:64] FLAG: --cloud-provider="external"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273021    2567 flags.go:64] FLAG: --cluster-dns="[]"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273026    2567 flags.go:64] FLAG: --cluster-domain=""
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273029    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273032    2567 flags.go:64] FLAG: --config-dir=""
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273035    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273039    2567 flags.go:64] FLAG: --container-log-max-files="5"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273043    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273046    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273049    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273052    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273055    2567 flags.go:64] FLAG: --contention-profiling="false"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273058    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273061    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273064    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273067    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273071    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 16:01:33.275299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273074    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273077    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273080    2567 flags.go:64] FLAG: --enable-load-reader="false"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273084    2567 flags.go:64] FLAG: --enable-server="true"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273087    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273092    2567 flags.go:64] FLAG: --event-burst="100"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273095    2567 flags.go:64] FLAG: --event-qps="50"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273098    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273101    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273104    2567 flags.go:64] FLAG: --eviction-hard=""
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273108    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273111    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273114    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273117    2567 flags.go:64] FLAG: --eviction-soft=""
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273120    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273123    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273125    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273128    2567 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273131    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273134    2567 flags.go:64] FLAG: --fail-swap-on="true"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273137    2567 flags.go:64] FLAG: --feature-gates=""
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273141    2567 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273144    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273147    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273151    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273154    2567 flags.go:64] FLAG: --healthz-port="10248"
May 26 16:01:33.275891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273157    2567 flags.go:64] FLAG: --help="false"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273160    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-140-223.ec2.internal"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273163    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273166    2567 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273169    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273173    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273176    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273179    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273182    2567 flags.go:64] FLAG: --image-service-endpoint=""
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273185    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273188    2567 flags.go:64] FLAG: --kube-api-burst="100"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273191    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273195    2567 flags.go:64] FLAG: --kube-api-qps="50"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273198    2567 flags.go:64] FLAG: --kube-reserved=""
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273201    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273204    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273207    2567 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273209    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273212    2567 flags.go:64] FLAG: --lock-file=""
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273215    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273217    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273220    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273226    2567 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 16:01:33.276540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273229    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273231    2567 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273234    2567 flags.go:64] FLAG: --logging-format="text"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273237    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273240    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273243    2567 flags.go:64] FLAG: --manifest-url=""
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273246    2567 flags.go:64] FLAG: --manifest-url-header=""
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273250    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273252    2567 flags.go:64] FLAG: --max-open-files="1000000"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273256    2567 flags.go:64] FLAG: --max-pods="110"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273259    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273262    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273265    2567 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273268    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273271    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273274    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273277    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273284    2567 flags.go:64] FLAG: --node-status-max-images="50"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273287    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273290    2567 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273297    2567 flags.go:64] FLAG: --pod-cidr=""
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273300    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273305    2567 flags.go:64] FLAG: --pod-manifest-path=""
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273308    2567 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 16:01:33.277088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273311    2567 flags.go:64] FLAG: --pods-per-core="0"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273314    2567 flags.go:64] FLAG: --port="10250"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273317    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273320    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0334bc74ac746ed2c"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273323    2567 flags.go:64] FLAG: --qos-reserved=""
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273326    2567 flags.go:64] FLAG: --read-only-port="10255"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273329    2567 flags.go:64] FLAG: --register-node="true"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273332    2567 flags.go:64] FLAG: --register-schedulable="true"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273335    2567 flags.go:64] FLAG: --register-with-taints=""
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273339    2567 flags.go:64] FLAG: --registry-burst="10"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273341    2567 flags.go:64] FLAG: --registry-qps="5"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273344    2567 flags.go:64] FLAG: --reserved-cpus=""
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273347    2567 flags.go:64] FLAG: --reserved-memory=""
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273351    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273354    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273357    2567 flags.go:64] FLAG: --rotate-certificates="false"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273359    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273362    2567 flags.go:64] FLAG: --runonce="false"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273365    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273368    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273371    2567 flags.go:64] FLAG: --seccomp-default="false"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273373    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273376    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273379    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273382    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273385    2567 flags.go:64] FLAG: --storage-driver-password="root"
May 26 16:01:33.277688 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273388    2567 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273390    2567 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273398    2567 flags.go:64] FLAG: --storage-driver-user="root"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273401    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273404    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273407    2567 flags.go:64] FLAG: --system-cgroups=""
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273410    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273416    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273419    2567 flags.go:64] FLAG: --tls-cert-file=""
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273421    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273426    2567 flags.go:64] FLAG: --tls-min-version=""
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273429    2567 flags.go:64] FLAG: --tls-private-key-file=""
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273432    2567 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273435    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273438    2567 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273441    2567 flags.go:64] FLAG: --v="2"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273445    2567 flags.go:64] FLAG: --version="false"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273449    2567 flags.go:64] FLAG: --vmodule=""
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273453    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.273456    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273547    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273550    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273553    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273555    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:01:33.278353 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273558    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273560    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273563    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273565    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273568    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273570    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273574    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273578    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273581    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273586    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273590    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273593    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273597    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273599    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273602    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273605    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273607    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273610    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273613    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:01:33.278967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273615    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273618    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273620    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273623    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273626    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273628    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273630    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273633    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273635    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273638    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273641    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273644    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273646    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273648    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273651    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273653    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273656    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273658    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273661    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273663    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:01:33.279494 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273666    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273668    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273672    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273677    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273679    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273682    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273685    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273688    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273690    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273692    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273695    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273697    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273700    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273702    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273706    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273710    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273713    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273715    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273718    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273720    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:01:33.279980 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273723    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273725    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273728    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273731    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273733    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273736    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273738    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273741    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273743    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273746    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273748    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273751    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273753    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273756    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273759    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273763    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273765    2567 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273768    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273771    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273774    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:01:33.280492 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273777    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:01:33.280978 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273779    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:01:33.280978 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.273782    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:01:33.280978 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.274485    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 16:01:33.281465 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.281445    2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 16:01:33.281493 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.281466    2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 16:01:33.281522 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281512    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:01:33.281522 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281518    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:01:33.281522 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281521    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281524    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281528    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281531    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281534    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281537    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281539    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281542    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281545    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281547    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281550    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281552    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281555    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281558    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281560    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281563    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281565    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281569    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281573    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:01:33.281596 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281577    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281580    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281583    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281586    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281589    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281592    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281595    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281598    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281601    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281604    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281608    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281611    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281613    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281616    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281619    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281621    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281624    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281627    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281630    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281632    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:01:33.282073 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281635    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281638    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281640    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281643    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281646    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281648    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281650    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281653    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281656    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281658    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281662    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281666    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281669    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281671    2567 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281675    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281677    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281680    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281683    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281685    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:01:33.282570 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281688    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281691    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281693    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281696    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281699    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281701    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281704    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281707    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281709    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281712    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281714    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281717    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281720    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281722    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281725    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281728    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281730    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281732    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281735    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281737    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:01:33.283047 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281740    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281742    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281745    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281747    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281750    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281752    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.281757    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281871    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281876    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281879    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281882    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281885    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281888    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281890    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281893    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:01:33.283550 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281895    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281898    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281901    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281904    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281906    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281909    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281911    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281914    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281916    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281919    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281922    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281924    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281927    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281929    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281932    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281934    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281937    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281940    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281942    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281945    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:01:33.283919 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281947    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281950    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281952    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281955    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281958    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281961    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281963    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281966    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281968    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281972    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281976    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281979    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281982    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281985    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281987    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281990    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.281993    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282013    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282016    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282019    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:01:33.284489 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282021    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282024    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282027    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282030    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282032    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282035    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282038    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282040    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282043    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282045    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282048    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282050    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282053    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282055    2567 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282058    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282061    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282064    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282068    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282071    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282075    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:01:33.284967 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282077    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282080    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282083    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282086    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282088    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282091    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282093    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282096    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282099    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282102    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282104    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282107    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282109    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282112    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282114    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282117    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282119    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:01:33.285469 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:33.282122    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:01:33.285878 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.282127    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 16:01:33.285878 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.283068    2567 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 16:01:33.287376 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.287362    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 16:01:33.288617 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.288606    2567 server.go:1019] "Starting client certificate rotation"
May 26 16:01:33.288715 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.288698    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 16:01:33.288744 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.288738    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 16:01:33.317441 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.317417    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 16:01:33.322555 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.322533    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 16:01:33.337778 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.337762    2567 log.go:25] "Validated CRI v1 runtime API"
May 26 16:01:33.343990 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.343971    2567 log.go:25] "Validated CRI v1 image API"
May 26 16:01:33.345521 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.345502    2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 16:01:33.346107 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.346089    2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 16:01:33.350020 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.349979    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 89376227-a94f-41e6-88fd-094be49ec3b2:/dev/nvme0n1p3 da35ad8c-9c21-4388-9254-5b4abe00db2f:/dev/nvme0n1p4]
May 26 16:01:33.350090 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.350019    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 16:01:33.354368 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.354249    2567 manager.go:217] Machine: {Timestamp:2026-05-26 16:01:33.35372732 +0000 UTC m=+0.464285102 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098215 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ec56b3d1872978a472f9ac86c88f6 SystemUUID:ec2ec56b-3d18-7297-8a47-2f9ac86c88f6 BootID:a30fdf7d-467c-4ac4-b7f9-ce8a14544ccb Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:03:d3:7b:86:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:03:d3:7b:86:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:76:9a:4f:c4:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 16:01:33.355771 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.355760    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 16:01:33.355893 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.355880    2567 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 16:01:33.358941 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.358915    2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 16:01:33.359107 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.358943    2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 16:01:33.359151 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.359113    2567 topology_manager.go:138] "Creating topology manager with none policy"
May 26 16:01:33.359151 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.359122    2567 container_manager_linux.go:306] "Creating device plugin manager"
May 26 16:01:33.359151 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.359131    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 16:01:33.360185 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.360175    2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 16:01:33.361370 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.361360    2567 state_mem.go:36] "Initialized new in-memory state store"
May 26 16:01:33.361635 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.361626    2567 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 16:01:33.364013 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.363984    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dcx5z"
May 26 16:01:33.364718 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.364708    2567 kubelet.go:491] "Attempting to sync node with API server"
May 26 16:01:33.364753 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.364723    2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 16:01:33.364753 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.364741    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 16:01:33.364753 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.364750    2567 kubelet.go:397] "Adding apiserver pod source"
May 26 16:01:33.364847 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.364764    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 16:01:33.366036 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.366025    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 16:01:33.366079 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.366042    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 16:01:33.370446 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.370421    2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 16:01:33.371086 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.371067    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dcx5z"
May 26 16:01:33.373474 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.373457    2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 16:01:33.376331 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376315    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376336    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376345    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376351    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376361    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376367    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376373    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376379    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376386    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376395    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376403    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 16:01:33.376419 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.376409    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 16:01:33.377277 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.377266    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 16:01:33.377277 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.377277    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 16:01:33.380514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.380497    2567 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 16:01:33.380597 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.380534    2567 server.go:1295] "Started kubelet"
May 26 16:01:33.380597 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.380552    2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:01:33.380699 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.380659    2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 16:01:33.380803 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.380714    2567 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 16:01:33.380970 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.380947    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 16:01:33.381316 ip-10-0-140-223 systemd[1]: Started Kubernetes Kubelet.
May 26 16:01:33.382149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.382057    2567 server.go:317] "Adding debug handlers to kubelet server"
May 26 16:01:33.382206 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.382195    2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:01:33.382342 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.382325    2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 16:01:33.383981 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.383960    2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-223.ec2.internal" not found
May 26 16:01:33.390932 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.390914    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 16:01:33.391591 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.391566    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 16:01:33.391739 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.391722    2567 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 16:01:33.391796 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.391741    2567 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 16:01:33.391986 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.391970    2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 16:01:33.392079 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.392056    2567 reconstruct.go:97] "Volume reconstruction finished"
May 26 16:01:33.392079 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.392065    2567 reconciler.go:26] "Reconciler: start to sync state"
May 26 16:01:33.392739 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:33.392715    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
May 26 16:01:33.392852 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.392839    2567 factory.go:55] Registering systemd factory
May 26 16:01:33.392935 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.392926    2567 factory.go:223] Registration of the systemd container factory successfully
May 26 16:01:33.393284 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.393268    2567 factory.go:153] Registering CRI-O factory
May 26 16:01:33.393367 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.393289    2567 factory.go:223] Registration of the crio container factory successfully
May 26 16:01:33.393367 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.393341    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 16:01:33.393367 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.393358    2567 factory.go:103] Registering Raw factory
May 26 16:01:33.393531 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.393377    2567 manager.go:1196] Started watching for new ooms in manager
May 26 16:01:33.393531 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:33.393438    2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 16:01:33.393778 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.393762    2567 manager.go:319] Starting recovery of all containers
May 26 16:01:33.394909 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.394890    2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:01:33.396399 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:33.396364    2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-223.ec2.internal\" not found" node="ip-10-0-140-223.ec2.internal"
May 26 16:01:33.399479 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.399364    2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-223.ec2.internal" not found
May 26 16:01:33.403260 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.403107    2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 16:01:33.406475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.406458    2567 manager.go:324] Recovery completed
May 26 16:01:33.410592 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.410578    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:01:33.412665 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.412650    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:01:33.412716 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.412677    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:01:33.412716 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.412688    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientPID"
May 26 16:01:33.413213 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.413197    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 16:01:33.413213 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.413210    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 16:01:33.413316 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.413227    2567 state_mem.go:36] "Initialized new in-memory state store"
May 26 16:01:33.416865 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.416849    2567 policy_none.go:49] "None policy: Start"
May 26 16:01:33.416865 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.416866    2567 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 16:01:33.416991 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.416877    2567 state_mem.go:35] "Initializing new in-memory state store"
May 26 16:01:33.455536 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.455519    2567 manager.go:341] "Starting Device Plugin manager"
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:33.455556    2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.455569    2567 server.go:85] "Starting device plugin registration server"
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.455772    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.455781    2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.455856    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.455928    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.455938    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:33.456554    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:33.456586    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-223.ec2.internal\" not found"
May 26 16:01:33.474827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.457871    2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-223.ec2.internal" not found
May 26 16:01:33.488761 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.488741    2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 16:01:33.488761 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.488764    2567 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 16:01:33.488870 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.488782    2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 16:01:33.488870 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.488788    2567 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 16:01:33.488870 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:33.488823    2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 16:01:33.491826 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.491809    2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:01:33.556668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.556604    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:01:33.557649 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.557627    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:01:33.557755 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.557658    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:01:33.557755 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.557678    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientPID"
May 26 16:01:33.557755 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.557705    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-223.ec2.internal"
May 26 16:01:33.566058 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.566038    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-223.ec2.internal"
May 26 16:01:33.588971 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.588945    2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"]
May 26 16:01:33.591096 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.591081    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.591146 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.591094    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.592397 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.592383    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.605968 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.605951    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 16:01:33.606068 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.606057    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.615007 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.614981    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 16:01:33.616550 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.616537    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.620864 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.620850    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.628546 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.628533    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 16:01:33.628623 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:33.628584    2567 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-223.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.633370 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.633356    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 16:01:33.633431 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:33.633389    2567 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.692593 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.692567    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8abf6e6200faa03983a4f96687820b97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"8abf6e6200faa03983a4f96687820b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.692684 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.692595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c705c9c8886b8665628a0c46bc41272e-config\") pod \"kube-apiserver-proxy-ip-10-0-140-223.ec2.internal\" (UID: \"c705c9c8886b8665628a0c46bc41272e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.692684 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.692617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8abf6e6200faa03983a4f96687820b97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"8abf6e6200faa03983a4f96687820b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.793738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.793707    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8abf6e6200faa03983a4f96687820b97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"8abf6e6200faa03983a4f96687820b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.793738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.793676    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8abf6e6200faa03983a4f96687820b97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"8abf6e6200faa03983a4f96687820b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.793885 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.793774    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8abf6e6200faa03983a4f96687820b97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"8abf6e6200faa03983a4f96687820b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.793885 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.793794    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c705c9c8886b8665628a0c46bc41272e-config\") pod \"kube-apiserver-proxy-ip-10-0-140-223.ec2.internal\" (UID: \"c705c9c8886b8665628a0c46bc41272e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.793885 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.793818    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c705c9c8886b8665628a0c46bc41272e-config\") pod \"kube-apiserver-proxy-ip-10-0-140-223.ec2.internal\" (UID: \"c705c9c8886b8665628a0c46bc41272e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.793885 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.793854    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8abf6e6200faa03983a4f96687820b97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"8abf6e6200faa03983a4f96687820b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.931762 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.931670    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
May 26 16:01:33.936023 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:33.935988    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
May 26 16:01:34.288782 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.288693    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 16:01:34.289529 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.288870    2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 16:01:34.289529 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.288882    2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 16:01:34.289529 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.288923    2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 16:01:34.365608 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.365576    2567 apiserver.go:52] "Watching apiserver"
May 26 16:01:34.372494 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.372471    2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 16:01:34.373393 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.373348    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 15:56:33 +0000 UTC" deadline="2027-11-26 14:10:24.104535071 +0000 UTC"
May 26 16:01:34.373507 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.373393    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13174h8m49.731145913s"
May 26 16:01:34.373507 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.373467    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal","openshift-cluster-node-tuning-operator/tuned-tczz9","openshift-image-registry/node-ca-6p6md","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal","openshift-multus/multus-additional-cni-plugins-2xs28","openshift-network-diagnostics/network-check-target-5dpqg","openshift-network-operator/iptables-alerter-942gr","openshift-ovn-kubernetes/ovnkube-node-9mczj","kube-system/konnectivity-agent-z56kl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8","openshift-dns/node-resolver-5j9n9","openshift-multus/multus-2hkb4","openshift-multus/network-metrics-daemon-6lm2r"]
May 26 16:01:34.378962 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.378941    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.379058 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.379033    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.381373 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.381350    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 16:01:34.381466 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.381385    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.381466 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.381406    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 16:01:34.381573 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.381474    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 16:01:34.381719 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.381705    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zpkcw\""
May 26 16:01:34.381774 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.381708    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2llk5\""
May 26 16:01:34.381774 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.381735    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 16:01:34.381832 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.381729    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 16:01:34.383510 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.383495    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:34.383609 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:34.383590    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:34.383652 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.383632    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-848cw\""
May 26 16:01:34.383962 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.383946    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 16:01:34.384015 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.383976    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 16:01:34.384015 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.383977    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 16:01:34.384108 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.383980    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 16:01:34.384108 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.384086    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 16:01:34.385927 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.385912    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.388090 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.388074    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 16:01:34.388364 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.388339    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 16:01:34.388450 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.388380    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.388450 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.388407    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 16:01:34.388609 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.388590    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tl48k\""
May 26 16:01:34.390283 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.390267    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:34.390779 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.390764    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 16:01:34.390984 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.390968    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 16:01:34.391073 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.390969    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 16:01:34.391127 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.391015    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 16:01:34.391700 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.391685    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9ncvl\""
May 26 16:01:34.391776 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.391758    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 16:01:34.391909 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.391893    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 16:01:34.392486 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.392453    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.392740 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.392707    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 16:01:34.392857 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.392842    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 16:01:34.392952 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.392891    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lx28l\""
May 26 16:01:34.393207 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.393192    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 16:01:34.394553 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.394523    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 16:01:34.394866 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.394849    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.395100 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.395084    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 16:01:34.395187 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.395100    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8rxpt\""
May 26 16:01:34.395256 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.395242    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 16:01:34.396668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.396651    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pbr6g\""
May 26 16:01:34.396931 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.396915    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 16:01:34.397005 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.396937    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 16:01:34.397149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397134    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.397452 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-cni-netd\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.397535 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.397535 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.397535 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-run\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.397535 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397520    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/94127774-1122-4c33-a89c-0a89175d27d6-etc-tuned\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.397668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397535    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-var-lib-openvswitch\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.397668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397559    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4hc9\" (UniqueName: \"kubernetes.io/projected/a8f8a8ec-0016-4484-8496-6813990419c8-kube-api-access-g4hc9\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.397668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a4cdf919-1a9c-4477-b7e9-1d2b553e0557-konnectivity-ca\") pod \"konnectivity-agent-z56kl\" (UID: \"a4cdf919-1a9c-4477-b7e9-1d2b553e0557\") " pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:34.397668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397589    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvw97\" (UniqueName: \"kubernetes.io/projected/5dce97a3-a3c3-4027-8fc0-4337abb334dc-kube-api-access-pvw97\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.397668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397608    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbed895c-2cee-4938-92e8-823766bdf878-host\") pod \"node-ca-6p6md\" (UID: \"cbed895c-2cee-4938-92e8-823766bdf878\") " pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.397668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-cnibin\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.397668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397639    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94127774-1122-4c33-a89c-0a89175d27d6-tmp\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.397668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397652    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-os-release\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dce97a3-a3c3-4027-8fc0-4337abb334dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-node-log\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-socket-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397739    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-sys-fs\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397759    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-host\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzjlc\" (UniqueName: \"kubernetes.io/projected/cbed895c-2cee-4938-92e8-823766bdf878-kube-api-access-dzjlc\") pod \"node-ca-6p6md\" (UID: \"cbed895c-2cee-4938-92e8-823766bdf878\") " pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397830    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-sys\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-system-cni-dir\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397865    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-log-socket\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397880    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dce97a3-a3c3-4027-8fc0-4337abb334dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397893    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8f8a8ec-0016-4484-8496-6813990419c8-ovnkube-config\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-kubernetes\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.397943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8f8a8ec-0016-4484-8496-6813990419c8-ovn-node-metrics-cert\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397956    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-modprobe-d\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.397977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8f8a8ec-0016-4484-8496-6813990419c8-ovnkube-script-lib\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398027    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-sysctl-d\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dce97a3-a3c3-4027-8fc0-4337abb334dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-systemd-units\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398106    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-sysctl-conf\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-systemd\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31c83f62-4c69-4d04-af97-1c368229b2ef-host-slash\") pod \"iptables-alerter-942gr\" (UID: \"31c83f62-4c69-4d04-af97-1c368229b2ef\") " pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-kubelet\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-etc-openvswitch\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398243    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-run-openvswitch\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-sysconfig\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398317    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbed895c-2cee-4938-92e8-823766bdf878-serviceca\") pod \"node-ca-6p6md\" (UID: \"cbed895c-2cee-4938-92e8-823766bdf878\") " pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-var-lib-kubelet\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398405    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqm9x\" (UniqueName: \"kubernetes.io/projected/94127774-1122-4c33-a89c-0a89175d27d6-kube-api-access-rqm9x\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.398514 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31c83f62-4c69-4d04-af97-1c368229b2ef-iptables-alerter-script\") pod \"iptables-alerter-942gr\" (UID: \"31c83f62-4c69-4d04-af97-1c368229b2ef\") " pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-run-netns\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398520    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8f8a8ec-0016-4484-8496-6813990419c8-env-overrides\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a4cdf919-1a9c-4477-b7e9-1d2b553e0557-agent-certs\") pod \"konnectivity-agent-z56kl\" (UID: \"a4cdf919-1a9c-4477-b7e9-1d2b553e0557\") " pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qrp2\" (UniqueName: \"kubernetes.io/projected/31c83f62-4c69-4d04-af97-1c368229b2ef-kube-api-access-7qrp2\") pod \"iptables-alerter-942gr\" (UID: \"31c83f62-4c69-4d04-af97-1c368229b2ef\") " pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398664    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-run-systemd\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-registration-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398717    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-device-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fdbp\" (UniqueName: \"kubernetes.io/projected/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-kube-api-access-2fdbp\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398766    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398804    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-slash\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.398835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-cni-bin\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.399119    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.399152    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-lib-modules\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.399198 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.399195    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-run-ovn\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.399799 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.399210    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 16:01:34.399799 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.399409    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rb2nk\""
May 26 16:01:34.399799 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.399520    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:34.399799 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:34.399574    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:34.404798 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.404704    2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 16:01:34.427437 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.427412    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t2ch7"
May 26 16:01:34.433390 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.433371    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t2ch7"
May 26 16:01:34.466433 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.466409    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8abf6e6200faa03983a4f96687820b97.slice/crio-b1078e8dfe9f3d8a520f546aa73cba3d39fe957c26a9d2433eb3f15b406e4a52 WatchSource:0}: Error finding container b1078e8dfe9f3d8a520f546aa73cba3d39fe957c26a9d2433eb3f15b406e4a52: Status 404 returned error can't find the container with id b1078e8dfe9f3d8a520f546aa73cba3d39fe957c26a9d2433eb3f15b406e4a52
May 26 16:01:34.466726 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.466706    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc705c9c8886b8665628a0c46bc41272e.slice/crio-9afc796d3c2c1f6a327f14541821dffa4ad5fe8d91bdb004a8471560e72c9bd0 WatchSource:0}: Error finding container 9afc796d3c2c1f6a327f14541821dffa4ad5fe8d91bdb004a8471560e72c9bd0: Status 404 returned error can't find the container with id 9afc796d3c2c1f6a327f14541821dffa4ad5fe8d91bdb004a8471560e72c9bd0
May 26 16:01:34.470385 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.470333    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:01:34.491489 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.491450    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal" event={"ID":"8abf6e6200faa03983a4f96687820b97","Type":"ContainerStarted","Data":"b1078e8dfe9f3d8a520f546aa73cba3d39fe957c26a9d2433eb3f15b406e4a52"}
May 26 16:01:34.492400 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.492380    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal" event={"ID":"c705c9c8886b8665628a0c46bc41272e","Type":"ContainerStarted","Data":"9afc796d3c2c1f6a327f14541821dffa4ad5fe8d91bdb004a8471560e72c9bd0"}
May 26 16:01:34.492625 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.492612    2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 16:01:34.499385 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499366    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-var-lib-cni-bin\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.499463 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499404    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw97\" (UniqueName: \"kubernetes.io/projected/5dce97a3-a3c3-4027-8fc0-4337abb334dc-kube-api-access-pvw97\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.499463 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499430    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbed895c-2cee-4938-92e8-823766bdf878-host\") pod \"node-ca-6p6md\" (UID: \"cbed895c-2cee-4938-92e8-823766bdf878\") " pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.499559 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499489    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbed895c-2cee-4938-92e8-823766bdf878-host\") pod \"node-ca-6p6md\" (UID: \"cbed895c-2cee-4938-92e8-823766bdf878\") " pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.499599 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499583    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-cnibin\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.499638 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d61634f-edec-49c7-8504-65bb9238526a-hosts-file\") pod \"node-resolver-5j9n9\" (UID: \"1d61634f-edec-49c7-8504-65bb9238526a\") " pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.499638 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499632    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b69e8e5-6171-4d40-95f2-f5075947001d-cni-binary-copy\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.499738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499647    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-conf-dir\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.499738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499652    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-cnibin\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.499738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6vr\" (UniqueName: \"kubernetes.io/projected/1d61634f-edec-49c7-8504-65bb9238526a-kube-api-access-cp6vr\") pod \"node-resolver-5j9n9\" (UID: \"1d61634f-edec-49c7-8504-65bb9238526a\") " pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.499738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499710    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94127774-1122-4c33-a89c-0a89175d27d6-tmp\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.499738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499736    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-os-release\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499763    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dce97a3-a3c3-4027-8fc0-4337abb334dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499789    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-node-log\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499828    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-os-release\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499833    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-socket-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499887    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-sys-fs\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499892    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-node-log\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499913    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-host\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499939    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzjlc\" (UniqueName: \"kubernetes.io/projected/cbed895c-2cee-4938-92e8-823766bdf878-kube-api-access-dzjlc\") pod \"node-ca-6p6md\" (UID: \"cbed895c-2cee-4938-92e8-823766bdf878\") " pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499942    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-socket-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.499957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499946    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-sys-fs\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499966    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-system-cni-dir\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499949    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.499986    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-host\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500010    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500043    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-sys\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500068    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-system-cni-dir\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500093    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-log-socket\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500122    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-var-lib-cni-multus\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500140    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-sys\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500172    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-log-socket\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500163    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dce97a3-a3c3-4027-8fc0-4337abb334dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500135    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-system-cni-dir\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500209    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8f8a8ec-0016-4484-8496-6813990419c8-ovnkube-config\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.500421 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500215    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dce97a3-a3c3-4027-8fc0-4337abb334dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500684    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-hostroot\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500704    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dce97a3-a3c3-4027-8fc0-4337abb334dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500723    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-kubernetes\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500739    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8f8a8ec-0016-4484-8496-6813990419c8-ovnkube-config\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500754    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8f8a8ec-0016-4484-8496-6813990419c8-ovn-node-metrics-cert\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500783    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-cnibin\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500809    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-socket-dir-parent\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500764    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-kubernetes\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-run-k8s-cni-cncf-io\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500859    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-run-netns\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500885    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-modprobe-d\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500909    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8f8a8ec-0016-4484-8496-6813990419c8-ovnkube-script-lib\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500952    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-sysctl-d\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500974    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-modprobe-d\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.500980 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.500980    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dce97a3-a3c3-4027-8fc0-4337abb334dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501036    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-systemd-units\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7flt\" (UniqueName: \"kubernetes.io/projected/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-kube-api-access-j7flt\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501079    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-sysctl-conf\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501095    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-sysctl-d\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501103    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-systemd\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501120    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-systemd-units\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501139    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31c83f62-4c69-4d04-af97-1c368229b2ef-host-slash\") pod \"iptables-alerter-942gr\" (UID: \"31c83f62-4c69-4d04-af97-1c368229b2ef\") " pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501168    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-kubelet\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501172    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31c83f62-4c69-4d04-af97-1c368229b2ef-host-slash\") pod \"iptables-alerter-942gr\" (UID: \"31c83f62-4c69-4d04-af97-1c368229b2ef\") " pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501142    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-systemd\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501191    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-etc-openvswitch\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501214    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-kubelet\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501220    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-run-openvswitch\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501241    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-sysctl-conf\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501252    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-etc-openvswitch\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501244    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-sysconfig\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.501653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501287    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbed895c-2cee-4938-92e8-823766bdf878-serviceca\") pod \"node-ca-6p6md\" (UID: \"cbed895c-2cee-4938-92e8-823766bdf878\") " pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501287    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-etc-sysconfig\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501288    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-run-openvswitch\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-os-release\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-var-lib-kubelet\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501344    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-var-lib-kubelet\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501364    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqm9x\" (UniqueName: \"kubernetes.io/projected/94127774-1122-4c33-a89c-0a89175d27d6-kube-api-access-rqm9x\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501390    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31c83f62-4c69-4d04-af97-1c368229b2ef-iptables-alerter-script\") pod \"iptables-alerter-942gr\" (UID: \"31c83f62-4c69-4d04-af97-1c368229b2ef\") " pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501404    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-var-lib-kubelet\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501414    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-run-netns\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501439    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501439    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8f8a8ec-0016-4484-8496-6813990419c8-ovnkube-script-lib\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501463    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8f8a8ec-0016-4484-8496-6813990419c8-env-overrides\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501487    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a4cdf919-1a9c-4477-b7e9-1d2b553e0557-agent-certs\") pod \"konnectivity-agent-z56kl\" (UID: \"a4cdf919-1a9c-4477-b7e9-1d2b553e0557\") " pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501502    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-run-netns\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501514    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dce97a3-a3c3-4027-8fc0-4337abb334dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501531    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qrp2\" (UniqueName: \"kubernetes.io/projected/31c83f62-4c69-4d04-af97-1c368229b2ef-kube-api-access-7qrp2\") pod \"iptables-alerter-942gr\" (UID: \"31c83f62-4c69-4d04-af97-1c368229b2ef\") " pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.502405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.501569    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-run-systemd\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502144    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8f8a8ec-0016-4484-8496-6813990419c8-env-overrides\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502221    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502275    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31c83f62-4c69-4d04-af97-1c368229b2ef-iptables-alerter-script\") pod \"iptables-alerter-942gr\" (UID: \"31c83f62-4c69-4d04-af97-1c368229b2ef\") " pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502345    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-registration-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502389    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbed895c-2cee-4938-92e8-823766bdf878-serviceca\") pod \"node-ca-6p6md\" (UID: \"cbed895c-2cee-4938-92e8-823766bdf878\") " pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502418    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-registration-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502458    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-run-systemd\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502603    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-device-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502643    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fdbp\" (UniqueName: \"kubernetes.io/projected/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-kube-api-access-2fdbp\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-run-multus-certs\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502719    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502754    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-slash\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502786    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-cni-bin\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502827    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d61634f-edec-49c7-8504-65bb9238526a-tmp-dir\") pod \"node-resolver-5j9n9\" (UID: \"1d61634f-edec-49c7-8504-65bb9238526a\") " pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-daemon-config\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.503208 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502930    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-lib-modules\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.502965    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-run-ovn\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503014    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-cni-netd\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503043    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503078    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503113    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-etc-kubernetes\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503178    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9kkh\" (UniqueName: \"kubernetes.io/projected/6b69e8e5-6171-4d40-95f2-f5075947001d-kube-api-access-d9kkh\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503209    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-run\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503221    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503273    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/94127774-1122-4c33-a89c-0a89175d27d6-etc-tuned\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503309    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94127774-1122-4c33-a89c-0a89175d27d6-tmp\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503341    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-device-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503373    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-lib-modules\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503414    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-var-lib-openvswitch\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503411    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503453    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4hc9\" (UniqueName: \"kubernetes.io/projected/a8f8a8ec-0016-4484-8496-6813990419c8-kube-api-access-g4hc9\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.503921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503475    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-cni-netd\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503481    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a4cdf919-1a9c-4477-b7e9-1d2b553e0557-konnectivity-ca\") pod \"konnectivity-agent-z56kl\" (UID: \"a4cdf919-1a9c-4477-b7e9-1d2b553e0557\") " pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503486    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-run-ovn\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503536    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-cni-dir\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503559    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503627    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/94127774-1122-4c33-a89c-0a89175d27d6-run\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503840    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-slash\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503864    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dce97a3-a3c3-4027-8fc0-4337abb334dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503883    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-host-cni-bin\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503981    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8f8a8ec-0016-4484-8496-6813990419c8-var-lib-openvswitch\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.503986    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a4cdf919-1a9c-4477-b7e9-1d2b553e0557-konnectivity-ca\") pod \"konnectivity-agent-z56kl\" (UID: \"a4cdf919-1a9c-4477-b7e9-1d2b553e0557\") " pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:34.504693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.504317    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8f8a8ec-0016-4484-8496-6813990419c8-ovn-node-metrics-cert\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.505533 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:34.505510    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:01:34.505615 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:34.505536    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:01:34.505615 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:34.505556    2567 projected.go:194] Error preparing data for projected volume kube-api-access-vhw6w for pod openshift-network-diagnostics/network-check-target-5dpqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:34.505718 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:34.505634    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w podName:e1586315-86d3-4140-bbde-20aeba976a6b nodeName:}" failed. No retries permitted until 2026-05-26 16:01:35.005603983 +0000 UTC m=+2.116161776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vhw6w" (UniqueName: "kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w") pod "network-check-target-5dpqg" (UID: "e1586315-86d3-4140-bbde-20aeba976a6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:34.505815 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.505770    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/94127774-1122-4c33-a89c-0a89175d27d6-etc-tuned\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.506036 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.505989    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a4cdf919-1a9c-4477-b7e9-1d2b553e0557-agent-certs\") pod \"konnectivity-agent-z56kl\" (UID: \"a4cdf919-1a9c-4477-b7e9-1d2b553e0557\") " pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:34.507556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.507533    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzjlc\" (UniqueName: \"kubernetes.io/projected/cbed895c-2cee-4938-92e8-823766bdf878-kube-api-access-dzjlc\") pod \"node-ca-6p6md\" (UID: \"cbed895c-2cee-4938-92e8-823766bdf878\") " pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.507846 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.507826    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvw97\" (UniqueName: \"kubernetes.io/projected/5dce97a3-a3c3-4027-8fc0-4337abb334dc-kube-api-access-pvw97\") pod \"multus-additional-cni-plugins-2xs28\" (UID: \"5dce97a3-a3c3-4027-8fc0-4337abb334dc\") " pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.508524 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.508503    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqm9x\" (UniqueName: \"kubernetes.io/projected/94127774-1122-4c33-a89c-0a89175d27d6-kube-api-access-rqm9x\") pod \"tuned-tczz9\" (UID: \"94127774-1122-4c33-a89c-0a89175d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.508645 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.508626    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qrp2\" (UniqueName: \"kubernetes.io/projected/31c83f62-4c69-4d04-af97-1c368229b2ef-kube-api-access-7qrp2\") pod \"iptables-alerter-942gr\" (UID: \"31c83f62-4c69-4d04-af97-1c368229b2ef\") " pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.510141 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.510116    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fdbp\" (UniqueName: \"kubernetes.io/projected/1128b42b-72e5-4aee-aa1d-ca33e32cd6a2-kube-api-access-2fdbp\") pod \"aws-ebs-csi-driver-node-hrrl8\" (UID: \"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.510641 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.510625    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4hc9\" (UniqueName: \"kubernetes.io/projected/a8f8a8ec-0016-4484-8496-6813990419c8-kube-api-access-g4hc9\") pod \"ovnkube-node-9mczj\" (UID: \"a8f8a8ec-0016-4484-8496-6813990419c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.604661 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604580    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-os-release\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604661 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604615    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-var-lib-kubelet\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604661 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604643    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-run-multus-certs\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604669    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d61634f-edec-49c7-8504-65bb9238526a-tmp-dir\") pod \"node-resolver-5j9n9\" (UID: \"1d61634f-edec-49c7-8504-65bb9238526a\") " pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604692    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-daemon-config\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604700    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-var-lib-kubelet\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604719    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604719    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-os-release\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604755    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-run-multus-certs\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:34.604793    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604818    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-etc-kubernetes\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:34.604843    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs podName:4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e nodeName:}" failed. No retries permitted until 2026-05-26 16:01:35.10482798 +0000 UTC m=+2.215385786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs") pod "network-metrics-daemon-6lm2r" (UID: "4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604853    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-etc-kubernetes\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604872    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kkh\" (UniqueName: \"kubernetes.io/projected/6b69e8e5-6171-4d40-95f2-f5075947001d-kube-api-access-d9kkh\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604900    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-cni-dir\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.604915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604916    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-var-lib-cni-bin\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604941    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d61634f-edec-49c7-8504-65bb9238526a-hosts-file\") pod \"node-resolver-5j9n9\" (UID: \"1d61634f-edec-49c7-8504-65bb9238526a\") " pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604965    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b69e8e5-6171-4d40-95f2-f5075947001d-cni-binary-copy\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604984    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-cni-dir\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.604990    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-conf-dir\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605013    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-var-lib-cni-bin\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605032    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6vr\" (UniqueName: \"kubernetes.io/projected/1d61634f-edec-49c7-8504-65bb9238526a-kube-api-access-cp6vr\") pod \"node-resolver-5j9n9\" (UID: \"1d61634f-edec-49c7-8504-65bb9238526a\") " pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605051    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d61634f-edec-49c7-8504-65bb9238526a-hosts-file\") pod \"node-resolver-5j9n9\" (UID: \"1d61634f-edec-49c7-8504-65bb9238526a\") " pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605023    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d61634f-edec-49c7-8504-65bb9238526a-tmp-dir\") pod \"node-resolver-5j9n9\" (UID: \"1d61634f-edec-49c7-8504-65bb9238526a\") " pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605078    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-system-cni-dir\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605082    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-conf-dir\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605133    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-system-cni-dir\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605140    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-var-lib-cni-multus\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605171    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-hostroot\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605198    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-cnibin\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605223    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-socket-dir-parent\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605248    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-run-k8s-cni-cncf-io\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605252    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-hostroot\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605266    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-cnibin\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605935 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605276    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-run-netns\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605935 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605302    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-var-lib-cni-multus\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605935 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605309    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7flt\" (UniqueName: \"kubernetes.io/projected/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-kube-api-access-j7flt\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:34.605935 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605316    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-run-k8s-cni-cncf-io\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605935 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605329    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-host-run-netns\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605935 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605327    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-socket-dir-parent\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605935 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605354    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b69e8e5-6171-4d40-95f2-f5075947001d-multus-daemon-config\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.605935 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.605413    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b69e8e5-6171-4d40-95f2-f5075947001d-cni-binary-copy\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.616071 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.616048    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6vr\" (UniqueName: \"kubernetes.io/projected/1d61634f-edec-49c7-8504-65bb9238526a-kube-api-access-cp6vr\") pod \"node-resolver-5j9n9\" (UID: \"1d61634f-edec-49c7-8504-65bb9238526a\") " pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.616921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.616902    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9kkh\" (UniqueName: \"kubernetes.io/projected/6b69e8e5-6171-4d40-95f2-f5075947001d-kube-api-access-d9kkh\") pod \"multus-2hkb4\" (UID: \"6b69e8e5-6171-4d40-95f2-f5075947001d\") " pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.617046 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.616931    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7flt\" (UniqueName: \"kubernetes.io/projected/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-kube-api-access-j7flt\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:34.699799 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.699780    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tczz9"
May 26 16:01:34.706188 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.706167    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94127774_1122_4c33_a89c_0a89175d27d6.slice/crio-2b4d18ea7be4e373d51adc6df1b5954755a7ddbbe719e902b9d146b047f7cfa8 WatchSource:0}: Error finding container 2b4d18ea7be4e373d51adc6df1b5954755a7ddbbe719e902b9d146b047f7cfa8: Status 404 returned error can't find the container with id 2b4d18ea7be4e373d51adc6df1b5954755a7ddbbe719e902b9d146b047f7cfa8
May 26 16:01:34.718623 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.718601    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6p6md"
May 26 16:01:34.725252 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.725232    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbed895c_2cee_4938_92e8_823766bdf878.slice/crio-480ec1a27efee54127e4987d260efa3bfa433af7d225e4cdd4070f1c760f7066 WatchSource:0}: Error finding container 480ec1a27efee54127e4987d260efa3bfa433af7d225e4cdd4070f1c760f7066: Status 404 returned error can't find the container with id 480ec1a27efee54127e4987d260efa3bfa433af7d225e4cdd4070f1c760f7066
May 26 16:01:34.737344 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.737327    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2xs28"
May 26 16:01:34.741874 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.741857    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-942gr"
May 26 16:01:34.742729 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.742710    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dce97a3_a3c3_4027_8fc0_4337abb334dc.slice/crio-455c852a3bc1aadee9185fd2a2b1da33a3925c683c1ea71e19294c1ee56883b5 WatchSource:0}: Error finding container 455c852a3bc1aadee9185fd2a2b1da33a3925c683c1ea71e19294c1ee56883b5: Status 404 returned error can't find the container with id 455c852a3bc1aadee9185fd2a2b1da33a3925c683c1ea71e19294c1ee56883b5
May 26 16:01:34.747648 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.747626    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c83f62_4c69_4d04_af97_1c368229b2ef.slice/crio-dcb89e4c0604036b9474c8313ce902da560df7dfe07cf3abe9619c04fad52d47 WatchSource:0}: Error finding container dcb89e4c0604036b9474c8313ce902da560df7dfe07cf3abe9619c04fad52d47: Status 404 returned error can't find the container with id dcb89e4c0604036b9474c8313ce902da560df7dfe07cf3abe9619c04fad52d47
May 26 16:01:34.761668 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.761647    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:01:34.768176 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.768157    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f8a8ec_0016_4484_8496_6813990419c8.slice/crio-def701d55c7984ea7cf579e4fe8da1a2573d9e09fdd61dfff8e226258f751ec6 WatchSource:0}: Error finding container def701d55c7984ea7cf579e4fe8da1a2573d9e09fdd61dfff8e226258f751ec6: Status 404 returned error can't find the container with id def701d55c7984ea7cf579e4fe8da1a2573d9e09fdd61dfff8e226258f751ec6
May 26 16:01:34.776747 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.776731    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:34.781588 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.781571    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8"
May 26 16:01:34.781768 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.781749    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4cdf919_1a9c_4477_b7e9_1d2b553e0557.slice/crio-275cce3278d5794df93f40a322edcd3d241b7d162ba47d8f48c8b257602894e9 WatchSource:0}: Error finding container 275cce3278d5794df93f40a322edcd3d241b7d162ba47d8f48c8b257602894e9: Status 404 returned error can't find the container with id 275cce3278d5794df93f40a322edcd3d241b7d162ba47d8f48c8b257602894e9
May 26 16:01:34.787497 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.787477    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5j9n9"
May 26 16:01:34.787687 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.787669    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1128b42b_72e5_4aee_aa1d_ca33e32cd6a2.slice/crio-9dd82e0ea24b532a30dc2d4739f5500196b5b85739848e5c5fc30832983f3fbb WatchSource:0}: Error finding container 9dd82e0ea24b532a30dc2d4739f5500196b5b85739848e5c5fc30832983f3fbb: Status 404 returned error can't find the container with id 9dd82e0ea24b532a30dc2d4739f5500196b5b85739848e5c5fc30832983f3fbb
May 26 16:01:34.792438 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:34.792419    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2hkb4"
May 26 16:01:34.792983 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.792967    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d61634f_edec_49c7_8504_65bb9238526a.slice/crio-f9d3b606b05c111caff751cea06cc20c64dc4f5afa79daa1b83d76c0b042691a WatchSource:0}: Error finding container f9d3b606b05c111caff751cea06cc20c64dc4f5afa79daa1b83d76c0b042691a: Status 404 returned error can't find the container with id f9d3b606b05c111caff751cea06cc20c64dc4f5afa79daa1b83d76c0b042691a
May 26 16:01:34.798560 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:01:34.798534    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b69e8e5_6171_4d40_95f2_f5075947001d.slice/crio-e13def3b5d7cac5e9496db909773e4b0621bc193d2dafcac1d517a938aa2a173 WatchSource:0}: Error finding container e13def3b5d7cac5e9496db909773e4b0621bc193d2dafcac1d517a938aa2a173: Status 404 returned error can't find the container with id e13def3b5d7cac5e9496db909773e4b0621bc193d2dafcac1d517a938aa2a173
May 26 16:01:35.007615 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.007531    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:35.007774 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:35.007718    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:01:35.007774 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:35.007737    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:01:35.007774 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:35.007750    2567 projected.go:194] Error preparing data for projected volume kube-api-access-vhw6w for pod openshift-network-diagnostics/network-check-target-5dpqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:35.007931 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:35.007811    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w podName:e1586315-86d3-4140-bbde-20aeba976a6b nodeName:}" failed. No retries permitted until 2026-05-26 16:01:36.007793456 +0000 UTC m=+3.118351233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhw6w" (UniqueName: "kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w") pod "network-check-target-5dpqg" (UID: "e1586315-86d3-4140-bbde-20aeba976a6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:35.108919 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.108885    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:35.109181 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:35.109080    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:35.109181 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:35.109151    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs podName:4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e nodeName:}" failed. No retries permitted until 2026-05-26 16:01:36.109130526 +0000 UTC m=+3.219688295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs") pod "network-metrics-daemon-6lm2r" (UID: "4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:35.192474 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.192441    2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:01:35.224859 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.224830    2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:01:35.434439 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.434391    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:56:34 +0000 UTC" deadline="2027-12-13 17:45:29.757187604 +0000 UTC"
May 26 16:01:35.434439 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.434435    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13585h43m54.322756664s"
May 26 16:01:35.516979 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.516846    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-942gr" event={"ID":"31c83f62-4c69-4d04-af97-1c368229b2ef","Type":"ContainerStarted","Data":"dcb89e4c0604036b9474c8313ce902da560df7dfe07cf3abe9619c04fad52d47"}
May 26 16:01:35.533890 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.533789    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xs28" event={"ID":"5dce97a3-a3c3-4027-8fc0-4337abb334dc","Type":"ContainerStarted","Data":"455c852a3bc1aadee9185fd2a2b1da33a3925c683c1ea71e19294c1ee56883b5"}
May 26 16:01:35.544768 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.544737    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5j9n9" event={"ID":"1d61634f-edec-49c7-8504-65bb9238526a","Type":"ContainerStarted","Data":"f9d3b606b05c111caff751cea06cc20c64dc4f5afa79daa1b83d76c0b042691a"}
May 26 16:01:35.553290 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.553261    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z56kl" event={"ID":"a4cdf919-1a9c-4477-b7e9-1d2b553e0557","Type":"ContainerStarted","Data":"275cce3278d5794df93f40a322edcd3d241b7d162ba47d8f48c8b257602894e9"}
May 26 16:01:35.574571 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.574239    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6p6md" event={"ID":"cbed895c-2cee-4938-92e8-823766bdf878","Type":"ContainerStarted","Data":"480ec1a27efee54127e4987d260efa3bfa433af7d225e4cdd4070f1c760f7066"}
May 26 16:01:35.579392 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.579359    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tczz9" event={"ID":"94127774-1122-4c33-a89c-0a89175d27d6","Type":"ContainerStarted","Data":"2b4d18ea7be4e373d51adc6df1b5954755a7ddbbe719e902b9d146b047f7cfa8"}
May 26 16:01:35.611918 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.611876    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2hkb4" event={"ID":"6b69e8e5-6171-4d40-95f2-f5075947001d","Type":"ContainerStarted","Data":"e13def3b5d7cac5e9496db909773e4b0621bc193d2dafcac1d517a938aa2a173"}
May 26 16:01:35.623902 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.623875    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8" event={"ID":"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2","Type":"ContainerStarted","Data":"9dd82e0ea24b532a30dc2d4739f5500196b5b85739848e5c5fc30832983f3fbb"}
May 26 16:01:35.643175 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.643127    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerStarted","Data":"def701d55c7984ea7cf579e4fe8da1a2573d9e09fdd61dfff8e226258f751ec6"}
May 26 16:01:35.814361 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:35.814282    2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:01:36.015718 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:36.015607    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:36.015897 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:36.015809    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:01:36.015897 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:36.015829    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:01:36.015897 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:36.015843    2567 projected.go:194] Error preparing data for projected volume kube-api-access-vhw6w for pod openshift-network-diagnostics/network-check-target-5dpqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:36.016095 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:36.015900    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w podName:e1586315-86d3-4140-bbde-20aeba976a6b nodeName:}" failed. No retries permitted until 2026-05-26 16:01:38.015880703 +0000 UTC m=+5.126438475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhw6w" (UniqueName: "kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w") pod "network-check-target-5dpqg" (UID: "e1586315-86d3-4140-bbde-20aeba976a6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:36.116327 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:36.116248    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:36.116483 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:36.116434    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:36.116539 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:36.116498    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs podName:4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e nodeName:}" failed. No retries permitted until 2026-05-26 16:01:38.116479445 +0000 UTC m=+5.227037218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs") pod "network-metrics-daemon-6lm2r" (UID: "4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:36.435313 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:36.435124    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:56:34 +0000 UTC" deadline="2028-01-14 07:23:27.85273734 +0000 UTC"
May 26 16:01:36.435313 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:36.435170    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14343h21m51.417571964s"
May 26 16:01:36.490226 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:36.489471    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:36.490226 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:36.489605    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:36.490226 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:36.490052    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:36.490226 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:36.490141    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:38.035429 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:38.035259    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:38.035887 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:38.035501    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:01:38.035887 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:38.035525    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:01:38.035887 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:38.035538    2567 projected.go:194] Error preparing data for projected volume kube-api-access-vhw6w for pod openshift-network-diagnostics/network-check-target-5dpqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:38.035887 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:38.035602    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w podName:e1586315-86d3-4140-bbde-20aeba976a6b nodeName:}" failed. No retries permitted until 2026-05-26 16:01:42.035583683 +0000 UTC m=+9.146141467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhw6w" (UniqueName: "kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w") pod "network-check-target-5dpqg" (UID: "e1586315-86d3-4140-bbde-20aeba976a6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:38.136642 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:38.136602    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:38.136823 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:38.136807    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:38.136886 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:38.136871    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs podName:4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e nodeName:}" failed. No retries permitted until 2026-05-26 16:01:42.13685116 +0000 UTC m=+9.247408936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs") pod "network-metrics-daemon-6lm2r" (UID: "4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:38.489646 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:38.489129    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:38.489646 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:38.489158    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:38.489646 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:38.489253    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:38.489646 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:38.489366    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:40.490282 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:40.489438    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:40.490282 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:40.489663    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:40.490282 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:40.489863    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:40.490282 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:40.490237    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:42.068190 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:42.068149    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:42.068622 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:42.068313    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:01:42.068622 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:42.068336    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:01:42.068622 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:42.068351    2567 projected.go:194] Error preparing data for projected volume kube-api-access-vhw6w for pod openshift-network-diagnostics/network-check-target-5dpqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:42.068622 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:42.068413    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w podName:e1586315-86d3-4140-bbde-20aeba976a6b nodeName:}" failed. No retries permitted until 2026-05-26 16:01:50.068394263 +0000 UTC m=+17.178952039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhw6w" (UniqueName: "kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w") pod "network-check-target-5dpqg" (UID: "e1586315-86d3-4140-bbde-20aeba976a6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:42.168842 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:42.168807    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:42.169082 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:42.168972    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:42.169082 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:42.169061    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs podName:4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e nodeName:}" failed. No retries permitted until 2026-05-26 16:01:50.169041892 +0000 UTC m=+17.279599672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs") pod "network-metrics-daemon-6lm2r" (UID: "4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:42.489687 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:42.489602    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:42.489837 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:42.489603    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:42.489837 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:42.489727    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:42.489941 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:42.489832    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:44.489735 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:44.489702    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:44.490222 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:44.489709    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:44.490222 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:44.489824    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:44.490222 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:44.489953    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:46.489910 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:46.489878    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:46.490381 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:46.489884    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:46.490381 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:46.490010    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:46.490381 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:46.490109    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:48.489087 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:48.489052    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:48.489500 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:48.489126    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:48.489500 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:48.489243    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:48.489500 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:48.489315    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:50.128510 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:50.128466    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:50.128932 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:50.128636    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:01:50.128932 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:50.128664    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:01:50.128932 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:50.128677    2567 projected.go:194] Error preparing data for projected volume kube-api-access-vhw6w for pod openshift-network-diagnostics/network-check-target-5dpqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:50.128932 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:50.128730    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w podName:e1586315-86d3-4140-bbde-20aeba976a6b nodeName:}" failed. No retries permitted until 2026-05-26 16:02:06.128716759 +0000 UTC m=+33.239274529 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhw6w" (UniqueName: "kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w") pod "network-check-target-5dpqg" (UID: "e1586315-86d3-4140-bbde-20aeba976a6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:50.229344 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:50.229305    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:50.229502 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:50.229470    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:50.229560 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:50.229548    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs podName:4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e nodeName:}" failed. No retries permitted until 2026-05-26 16:02:06.229524635 +0000 UTC m=+33.340082407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs") pod "network-metrics-daemon-6lm2r" (UID: "4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:01:50.489184 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:50.489108    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:50.489340 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:50.489109    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:50.489340 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:50.489237    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:50.489340 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:50.489295    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:52.489409 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:52.489353    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:52.489409 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:52.489402    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:52.489899 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:52.489501    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:52.489899 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:52.489647    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:53.679963 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:53.679900    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal" event={"ID":"c705c9c8886b8665628a0c46bc41272e","Type":"ContainerStarted","Data":"f91786427205913f95ac2455c45e509e02517bade08bb07e11ea5962080ef0d7"}
May 26 16:01:53.695817 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:53.695765    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal" podStartSLOduration=20.695751678 podStartE2EDuration="20.695751678s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:01:53.69540167 +0000 UTC m=+20.805959461" watchObservedRunningTime="2026-05-26 16:01:53.695751678 +0000 UTC m=+20.806309470"
May 26 16:01:54.489593 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.489014    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:54.489593 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:54.489335    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:54.489593 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.489028    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:54.489593 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:54.489542    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:54.682127 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.681976    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8" event={"ID":"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2","Type":"ContainerStarted","Data":"54107fa8bdc7af72caa68d76e045a3dfd16bfaa7e94dcf20b788a1a9556a01ed"}
May 26 16:01:54.683524 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.683507    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:01:54.683832 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.683808    2567 generic.go:358] "Generic (PLEG): container finished" podID="a8f8a8ec-0016-4484-8496-6813990419c8" containerID="d702a30b1ba2cd0afeaf79d51d64e0597eba44ce7c32efadeb1a1de2d08733c9" exitCode=1
May 26 16:01:54.684105 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.683875    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerStarted","Data":"beb11a3ed8374419c669092563e7f8436b3e8bfdeeb7e23a2f9acd95cfaede64"}
May 26 16:01:54.684105 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.683901    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerDied","Data":"d702a30b1ba2cd0afeaf79d51d64e0597eba44ce7c32efadeb1a1de2d08733c9"}
May 26 16:01:54.684105 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.683913    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerStarted","Data":"05c51c13b53bc5430e283af73808509778e83052ea17d6d5e73c655b2d22936a"}
May 26 16:01:54.685135 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.685116    2567 generic.go:358] "Generic (PLEG): container finished" podID="5dce97a3-a3c3-4027-8fc0-4337abb334dc" containerID="d51f5887f222b16f16882492e41532c1521a52dbef9eea29fc92b62745b15245" exitCode=0
May 26 16:01:54.685209 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.685176    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xs28" event={"ID":"5dce97a3-a3c3-4027-8fc0-4337abb334dc","Type":"ContainerDied","Data":"d51f5887f222b16f16882492e41532c1521a52dbef9eea29fc92b62745b15245"}
May 26 16:01:54.686475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.686451    2567 generic.go:358] "Generic (PLEG): container finished" podID="8abf6e6200faa03983a4f96687820b97" containerID="4ff44fa48fc1913596469856f4d6cdcd7503600073bd2705d55ea3a76fc8a056" exitCode=0
May 26 16:01:54.686632 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.686513    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal" event={"ID":"8abf6e6200faa03983a4f96687820b97","Type":"ContainerDied","Data":"4ff44fa48fc1913596469856f4d6cdcd7503600073bd2705d55ea3a76fc8a056"}
May 26 16:01:54.687849 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.687827    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5j9n9" event={"ID":"1d61634f-edec-49c7-8504-65bb9238526a","Type":"ContainerStarted","Data":"cc999b09d8a3d7e93485660383bc58a06ad3712633a09f363691a2bc3eaa2024"}
May 26 16:01:54.689234 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.689211    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z56kl" event={"ID":"a4cdf919-1a9c-4477-b7e9-1d2b553e0557","Type":"ContainerStarted","Data":"d87bebf31823c9bfe256d701f057c61170d8f919b0f04e64416d4e84efe6d715"}
May 26 16:01:54.690732 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.690713    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6p6md" event={"ID":"cbed895c-2cee-4938-92e8-823766bdf878","Type":"ContainerStarted","Data":"024a559374298645f1a8289c10851b4cc5d49451e31f6edcafaa67ba8dd0b483"}
May 26 16:01:54.691967 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.691947    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tczz9" event={"ID":"94127774-1122-4c33-a89c-0a89175d27d6","Type":"ContainerStarted","Data":"a4628a4895ab6487b697cd4c6f3e20a55529a45a284e322f399641775670c33c"}
May 26 16:01:54.693413 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.693395    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2hkb4" event={"ID":"6b69e8e5-6171-4d40-95f2-f5075947001d","Type":"ContainerStarted","Data":"d8ba6b45280235bd3e3032767fc369ce2ec398d84e2fd978dc6f0be0825c181c"}
May 26 16:01:54.722728 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.722690    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tczz9" podStartSLOduration=3.008317027 podStartE2EDuration="21.72267839s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:01:34.707651651 +0000 UTC m=+1.818209421" lastFinishedPulling="2026-05-26 16:01:53.422012999 +0000 UTC m=+20.532570784" observedRunningTime="2026-05-26 16:01:54.722453092 +0000 UTC m=+21.833010883" watchObservedRunningTime="2026-05-26 16:01:54.72267839 +0000 UTC m=+21.833236181"
May 26 16:01:54.737213 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.737168    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-5j9n9" podStartSLOduration=3.143976627 podStartE2EDuration="21.737152673s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:01:34.795513177 +0000 UTC m=+1.906070948" lastFinishedPulling="2026-05-26 16:01:53.388689211 +0000 UTC m=+20.499246994" observedRunningTime="2026-05-26 16:01:54.736974126 +0000 UTC m=+21.847531917" watchObservedRunningTime="2026-05-26 16:01:54.737152673 +0000 UTC m=+21.847710466"
May 26 16:01:54.754566 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.754068    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2hkb4" podStartSLOduration=2.889133049 podStartE2EDuration="21.754051422s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:01:34.800795449 +0000 UTC m=+1.911353219" lastFinishedPulling="2026-05-26 16:01:53.665713818 +0000 UTC m=+20.776271592" observedRunningTime="2026-05-26 16:01:54.752799625 +0000 UTC m=+21.863357431" watchObservedRunningTime="2026-05-26 16:01:54.754051422 +0000 UTC m=+21.864609214"
May 26 16:01:54.784030 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.783967    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6p6md" podStartSLOduration=3.091505132 podStartE2EDuration="21.783952819s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:01:34.727065262 +0000 UTC m=+1.837623032" lastFinishedPulling="2026-05-26 16:01:53.419512936 +0000 UTC m=+20.530070719" observedRunningTime="2026-05-26 16:01:54.783563792 +0000 UTC m=+21.894121583" watchObservedRunningTime="2026-05-26 16:01:54.783952819 +0000 UTC m=+21.894510612"
May 26 16:01:54.798495 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:54.798456    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z56kl" podStartSLOduration=3.233352978 podStartE2EDuration="21.798444167s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:01:34.78486495 +0000 UTC m=+1.895422720" lastFinishedPulling="2026-05-26 16:01:53.349956136 +0000 UTC m=+20.460513909" observedRunningTime="2026-05-26 16:01:54.798349895 +0000 UTC m=+21.908907697" watchObservedRunningTime="2026-05-26 16:01:54.798444167 +0000 UTC m=+21.909001994"
May 26 16:01:55.696263 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:55.696230    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal" event={"ID":"8abf6e6200faa03983a4f96687820b97","Type":"ContainerStarted","Data":"05cfa8c7396bd380659741616076660cf0556201052c89ca76d20ef4ef69b601"}
May 26 16:01:55.698585 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:55.698563    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:01:55.698893 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:55.698873    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerStarted","Data":"1a1b7af1b7992de49a3739252a2a59582e3c72c33ded5d89d499eddf758eb6ba"}
May 26 16:01:55.698950 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:55.698913    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerStarted","Data":"7502dd84e2b8608c99c45ab41448db2ac485b3a8b00c83254ddb566e8a68022c"}
May 26 16:01:55.698950 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:55.698929    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerStarted","Data":"082a5cb8275404759ae3315164f7a1ac1a181bfa11755dcdb52875933264f558"}
May 26 16:01:55.699937 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:55.699912    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-942gr" event={"ID":"31c83f62-4c69-4d04-af97-1c368229b2ef","Type":"ContainerStarted","Data":"3789acba00e57f84a18d08f80831f33fc26286d07ac16594eac9e2128ffd1f9d"}
May 26 16:01:55.722539 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:55.722504    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal" podStartSLOduration=22.722490465 podStartE2EDuration="22.722490465s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:01:55.709142062 +0000 UTC m=+22.819699856" watchObservedRunningTime="2026-05-26 16:01:55.722490465 +0000 UTC m=+22.833048257"
May 26 16:01:55.722765 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:55.722736    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-942gr" podStartSLOduration=4.049576432 podStartE2EDuration="22.722724192s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:01:34.748898604 +0000 UTC m=+1.859456373" lastFinishedPulling="2026-05-26 16:01:53.422046349 +0000 UTC m=+20.532604133" observedRunningTime="2026-05-26 16:01:55.72271206 +0000 UTC m=+22.833269853" watchObservedRunningTime="2026-05-26 16:01:55.722724192 +0000 UTC m=+22.833281984"
May 26 16:01:55.856327 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:55.856301    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 16:01:56.468228 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:56.468105    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T16:01:55.856322172Z","UUID":"81ee0d2d-1612-46f6-9875-111cb5370d82","Handler":null,"Name":"","Endpoint":""}
May 26 16:01:56.470187 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:56.470166    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 16:01:56.470187 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:56.470196    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 16:01:56.489110 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:56.489080    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:56.489238 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:56.489082    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:56.489238 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:56.489193    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:56.489238 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:56.489232    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:56.704048 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:56.704009    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8" event={"ID":"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2","Type":"ContainerStarted","Data":"6249ccf762b096917da16db47f6f57d89c2d3837c1c420aa3f834a9ba1c441a6"}
May 26 16:01:58.490013 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:58.489840    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:01:58.490544 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:58.489840    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:01:58.490544 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:58.490123    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:01:58.490544 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:01:58.490214    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:01:59.328832 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.328756    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:59.329286 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.329269    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:59.711981 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.711909    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:01:59.712581 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.712280    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerStarted","Data":"bd364235a02a257243a6bd9f720a95088dd43d181b92dc9d926c80195798b4f5"}
May 26 16:01:59.713762 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.713739    2567 generic.go:358] "Generic (PLEG): container finished" podID="5dce97a3-a3c3-4027-8fc0-4337abb334dc" containerID="961f76b4057c82744fa5b632a49adb9df6e2b93ac32d4d10c82a1a182784d6fb" exitCode=0
May 26 16:01:59.713881 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.713821    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xs28" event={"ID":"5dce97a3-a3c3-4027-8fc0-4337abb334dc","Type":"ContainerDied","Data":"961f76b4057c82744fa5b632a49adb9df6e2b93ac32d4d10c82a1a182784d6fb"}
May 26 16:01:59.715626 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.715607    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8" event={"ID":"1128b42b-72e5-4aee-aa1d-ca33e32cd6a2","Type":"ContainerStarted","Data":"deea8c0ee49193b0eb2210d298877d45a0b29d175d1a8bb4fba0372897f4b3f7"}
May 26 16:01:59.715794 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.715781    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:59.716251 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.716236    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z56kl"
May 26 16:01:59.767479 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:01:59.767434    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrrl8" podStartSLOduration=2.846164244 podStartE2EDuration="26.767422058s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:01:34.790026508 +0000 UTC m=+1.900584279" lastFinishedPulling="2026-05-26 16:01:58.711284309 +0000 UTC m=+25.821842093" observedRunningTime="2026-05-26 16:01:59.767233725 +0000 UTC m=+26.877791516" watchObservedRunningTime="2026-05-26 16:01:59.767422058 +0000 UTC m=+26.877979850"
May 26 16:02:00.489314 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:00.489278    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:00.489474 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:00.489330    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:02:00.489474 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:00.489422    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:02:00.489567 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:00.489494    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:02:00.718976 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:00.718943    2567 generic.go:358] "Generic (PLEG): container finished" podID="5dce97a3-a3c3-4027-8fc0-4337abb334dc" containerID="28637b93f2da242d2f14f561d790866dc7752bcb13514da5ed61a7d930f02343" exitCode=0
May 26 16:02:00.719382 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:00.719034    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xs28" event={"ID":"5dce97a3-a3c3-4027-8fc0-4337abb334dc","Type":"ContainerDied","Data":"28637b93f2da242d2f14f561d790866dc7752bcb13514da5ed61a7d930f02343"}
May 26 16:02:01.723803 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.723643    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:02:01.724270 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.724089    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerStarted","Data":"719361dfd4d6207ded99435cc1365b999441d2dd8b51973c8ee1eef88a0ab521"}
May 26 16:02:01.724432 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.724405    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:02:01.724563 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.724505    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:02:01.724563 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.724550    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:02:01.724654 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.724566    2567 scope.go:117] "RemoveContainer" containerID="d702a30b1ba2cd0afeaf79d51d64e0597eba44ce7c32efadeb1a1de2d08733c9"
May 26 16:02:01.726621 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.726599    2567 generic.go:358] "Generic (PLEG): container finished" podID="5dce97a3-a3c3-4027-8fc0-4337abb334dc" containerID="27deb603e999e234ce9117f0d8c71c8b2eb059301ce6938fd24fbe2df3ebebde" exitCode=0
May 26 16:02:01.726723 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.726684    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xs28" event={"ID":"5dce97a3-a3c3-4027-8fc0-4337abb334dc","Type":"ContainerDied","Data":"27deb603e999e234ce9117f0d8c71c8b2eb059301ce6938fd24fbe2df3ebebde"}
May 26 16:02:01.740954 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.740935    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:02:01.741090 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:01.741027    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:02:02.489361 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:02.489327    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:02:02.489517 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:02.489327    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:02.489517 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:02.489478    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:02:02.489517 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:02.489497    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:02:02.732614 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:02.732587    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:02:02.733042 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:02.732946    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" event={"ID":"a8f8a8ec-0016-4484-8496-6813990419c8","Type":"ContainerStarted","Data":"51758ec3da32f62b82f472fb528b998c3c9dbe80bbeb554c1f27a73236ec2ba4"}
May 26 16:02:02.759696 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:02.759613    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj" podStartSLOduration=10.348480594 podStartE2EDuration="29.759599204s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:01:34.769527841 +0000 UTC m=+1.880085611" lastFinishedPulling="2026-05-26 16:01:54.180646447 +0000 UTC m=+21.291204221" observedRunningTime="2026-05-26 16:02:02.758275584 +0000 UTC m=+29.868833375" watchObservedRunningTime="2026-05-26 16:02:02.759599204 +0000 UTC m=+29.870156995"
May 26 16:02:02.793110 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:02.793077    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6lm2r"]
May 26 16:02:02.793269 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:02.793192    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:02:02.793374 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:02.793349    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:02:02.793887 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:02.793863    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5dpqg"]
May 26 16:02:02.794007 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:02.793936    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:02.794055 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:02.794028    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:02:04.490017 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:04.489967    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:04.490469 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:04.489978    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:02:04.490469 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:04.490096    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:02:04.490469 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:04.490258    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:02:06.152302 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.152263    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:06.152832 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:06.152456    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:02:06.152832 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:06.152482    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:02:06.152832 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:06.152494    2567 projected.go:194] Error preparing data for projected volume kube-api-access-vhw6w for pod openshift-network-diagnostics/network-check-target-5dpqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:02:06.152832 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:06.152556    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w podName:e1586315-86d3-4140-bbde-20aeba976a6b nodeName:}" failed. No retries permitted until 2026-05-26 16:02:38.152537618 +0000 UTC m=+65.263095388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhw6w" (UniqueName: "kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w") pod "network-check-target-5dpqg" (UID: "e1586315-86d3-4140-bbde-20aeba976a6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:02:06.252737 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.252700    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:02:06.252896 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:06.252805    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:02:06.252896 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:06.252884    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs podName:4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e nodeName:}" failed. No retries permitted until 2026-05-26 16:02:38.252863924 +0000 UTC m=+65.363421704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs") pod "network-metrics-daemon-6lm2r" (UID: "4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:02:06.489366 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.489329    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:06.489475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.489364    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:02:06.489475 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:06.489463    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dpqg" podUID="e1586315-86d3-4140-bbde-20aeba976a6b"
May 26 16:02:06.489640 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:06.489615    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:02:06.721531 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.721493    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeReady"
May 26 16:02:06.721723 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.721664    2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 16:02:06.765368 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.765330    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cxzqq"]
May 26 16:02:06.815921 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.815890    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dkldm"]
May 26 16:02:06.816107 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.816085    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:06.818571 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.818547    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 16:02:06.818700 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.818553    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t9x9h\""
May 26 16:02:06.818700 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.818691    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 16:02:06.835441 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.835421    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cxzqq"]
May 26 16:02:06.835542 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.835457    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dkldm"]
May 26 16:02:06.835542 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.835454    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:06.837775 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.837753    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 16:02:06.837891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.837801    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 16:02:06.837891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.837756    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vkcq2\""
May 26 16:02:06.837891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.837830    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 16:02:06.959579 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.959549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:06.959738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.959588    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7e59530-8135-4c3d-a7f2-f525837a7ba9-config-volume\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:06.959738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.959651    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:06.959738 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.959699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e59530-8135-4c3d-a7f2-f525837a7ba9-tmp-dir\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:06.959878 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.959746    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkkgk\" (UniqueName: \"kubernetes.io/projected/97e650be-df4d-4a81-81b6-9081e889b5cb-kube-api-access-tkkgk\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:06.959878 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:06.959816    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpfrv\" (UniqueName: \"kubernetes.io/projected/a7e59530-8135-4c3d-a7f2-f525837a7ba9-kube-api-access-fpfrv\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:07.060450 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.060370    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:07.060450 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.060421    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7e59530-8135-4c3d-a7f2-f525837a7ba9-config-volume\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:07.060450 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.060447    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:07.060704 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.060470    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e59530-8135-4c3d-a7f2-f525837a7ba9-tmp-dir\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:07.060704 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.060518    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkkgk\" (UniqueName: \"kubernetes.io/projected/97e650be-df4d-4a81-81b6-9081e889b5cb-kube-api-access-tkkgk\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:07.060704 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:07.060550    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:02:07.060704 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.060554    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpfrv\" (UniqueName: \"kubernetes.io/projected/a7e59530-8135-4c3d-a7f2-f525837a7ba9-kube-api-access-fpfrv\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:07.060704 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:07.060620    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert podName:97e650be-df4d-4a81-81b6-9081e889b5cb nodeName:}" failed. No retries permitted until 2026-05-26 16:02:07.5606037 +0000 UTC m=+34.671161469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert") pod "ingress-canary-dkldm" (UID: "97e650be-df4d-4a81-81b6-9081e889b5cb") : secret "canary-serving-cert" not found
May 26 16:02:07.060949 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:07.060813    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:02:07.060949 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:07.060868    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls podName:a7e59530-8135-4c3d-a7f2-f525837a7ba9 nodeName:}" failed. No retries permitted until 2026-05-26 16:02:07.560852326 +0000 UTC m=+34.671410098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls") pod "dns-default-cxzqq" (UID: "a7e59530-8135-4c3d-a7f2-f525837a7ba9") : secret "dns-default-metrics-tls" not found
May 26 16:02:07.061078 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.060970    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e59530-8135-4c3d-a7f2-f525837a7ba9-tmp-dir\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:07.061138 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.061120    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7e59530-8135-4c3d-a7f2-f525837a7ba9-config-volume\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:07.072584 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.072558    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpfrv\" (UniqueName: \"kubernetes.io/projected/a7e59530-8135-4c3d-a7f2-f525837a7ba9-kube-api-access-fpfrv\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:07.072713 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.072676    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkkgk\" (UniqueName: \"kubernetes.io/projected/97e650be-df4d-4a81-81b6-9081e889b5cb-kube-api-access-tkkgk\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:07.564338 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.564311    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:07.564991 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:07.564348    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:07.564991 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:07.564472    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:02:07.564991 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:07.564524    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:02:07.564991 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:07.564540    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert podName:97e650be-df4d-4a81-81b6-9081e889b5cb nodeName:}" failed. No retries permitted until 2026-05-26 16:02:08.564523055 +0000 UTC m=+35.675080827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert") pod "ingress-canary-dkldm" (UID: "97e650be-df4d-4a81-81b6-9081e889b5cb") : secret "canary-serving-cert" not found
May 26 16:02:07.564991 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:07.564582    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls podName:a7e59530-8135-4c3d-a7f2-f525837a7ba9 nodeName:}" failed. No retries permitted until 2026-05-26 16:02:08.564568655 +0000 UTC m=+35.675126426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls") pod "dns-default-cxzqq" (UID: "a7e59530-8135-4c3d-a7f2-f525837a7ba9") : secret "dns-default-metrics-tls" not found
May 26 16:02:08.489088 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.489059    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:08.489354 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.489059    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:02:08.491808 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.491787    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 16:02:08.492399 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.492383    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 16:02:08.492399 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.492393    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 16:02:08.492534 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.492432    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fjs6m\""
May 26 16:02:08.492534 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.492472    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvvx5\""
May 26 16:02:08.572141 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.572113    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:08.572570 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.572150    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:08.572570 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:08.572256    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:02:08.572570 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:08.572256    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:02:08.572570 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:08.572320    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls podName:a7e59530-8135-4c3d-a7f2-f525837a7ba9 nodeName:}" failed. No retries permitted until 2026-05-26 16:02:10.572301493 +0000 UTC m=+37.682859265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls") pod "dns-default-cxzqq" (UID: "a7e59530-8135-4c3d-a7f2-f525837a7ba9") : secret "dns-default-metrics-tls" not found
May 26 16:02:08.572570 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:08.572333    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert podName:97e650be-df4d-4a81-81b6-9081e889b5cb nodeName:}" failed. No retries permitted until 2026-05-26 16:02:10.572327924 +0000 UTC m=+37.682885693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert") pod "ingress-canary-dkldm" (UID: "97e650be-df4d-4a81-81b6-9081e889b5cb") : secret "canary-serving-cert" not found
May 26 16:02:08.745098 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.745027    2567 generic.go:358] "Generic (PLEG): container finished" podID="5dce97a3-a3c3-4027-8fc0-4337abb334dc" containerID="65cd0aa8a11ac727e3b4d8d64f12ea2d2c295c39b2647c2a2cbc8e44cc4e00a7" exitCode=0
May 26 16:02:08.745098 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:08.745062    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xs28" event={"ID":"5dce97a3-a3c3-4027-8fc0-4337abb334dc","Type":"ContainerDied","Data":"65cd0aa8a11ac727e3b4d8d64f12ea2d2c295c39b2647c2a2cbc8e44cc4e00a7"}
May 26 16:02:09.749050 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:09.749019    2567 generic.go:358] "Generic (PLEG): container finished" podID="5dce97a3-a3c3-4027-8fc0-4337abb334dc" containerID="5b2cbcf8672260646afea5b03eed57f366ccc9ab8507fba591ec8d191204bffa" exitCode=0
May 26 16:02:09.749432 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:09.749073    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xs28" event={"ID":"5dce97a3-a3c3-4027-8fc0-4337abb334dc","Type":"ContainerDied","Data":"5b2cbcf8672260646afea5b03eed57f366ccc9ab8507fba591ec8d191204bffa"}
May 26 16:02:10.587804 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:10.587632    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:10.587804 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:10.587800    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:02:10.588016 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:10.587847    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:10.588016 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:10.587868    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls podName:a7e59530-8135-4c3d-a7f2-f525837a7ba9 nodeName:}" failed. No retries permitted until 2026-05-26 16:02:14.5878513 +0000 UTC m=+41.698409080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls") pod "dns-default-cxzqq" (UID: "a7e59530-8135-4c3d-a7f2-f525837a7ba9") : secret "dns-default-metrics-tls" not found
May 26 16:02:10.588016 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:10.587920    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:02:10.588016 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:10.587960    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert podName:97e650be-df4d-4a81-81b6-9081e889b5cb nodeName:}" failed. No retries permitted until 2026-05-26 16:02:14.587949384 +0000 UTC m=+41.698507154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert") pod "ingress-canary-dkldm" (UID: "97e650be-df4d-4a81-81b6-9081e889b5cb") : secret "canary-serving-cert" not found
May 26 16:02:10.754072 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:10.754041    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xs28" event={"ID":"5dce97a3-a3c3-4027-8fc0-4337abb334dc","Type":"ContainerStarted","Data":"512a37dbdae85ee8c3473dbd055e856da51c6cf4b0ccf1c8728909bf64f6da51"}
May 26 16:02:10.775498 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:10.775453    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2xs28" podStartSLOduration=4.8481098639999995 podStartE2EDuration="37.775439582s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:01:34.744833698 +0000 UTC m=+1.855391474" lastFinishedPulling="2026-05-26 16:02:07.672163407 +0000 UTC m=+34.782721192" observedRunningTime="2026-05-26 16:02:10.77422493 +0000 UTC m=+37.884782721" watchObservedRunningTime="2026-05-26 16:02:10.775439582 +0000 UTC m=+37.885997374"
May 26 16:02:14.614276 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:14.614240    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:14.614276 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:14.614284    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:14.614656 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:14.614376    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:02:14.614656 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:14.614392    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:02:14.614656 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:14.614427    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls podName:a7e59530-8135-4c3d-a7f2-f525837a7ba9 nodeName:}" failed. No retries permitted until 2026-05-26 16:02:22.61441234 +0000 UTC m=+49.724970111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls") pod "dns-default-cxzqq" (UID: "a7e59530-8135-4c3d-a7f2-f525837a7ba9") : secret "dns-default-metrics-tls" not found
May 26 16:02:14.614656 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:14.614440    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert podName:97e650be-df4d-4a81-81b6-9081e889b5cb nodeName:}" failed. No retries permitted until 2026-05-26 16:02:22.61443387 +0000 UTC m=+49.724991640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert") pod "ingress-canary-dkldm" (UID: "97e650be-df4d-4a81-81b6-9081e889b5cb") : secret "canary-serving-cert" not found
May 26 16:02:22.663788 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:22.663743    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:22.664242 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:22.663800    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:22.664242 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:22.663898    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:02:22.664242 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:22.663925    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:02:22.664242 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:22.663962    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert podName:97e650be-df4d-4a81-81b6-9081e889b5cb nodeName:}" failed. No retries permitted until 2026-05-26 16:02:38.663946382 +0000 UTC m=+65.774504162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert") pod "ingress-canary-dkldm" (UID: "97e650be-df4d-4a81-81b6-9081e889b5cb") : secret "canary-serving-cert" not found
May 26 16:02:22.664242 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:22.664015    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls podName:a7e59530-8135-4c3d-a7f2-f525837a7ba9 nodeName:}" failed. No retries permitted until 2026-05-26 16:02:38.663975228 +0000 UTC m=+65.774533004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls") pod "dns-default-cxzqq" (UID: "a7e59530-8135-4c3d-a7f2-f525837a7ba9") : secret "dns-default-metrics-tls" not found
May 26 16:02:33.744727 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:33.744700    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mczj"
May 26 16:02:38.167095 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.167063    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:38.169837 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.169815    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 16:02:38.179524 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.179500    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 16:02:38.191244 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.191219    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhw6w\" (UniqueName: \"kubernetes.io/projected/e1586315-86d3-4140-bbde-20aeba976a6b-kube-api-access-vhw6w\") pod \"network-check-target-5dpqg\" (UID: \"e1586315-86d3-4140-bbde-20aeba976a6b\") " pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:38.200907 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.200885    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvvx5\""
May 26 16:02:38.209623 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.209608    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:38.267589 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.267556    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:02:38.270030 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.270008    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 16:02:38.278044 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:38.278027    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 16:02:38.278139 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:38.278107    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs podName:4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e nodeName:}" failed. No retries permitted until 2026-05-26 16:03:42.278085004 +0000 UTC m=+129.388642777 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs") pod "network-metrics-daemon-6lm2r" (UID: "4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e") : secret "metrics-daemon-secret" not found
May 26 16:02:38.392850 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.392820    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5dpqg"]
May 26 16:02:38.396307 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:02:38.396280    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1586315_86d3_4140_bbde_20aeba976a6b.slice/crio-a4cb6812fc8dd0ec4b4b96709db59f98bbd9846e4e9e447d88e215c53057dd10 WatchSource:0}: Error finding container a4cb6812fc8dd0ec4b4b96709db59f98bbd9846e4e9e447d88e215c53057dd10: Status 404 returned error can't find the container with id a4cb6812fc8dd0ec4b4b96709db59f98bbd9846e4e9e447d88e215c53057dd10
May 26 16:02:38.670946 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.670918    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:02:38.671114 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.670954    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:02:38.671114 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:38.671067    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:02:38.671114 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:38.671069    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:02:38.671211 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:38.671120    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert podName:97e650be-df4d-4a81-81b6-9081e889b5cb nodeName:}" failed. No retries permitted until 2026-05-26 16:03:10.671105421 +0000 UTC m=+97.781663192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert") pod "ingress-canary-dkldm" (UID: "97e650be-df4d-4a81-81b6-9081e889b5cb") : secret "canary-serving-cert" not found
May 26 16:02:38.671211 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:02:38.671136    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls podName:a7e59530-8135-4c3d-a7f2-f525837a7ba9 nodeName:}" failed. No retries permitted until 2026-05-26 16:03:10.671128035 +0000 UTC m=+97.781685805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls") pod "dns-default-cxzqq" (UID: "a7e59530-8135-4c3d-a7f2-f525837a7ba9") : secret "dns-default-metrics-tls" not found
May 26 16:02:38.808435 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:38.808398    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5dpqg" event={"ID":"e1586315-86d3-4140-bbde-20aeba976a6b","Type":"ContainerStarted","Data":"a4cb6812fc8dd0ec4b4b96709db59f98bbd9846e4e9e447d88e215c53057dd10"}
May 26 16:02:41.815437 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:41.815399    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5dpqg" event={"ID":"e1586315-86d3-4140-bbde-20aeba976a6b","Type":"ContainerStarted","Data":"c6501d8bf0bd67a810909b271216811331bb6126148c3d94a01d5d41fe7e3df6"}
May 26 16:02:41.815882 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:41.815525    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:02:41.830225 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:02:41.830178    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5dpqg" podStartSLOduration=65.893495548 podStartE2EDuration="1m8.830166684s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:02:38.398618079 +0000 UTC m=+65.509175850" lastFinishedPulling="2026-05-26 16:02:41.335289214 +0000 UTC m=+68.445846986" observedRunningTime="2026-05-26 16:02:41.828984456 +0000 UTC m=+68.939542248" watchObservedRunningTime="2026-05-26 16:02:41.830166684 +0000 UTC m=+68.940724476"
May 26 16:03:10.677783 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:10.677732    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:03:10.678329 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:10.677811    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:03:10.678329 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:10.677885    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:03:10.678329 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:10.677934    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert podName:97e650be-df4d-4a81-81b6-9081e889b5cb nodeName:}" failed. No retries permitted until 2026-05-26 16:04:14.677919657 +0000 UTC m=+161.788477427 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert") pod "ingress-canary-dkldm" (UID: "97e650be-df4d-4a81-81b6-9081e889b5cb") : secret "canary-serving-cert" not found
May 26 16:03:10.678329 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:10.677884    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:03:10.678329 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:10.678033    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls podName:a7e59530-8135-4c3d-a7f2-f525837a7ba9 nodeName:}" failed. No retries permitted until 2026-05-26 16:04:14.678017956 +0000 UTC m=+161.788575729 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls") pod "dns-default-cxzqq" (UID: "a7e59530-8135-4c3d-a7f2-f525837a7ba9") : secret "dns-default-metrics-tls" not found
May 26 16:03:12.819331 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:12.819298    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5dpqg"
May 26 16:03:42.285136 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:42.285094    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:03:42.285608 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:42.285236    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 16:03:42.285608 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:42.285314    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs podName:4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e nodeName:}" failed. No retries permitted until 2026-05-26 16:05:44.285296997 +0000 UTC m=+251.395854766 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs") pod "network-metrics-daemon-6lm2r" (UID: "4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e") : secret "metrics-daemon-secret" not found
May 26 16:03:45.691501 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.691467    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"]
May 26 16:03:45.694375 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.694354    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:45.696916 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.696884    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 26 16:03:45.697067 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.696984    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wb4zd\""
May 26 16:03:45.697229 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.697211    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 26 16:03:45.697369 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.697352    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 26 16:03:45.705273 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.705250    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"]
May 26 16:03:45.789305 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.789268    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd"]
May 26 16:03:45.791899 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.791883    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd"
May 26 16:03:45.794238 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.794211    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tnlcs\""
May 26 16:03:45.794369 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.794238    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 26 16:03:45.794369 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.794342    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 26 16:03:45.799475 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.799453    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd"]
May 26 16:03:45.811168 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.811146    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:45.811261 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.811187    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzf4\" (UniqueName: \"kubernetes.io/projected/6c451891-d799-48bf-b0ec-64979b36f50c-kube-api-access-ckzf4\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:45.892886 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.892853    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"]
May 26 16:03:45.895637 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.895620    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:45.897928 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.897905    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 26 16:03:45.898166 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.898150    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 26 16:03:45.898290 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.898268    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-r4vdb\""
May 26 16:03:45.898636 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.898620    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 26 16:03:45.898956 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.898936    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 26 16:03:45.900377 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.900354    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fd8bbc449-f82vg"]
May 26 16:03:45.903017 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.902983    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:45.905263 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.905244    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 16:03:45.905463 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.905448    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 16:03:45.905557 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.905449    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q98vj\""
May 26 16:03:45.905557 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.905516    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 16:03:45.908328 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.908309    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"]
May 26 16:03:45.911547 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.911524    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzf4\" (UniqueName: \"kubernetes.io/projected/6c451891-d799-48bf-b0ec-64979b36f50c-kube-api-access-ckzf4\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:45.911689 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.911650    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:45.911755 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.911718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbh9q\" (UniqueName: \"kubernetes.io/projected/15f6460a-e59e-4fec-bb58-a67ff23fb47f-kube-api-access-pbh9q\") pod \"volume-data-source-validator-5cf8c89d64-c86qd\" (UID: \"15f6460a-e59e-4fec-bb58-a67ff23fb47f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd"
May 26 16:03:45.911829 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:45.911806    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 16:03:45.911920 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:45.911909    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls podName:6c451891-d799-48bf-b0ec-64979b36f50c nodeName:}" failed. No retries permitted until 2026-05-26 16:03:46.411883771 +0000 UTC m=+133.522441554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls") pod "cluster-samples-operator-697587599-xzjlm" (UID: "6c451891-d799-48bf-b0ec-64979b36f50c") : secret "samples-operator-tls" not found
May 26 16:03:45.912401 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.912384    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 16:03:45.917182 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.917160    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd8bbc449-f82vg"]
May 26 16:03:45.929984 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:45.929963    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzf4\" (UniqueName: \"kubernetes.io/projected/6c451891-d799-48bf-b0ec-64979b36f50c-kube-api-access-ckzf4\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:46.012904 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.012880    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbh9q\" (UniqueName: \"kubernetes.io/projected/15f6460a-e59e-4fec-bb58-a67ff23fb47f-kube-api-access-pbh9q\") pod \"volume-data-source-validator-5cf8c89d64-c86qd\" (UID: \"15f6460a-e59e-4fec-bb58-a67ff23fb47f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd"
May 26 16:03:46.013116 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.012915    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b66e3c90-b65a-4101-b103-487d5b168a2c-serving-cert\") pod \"service-ca-operator-57b5b68b8-2n554\" (UID: \"b66e3c90-b65a-4101-b103-487d5b168a2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.013116 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.012934    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-bound-sa-token\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.013116 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.012954    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fw88\" (UniqueName: \"kubernetes.io/projected/b66e3c90-b65a-4101-b103-487d5b168a2c-kube-api-access-5fw88\") pod \"service-ca-operator-57b5b68b8-2n554\" (UID: \"b66e3c90-b65a-4101-b103-487d5b168a2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.013116 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.013027    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.013116 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.013070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-installation-pull-secrets\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.013361 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.013142    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-image-registry-private-configuration\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.013361 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.013180    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-ca-trust-extracted\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.013361 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.013230    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-certificates\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.013361 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.013262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tmzp\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-kube-api-access-8tmzp\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.013361 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.013325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b66e3c90-b65a-4101-b103-487d5b168a2c-config\") pod \"service-ca-operator-57b5b68b8-2n554\" (UID: \"b66e3c90-b65a-4101-b103-487d5b168a2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.013361 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.013343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-trusted-ca\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.021412 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.021393    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbh9q\" (UniqueName: \"kubernetes.io/projected/15f6460a-e59e-4fec-bb58-a67ff23fb47f-kube-api-access-pbh9q\") pod \"volume-data-source-validator-5cf8c89d64-c86qd\" (UID: \"15f6460a-e59e-4fec-bb58-a67ff23fb47f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd"
May 26 16:03:46.101339 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.101293    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd"
May 26 16:03:46.114293 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114261    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-certificates\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.114403 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114305    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tmzp\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-kube-api-access-8tmzp\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.114403 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114351    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b66e3c90-b65a-4101-b103-487d5b168a2c-config\") pod \"service-ca-operator-57b5b68b8-2n554\" (UID: \"b66e3c90-b65a-4101-b103-487d5b168a2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.114403 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114379    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-trusted-ca\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.114556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114448    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b66e3c90-b65a-4101-b103-487d5b168a2c-serving-cert\") pod \"service-ca-operator-57b5b68b8-2n554\" (UID: \"b66e3c90-b65a-4101-b103-487d5b168a2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.114556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114474    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-bound-sa-token\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.114556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114505    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fw88\" (UniqueName: \"kubernetes.io/projected/b66e3c90-b65a-4101-b103-487d5b168a2c-kube-api-access-5fw88\") pod \"service-ca-operator-57b5b68b8-2n554\" (UID: \"b66e3c90-b65a-4101-b103-487d5b168a2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.114556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114532    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.114763 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114556    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-installation-pull-secrets\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.114763 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114601    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-image-registry-private-configuration\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.114763 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114631    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-ca-trust-extracted\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.114763 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:46.114756    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:03:46.114967 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:46.114776    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd8bbc449-f82vg: secret "image-registry-tls" not found
May 26 16:03:46.114967 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:46.114831    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls podName:6c2fe1b0-a9fc-4b74-9a78-82070ff232bc nodeName:}" failed. No retries permitted until 2026-05-26 16:03:46.614811763 +0000 UTC m=+133.725369534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls") pod "image-registry-7fd8bbc449-f82vg" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc") : secret "image-registry-tls" not found
May 26 16:03:46.115109 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.114979    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-certificates\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.115109 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.115034    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b66e3c90-b65a-4101-b103-487d5b168a2c-config\") pod \"service-ca-operator-57b5b68b8-2n554\" (UID: \"b66e3c90-b65a-4101-b103-487d5b168a2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.115214 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.115139    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-ca-trust-extracted\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.115343 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.115325    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-trusted-ca\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.117281 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.117262    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-installation-pull-secrets\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.117389 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.117322    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b66e3c90-b65a-4101-b103-487d5b168a2c-serving-cert\") pod \"service-ca-operator-57b5b68b8-2n554\" (UID: \"b66e3c90-b65a-4101-b103-487d5b168a2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.117389 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.117353    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-image-registry-private-configuration\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.123484 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.123463    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-bound-sa-token\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.124396 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.124367    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fw88\" (UniqueName: \"kubernetes.io/projected/b66e3c90-b65a-4101-b103-487d5b168a2c-kube-api-access-5fw88\") pod \"service-ca-operator-57b5b68b8-2n554\" (UID: \"b66e3c90-b65a-4101-b103-487d5b168a2c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.125180 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.125158    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tmzp\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-kube-api-access-8tmzp\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.205349 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.205320    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"
May 26 16:03:46.242542 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.242512    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd"]
May 26 16:03:46.245077 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:03:46.245052    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f6460a_e59e_4fec_bb58_a67ff23fb47f.slice/crio-debf9dfa166f07ae64952470289210be35523ab6686ab413e9aa45765ce97990 WatchSource:0}: Error finding container debf9dfa166f07ae64952470289210be35523ab6686ab413e9aa45765ce97990: Status 404 returned error can't find the container with id debf9dfa166f07ae64952470289210be35523ab6686ab413e9aa45765ce97990
May 26 16:03:46.323078 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.323048    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554"]
May 26 16:03:46.326647 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:03:46.326624    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66e3c90_b65a_4101_b103_487d5b168a2c.slice/crio-e23170dfcadd21ccb47284b200c7c70294b504a80cf8572fa83d0c004e283212 WatchSource:0}: Error finding container e23170dfcadd21ccb47284b200c7c70294b504a80cf8572fa83d0c004e283212: Status 404 returned error can't find the container with id e23170dfcadd21ccb47284b200c7c70294b504a80cf8572fa83d0c004e283212
May 26 16:03:46.417194 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.417153    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:46.417367 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:46.417315    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 16:03:46.417410 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:46.417398    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls podName:6c451891-d799-48bf-b0ec-64979b36f50c nodeName:}" failed. No retries permitted until 2026-05-26 16:03:47.417370194 +0000 UTC m=+134.527927964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls") pod "cluster-samples-operator-697587599-xzjlm" (UID: "6c451891-d799-48bf-b0ec-64979b36f50c") : secret "samples-operator-tls" not found
May 26 16:03:46.618121 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.618025    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:46.618263 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:46.618184    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:03:46.618263 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:46.618201    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd8bbc449-f82vg: secret "image-registry-tls" not found
May 26 16:03:46.618263 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:46.618255    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls podName:6c2fe1b0-a9fc-4b74-9a78-82070ff232bc nodeName:}" failed. No retries permitted until 2026-05-26 16:03:47.618238042 +0000 UTC m=+134.728795832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls") pod "image-registry-7fd8bbc449-f82vg" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc") : secret "image-registry-tls" not found
May 26 16:03:46.929745 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.929658    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554" event={"ID":"b66e3c90-b65a-4101-b103-487d5b168a2c","Type":"ContainerStarted","Data":"e23170dfcadd21ccb47284b200c7c70294b504a80cf8572fa83d0c004e283212"}
May 26 16:03:46.930753 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:46.930725    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd" event={"ID":"15f6460a-e59e-4fec-bb58-a67ff23fb47f","Type":"ContainerStarted","Data":"debf9dfa166f07ae64952470289210be35523ab6686ab413e9aa45765ce97990"}
May 26 16:03:47.426355 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:47.426317    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:47.426502 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:47.426464    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 16:03:47.426571 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:47.426531    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls podName:6c451891-d799-48bf-b0ec-64979b36f50c nodeName:}" failed. No retries permitted until 2026-05-26 16:03:49.426516156 +0000 UTC m=+136.537073925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls") pod "cluster-samples-operator-697587599-xzjlm" (UID: "6c451891-d799-48bf-b0ec-64979b36f50c") : secret "samples-operator-tls" not found
May 26 16:03:47.628212 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:47.628163    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:47.628494 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:47.628337    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:03:47.628494 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:47.628365    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd8bbc449-f82vg: secret "image-registry-tls" not found
May 26 16:03:47.628494 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:47.628444    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls podName:6c2fe1b0-a9fc-4b74-9a78-82070ff232bc nodeName:}" failed. No retries permitted until 2026-05-26 16:03:49.628421294 +0000 UTC m=+136.738979089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls") pod "image-registry-7fd8bbc449-f82vg" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc") : secret "image-registry-tls" not found
May 26 16:03:47.933973 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:47.933932    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd" event={"ID":"15f6460a-e59e-4fec-bb58-a67ff23fb47f","Type":"ContainerStarted","Data":"59907fee38807c6429d7ce622eecc07094b71f01a1125bddb3f28774031255e2"}
May 26 16:03:47.948914 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:47.948824    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-c86qd" podStartSLOduration=1.501157 podStartE2EDuration="2.948806644s" podCreationTimestamp="2026-05-26 16:03:45 +0000 UTC" firstStartedPulling="2026-05-26 16:03:46.247024759 +0000 UTC m=+133.357582546" lastFinishedPulling="2026-05-26 16:03:47.69467442 +0000 UTC m=+134.805232190" observedRunningTime="2026-05-26 16:03:47.948435636 +0000 UTC m=+135.058993429" watchObservedRunningTime="2026-05-26 16:03:47.948806644 +0000 UTC m=+135.059364437"
May 26 16:03:48.937515 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:48.937475    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554" event={"ID":"b66e3c90-b65a-4101-b103-487d5b168a2c","Type":"ContainerStarted","Data":"fe7ee711c0b5ae91cad2503aa2608b2e606a89615105e63edf976b74cca1c44e"}
May 26 16:03:48.953549 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:48.953499    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554" podStartSLOduration=1.970308686 podStartE2EDuration="3.953485774s" podCreationTimestamp="2026-05-26 16:03:45 +0000 UTC" firstStartedPulling="2026-05-26 16:03:46.328402531 +0000 UTC m=+133.438960300" lastFinishedPulling="2026-05-26 16:03:48.311579603 +0000 UTC m=+135.422137388" observedRunningTime="2026-05-26 16:03:48.953328766 +0000 UTC m=+136.063886575" watchObservedRunningTime="2026-05-26 16:03:48.953485774 +0000 UTC m=+136.064043565"
May 26 16:03:49.445009 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:49.444956    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:49.445198 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:49.445125    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 16:03:49.445198 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:49.445191    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls podName:6c451891-d799-48bf-b0ec-64979b36f50c nodeName:}" failed. No retries permitted until 2026-05-26 16:03:53.445175617 +0000 UTC m=+140.555733387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls") pod "cluster-samples-operator-697587599-xzjlm" (UID: "6c451891-d799-48bf-b0ec-64979b36f50c") : secret "samples-operator-tls" not found
May 26 16:03:49.646168 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:49.646125    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:49.646323 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:49.646246    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:03:49.646323 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:49.646257    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd8bbc449-f82vg: secret "image-registry-tls" not found
May 26 16:03:49.646323 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:49.646305    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls podName:6c2fe1b0-a9fc-4b74-9a78-82070ff232bc nodeName:}" failed. No retries permitted until 2026-05-26 16:03:53.646291586 +0000 UTC m=+140.756849355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls") pod "image-registry-7fd8bbc449-f82vg" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc") : secret "image-registry-tls" not found
May 26 16:03:50.748644 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:50.748605    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn"]
May 26 16:03:50.751695 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:50.751679    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn"
May 26 16:03:50.754125 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:50.753963    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 26 16:03:50.754125 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:50.754007    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wgtcn\""
May 26 16:03:50.754793 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:50.754778    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 26 16:03:50.761109 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:50.761086    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn"]
May 26 16:03:50.855855 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:50.855822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5kgg\" (UniqueName: \"kubernetes.io/projected/79b8627f-00c5-4c1d-8bcc-0437b77ef736-kube-api-access-x5kgg\") pod \"migrator-b985f5d89-xfqrn\" (UID: \"79b8627f-00c5-4c1d-8bcc-0437b77ef736\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn"
May 26 16:03:50.956264 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:50.956232    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5kgg\" (UniqueName: \"kubernetes.io/projected/79b8627f-00c5-4c1d-8bcc-0437b77ef736-kube-api-access-x5kgg\") pod \"migrator-b985f5d89-xfqrn\" (UID: \"79b8627f-00c5-4c1d-8bcc-0437b77ef736\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn"
May 26 16:03:50.964552 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:50.964527    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5kgg\" (UniqueName: \"kubernetes.io/projected/79b8627f-00c5-4c1d-8bcc-0437b77ef736-kube-api-access-x5kgg\") pod \"migrator-b985f5d89-xfqrn\" (UID: \"79b8627f-00c5-4c1d-8bcc-0437b77ef736\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn"
May 26 16:03:51.060918 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:51.060819    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn"
May 26 16:03:51.177345 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:51.177315    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn"]
May 26 16:03:51.180324 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:03:51.180283    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b8627f_00c5_4c1d_8bcc_0437b77ef736.slice/crio-4d1b37deda27091a1408d725fb7d7051cb9278f10a8e64033ab97422c531eac2 WatchSource:0}: Error finding container 4d1b37deda27091a1408d725fb7d7051cb9278f10a8e64033ab97422c531eac2: Status 404 returned error can't find the container with id 4d1b37deda27091a1408d725fb7d7051cb9278f10a8e64033ab97422c531eac2
May 26 16:03:51.944675 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:51.944635    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn" event={"ID":"79b8627f-00c5-4c1d-8bcc-0437b77ef736","Type":"ContainerStarted","Data":"4d1b37deda27091a1408d725fb7d7051cb9278f10a8e64033ab97422c531eac2"}
May 26 16:03:52.163224 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:52.163199    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5j9n9_1d61634f-edec-49c7-8504-65bb9238526a/dns-node-resolver/0.log"
May 26 16:03:52.950552 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:52.950462    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn" event={"ID":"79b8627f-00c5-4c1d-8bcc-0437b77ef736","Type":"ContainerStarted","Data":"ebd47dc1ccfdc79ef2d0ccd52c01bc5f8672a668c0fefd8c606f631f36a27d59"}
May 26 16:03:52.950552 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:52.950508    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn" event={"ID":"79b8627f-00c5-4c1d-8bcc-0437b77ef736","Type":"ContainerStarted","Data":"2c6704d2d0f13377783d460cf31218eac3ef65483bb38d17248079ee34c04f1f"}
May 26 16:03:52.966660 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:52.966622    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-xfqrn" podStartSLOduration=1.668135075 podStartE2EDuration="2.96661017s" podCreationTimestamp="2026-05-26 16:03:50 +0000 UTC" firstStartedPulling="2026-05-26 16:03:51.182129507 +0000 UTC m=+138.292687277" lastFinishedPulling="2026-05-26 16:03:52.480604594 +0000 UTC m=+139.591162372" observedRunningTime="2026-05-26 16:03:52.965957384 +0000 UTC m=+140.076515167" watchObservedRunningTime="2026-05-26 16:03:52.96661017 +0000 UTC m=+140.077167961"
May 26 16:03:53.162649 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:53.162625    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6p6md_cbed895c-2cee-4938-92e8-823766bdf878/node-ca/0.log"
May 26 16:03:53.473906 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:53.473877    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:03:53.474097 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:53.474045    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 16:03:53.474142 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:53.474113    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls podName:6c451891-d799-48bf-b0ec-64979b36f50c nodeName:}" failed. No retries permitted until 2026-05-26 16:04:01.474094721 +0000 UTC m=+148.584652490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls") pod "cluster-samples-operator-697587599-xzjlm" (UID: "6c451891-d799-48bf-b0ec-64979b36f50c") : secret "samples-operator-tls" not found
May 26 16:03:53.675670 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:03:53.675635    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:03:53.675820 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:53.675753    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:03:53.675820 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:53.675765    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd8bbc449-f82vg: secret "image-registry-tls" not found
May 26 16:03:53.675820 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:03:53.675816    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls podName:6c2fe1b0-a9fc-4b74-9a78-82070ff232bc nodeName:}" failed. No retries permitted until 2026-05-26 16:04:01.675800162 +0000 UTC m=+148.786357932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls") pod "image-registry-7fd8bbc449-f82vg" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc") : secret "image-registry-tls" not found
May 26 16:04:01.531101 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.531037    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:04:01.533436 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.533416    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c451891-d799-48bf-b0ec-64979b36f50c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xzjlm\" (UID: \"6c451891-d799-48bf-b0ec-64979b36f50c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:04:01.605372 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.605328    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"
May 26 16:04:01.721329 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.721300    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm"]
May 26 16:04:01.733461 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.733431    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:04:01.735504 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.735481    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") pod \"image-registry-7fd8bbc449-f82vg\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") " pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:04:01.813302 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.813234    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:04:01.931891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.931862    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd8bbc449-f82vg"]
May 26 16:04:01.934563 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:01.934537    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2fe1b0_a9fc_4b74_9a78_82070ff232bc.slice/crio-d3716aa803e5b143a424bb87e55a55ab0e2c7e0664a72b9a70546137f61dbcdf WatchSource:0}: Error finding container d3716aa803e5b143a424bb87e55a55ab0e2c7e0664a72b9a70546137f61dbcdf: Status 404 returned error can't find the container with id d3716aa803e5b143a424bb87e55a55ab0e2c7e0664a72b9a70546137f61dbcdf
May 26 16:04:01.974619 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.974223    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg" event={"ID":"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc","Type":"ContainerStarted","Data":"d3716aa803e5b143a424bb87e55a55ab0e2c7e0664a72b9a70546137f61dbcdf"}
May 26 16:04:01.975599 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:01.975576    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm" event={"ID":"6c451891-d799-48bf-b0ec-64979b36f50c","Type":"ContainerStarted","Data":"42fd980bd5341c630798eb64ea4610c8a305f0e134ea52dc386c3ea1aa9e79c2"}
May 26 16:04:02.978947 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:02.978896    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg" event={"ID":"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc","Type":"ContainerStarted","Data":"95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108"}
May 26 16:04:02.979389 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:02.979159    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:04:02.997018 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:02.996963    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg" podStartSLOduration=17.996950409 podStartE2EDuration="17.996950409s" podCreationTimestamp="2026-05-26 16:03:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:04:02.995894852 +0000 UTC m=+150.106452635" watchObservedRunningTime="2026-05-26 16:04:02.996950409 +0000 UTC m=+150.107508233"
May 26 16:04:03.982946 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:03.982914    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm" event={"ID":"6c451891-d799-48bf-b0ec-64979b36f50c","Type":"ContainerStarted","Data":"0b70426c5987567931f4154cba44470aee818bdfcf64bbef0cf3a5932dee0a52"}
May 26 16:04:03.983387 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:03.982954    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm" event={"ID":"6c451891-d799-48bf-b0ec-64979b36f50c","Type":"ContainerStarted","Data":"4553273da57d750f40d607fe7d9c4997faf7ddd8b1d1a47c9c74ead2fd55d5cf"}
May 26 16:04:04.001149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:04.001105    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xzjlm" podStartSLOduration=17.282080811 podStartE2EDuration="19.001090809s" podCreationTimestamp="2026-05-26 16:03:45 +0000 UTC" firstStartedPulling="2026-05-26 16:04:01.762116866 +0000 UTC m=+148.872674635" lastFinishedPulling="2026-05-26 16:04:03.481126851 +0000 UTC m=+150.591684633" observedRunningTime="2026-05-26 16:04:04.000323153 +0000 UTC m=+151.110880970" watchObservedRunningTime="2026-05-26 16:04:04.001090809 +0000 UTC m=+151.111648612"
May 26 16:04:09.827174 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:09.827114    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cxzqq" podUID="a7e59530-8135-4c3d-a7f2-f525837a7ba9"
May 26 16:04:09.845382 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:09.845349    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-dkldm" podUID="97e650be-df4d-4a81-81b6-9081e889b5cb"
May 26 16:04:09.996797 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:09.996762    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:04:09.996978 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:09.996763    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cxzqq"
May 26 16:04:11.503026 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:11.502975    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6lm2r" podUID="4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e"
May 26 16:04:14.080712 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.080682    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c8vfk"]
May 26 16:04:14.085057 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.085041    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.087990 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.087967    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7shss\""
May 26 16:04:14.088125 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.088025    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 16:04:14.088943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.088917    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 16:04:14.089061 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.088942    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 16:04:14.089061 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.088979    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 16:04:14.099729 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.099706    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c8vfk"]
May 26 16:04:14.115122 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.115101    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-fxjwv"]
May 26 16:04:14.118191 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.118172    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-fxjwv"
May 26 16:04:14.120376 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.120354    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54bcd\" (UniqueName: \"kubernetes.io/projected/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-kube-api-access-54bcd\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.120472 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.120414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-data-volume\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.120516 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.120479    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-crio-socket\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.120516 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.120502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.120624 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.120525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.120624 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.120594    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 16:04:14.120784 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.120770    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hbkcx\""
May 26 16:04:14.120851 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.120837    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 16:04:14.126770 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.126751    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fd8bbc449-f82vg"]
May 26 16:04:14.137153 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.137130    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-fxjwv"]
May 26 16:04:14.221776 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.221738    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54bcd\" (UniqueName: \"kubernetes.io/projected/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-kube-api-access-54bcd\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.221951 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.221807    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-data-volume\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.221951 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.221925    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkjk\" (UniqueName: \"kubernetes.io/projected/218941f9-9f6b-4222-a147-240b78053057-kube-api-access-xpkjk\") pod \"downloads-57bd96b888-fxjwv\" (UID: \"218941f9-9f6b-4222-a147-240b78053057\") " pod="openshift-console/downloads-57bd96b888-fxjwv"
May 26 16:04:14.222118 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.221974    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-crio-socket\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.222118 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.222012    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.222118 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.222072    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-crio-socket\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.222118 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.222116    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.222335 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.222170    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-data-volume\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.223276 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.223254    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.224558 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.224532    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.230281 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.230260    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54bcd\" (UniqueName: \"kubernetes.io/projected/b72063e5-bd6f-4255-8bf4-696aa1e2cb6d-kube-api-access-54bcd\") pod \"insights-runtime-extractor-c8vfk\" (UID: \"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d\") " pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.322637 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.322606    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkjk\" (UniqueName: \"kubernetes.io/projected/218941f9-9f6b-4222-a147-240b78053057-kube-api-access-xpkjk\") pod \"downloads-57bd96b888-fxjwv\" (UID: \"218941f9-9f6b-4222-a147-240b78053057\") " pod="openshift-console/downloads-57bd96b888-fxjwv"
May 26 16:04:14.333839 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.333781    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkjk\" (UniqueName: \"kubernetes.io/projected/218941f9-9f6b-4222-a147-240b78053057-kube-api-access-xpkjk\") pod \"downloads-57bd96b888-fxjwv\" (UID: \"218941f9-9f6b-4222-a147-240b78053057\") " pod="openshift-console/downloads-57bd96b888-fxjwv"
May 26 16:04:14.393744 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.393719    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c8vfk"
May 26 16:04:14.428028 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.427984    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-fxjwv"
May 26 16:04:14.520933 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.520894    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c8vfk"]
May 26 16:04:14.524743 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:14.524715    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72063e5_bd6f_4255_8bf4_696aa1e2cb6d.slice/crio-fe7b0177d463318c4c783271eb0a7c085e8b7bab78f0d0ad828ae11bd0c1b3ba WatchSource:0}: Error finding container fe7b0177d463318c4c783271eb0a7c085e8b7bab78f0d0ad828ae11bd0c1b3ba: Status 404 returned error can't find the container with id fe7b0177d463318c4c783271eb0a7c085e8b7bab78f0d0ad828ae11bd0c1b3ba
May 26 16:04:14.570394 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.570368    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-fxjwv"]
May 26 16:04:14.574638 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:14.574613    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218941f9_9f6b_4222_a147_240b78053057.slice/crio-940304548b44d70270b4b10422335c6500ce889b11b39d044487696f787f347f WatchSource:0}: Error finding container 940304548b44d70270b4b10422335c6500ce889b11b39d044487696f787f347f: Status 404 returned error can't find the container with id 940304548b44d70270b4b10422335c6500ce889b11b39d044487696f787f347f
May 26 16:04:14.725858 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.725820    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:04:14.726057 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.725868    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:04:14.728487 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.728462    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7e59530-8135-4c3d-a7f2-f525837a7ba9-metrics-tls\") pod \"dns-default-cxzqq\" (UID: \"a7e59530-8135-4c3d-a7f2-f525837a7ba9\") " pod="openshift-dns/dns-default-cxzqq"
May 26 16:04:14.728626 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.728608    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e650be-df4d-4a81-81b6-9081e889b5cb-cert\") pod \"ingress-canary-dkldm\" (UID: \"97e650be-df4d-4a81-81b6-9081e889b5cb\") " pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:04:14.799874 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.799842    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vkcq2\""
May 26 16:04:14.800052 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.799923    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t9x9h\""
May 26 16:04:14.807930 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.807913    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cxzqq"
May 26 16:04:14.808062 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.808046    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dkldm"
May 26 16:04:14.936683 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.936656    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cxzqq"]
May 26 16:04:14.939358 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:14.939330    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e59530_8135_4c3d_a7f2_f525837a7ba9.slice/crio-08597e9a9a648f951f32a021f03e79b97b5f3ae11b2610ebf756271e05313ea7 WatchSource:0}: Error finding container 08597e9a9a648f951f32a021f03e79b97b5f3ae11b2610ebf756271e05313ea7: Status 404 returned error can't find the container with id 08597e9a9a648f951f32a021f03e79b97b5f3ae11b2610ebf756271e05313ea7
May 26 16:04:14.951793 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:14.951772    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dkldm"]
May 26 16:04:14.954310 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:14.954285    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e650be_df4d_4a81_81b6_9081e889b5cb.slice/crio-8d68128d3d1d8ca7decad7575b4b8312d84f5d007e2ea43d5fb47207681afc20 WatchSource:0}: Error finding container 8d68128d3d1d8ca7decad7575b4b8312d84f5d007e2ea43d5fb47207681afc20: Status 404 returned error can't find the container with id 8d68128d3d1d8ca7decad7575b4b8312d84f5d007e2ea43d5fb47207681afc20
May 26 16:04:15.012753 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:15.012712    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cxzqq" event={"ID":"a7e59530-8135-4c3d-a7f2-f525837a7ba9","Type":"ContainerStarted","Data":"08597e9a9a648f951f32a021f03e79b97b5f3ae11b2610ebf756271e05313ea7"}
May 26 16:04:15.013583 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:15.013560    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dkldm" event={"ID":"97e650be-df4d-4a81-81b6-9081e889b5cb","Type":"ContainerStarted","Data":"8d68128d3d1d8ca7decad7575b4b8312d84f5d007e2ea43d5fb47207681afc20"}
May 26 16:04:15.014507 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:15.014483    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-fxjwv" event={"ID":"218941f9-9f6b-4222-a147-240b78053057","Type":"ContainerStarted","Data":"940304548b44d70270b4b10422335c6500ce889b11b39d044487696f787f347f"}
May 26 16:04:15.015615 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:15.015595    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c8vfk" event={"ID":"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d","Type":"ContainerStarted","Data":"1caa05654662adfcaafbd901f143885790cd59e11e4ca5e052acc15ccc3df823"}
May 26 16:04:15.015692 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:15.015619    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c8vfk" event={"ID":"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d","Type":"ContainerStarted","Data":"fe7b0177d463318c4c783271eb0a7c085e8b7bab78f0d0ad828ae11bd0c1b3ba"}
May 26 16:04:16.020488 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:16.020449    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c8vfk" event={"ID":"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d","Type":"ContainerStarted","Data":"009447f6e22f33af329e95418d96c76a27f501ea13e05cc60da265bb3d825ce1"}
May 26 16:04:18.029214 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:18.029085    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c8vfk" event={"ID":"b72063e5-bd6f-4255-8bf4-696aa1e2cb6d","Type":"ContainerStarted","Data":"a3e3cfde107f982000ba7a78666ce1ac3267e8a30d42061a79b8e22153610be4"}
May 26 16:04:18.036737 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:18.036701    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cxzqq" event={"ID":"a7e59530-8135-4c3d-a7f2-f525837a7ba9","Type":"ContainerStarted","Data":"f3ac6046698a2b15951e164be3e80e95e93b425d4627060e13c95c882d13bd6a"}
May 26 16:04:18.038792 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:18.038767    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dkldm" event={"ID":"97e650be-df4d-4a81-81b6-9081e889b5cb","Type":"ContainerStarted","Data":"2edc494eb8914d1654847940c742b6dc18feceb754f2d9730928cef1902ed0f9"}
May 26 16:04:18.050299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:18.050226    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c8vfk" podStartSLOduration=0.831732223 podStartE2EDuration="4.050209871s" podCreationTimestamp="2026-05-26 16:04:14 +0000 UTC" firstStartedPulling="2026-05-26 16:04:14.582888828 +0000 UTC m=+161.693446597" lastFinishedPulling="2026-05-26 16:04:17.801366475 +0000 UTC m=+164.911924245" observedRunningTime="2026-05-26 16:04:18.048683977 +0000 UTC m=+165.159241769" watchObservedRunningTime="2026-05-26 16:04:18.050209871 +0000 UTC m=+165.160767663"
May 26 16:04:18.063338 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:18.063290    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dkldm" podStartSLOduration=129.221268773 podStartE2EDuration="2m12.063278631s" podCreationTimestamp="2026-05-26 16:02:06 +0000 UTC" firstStartedPulling="2026-05-26 16:04:14.956071797 +0000 UTC m=+162.066629568" lastFinishedPulling="2026-05-26 16:04:17.798081642 +0000 UTC m=+164.908639426" observedRunningTime="2026-05-26 16:04:18.062852127 +0000 UTC m=+165.173409920" watchObservedRunningTime="2026-05-26 16:04:18.063278631 +0000 UTC m=+165.173836423"
May 26 16:04:19.043392 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:19.043348    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cxzqq" event={"ID":"a7e59530-8135-4c3d-a7f2-f525837a7ba9","Type":"ContainerStarted","Data":"5a2c580f24ef34c50d34effb3165a933d196d488bbe916beacbab44b7128b87c"}
May 26 16:04:19.043856 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:19.043801    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cxzqq"
May 26 16:04:19.060926 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:19.060882    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-cxzqq" podStartSLOduration=130.203967491 podStartE2EDuration="2m13.060869572s" podCreationTimestamp="2026-05-26 16:02:06 +0000 UTC" firstStartedPulling="2026-05-26 16:04:14.941175872 +0000 UTC m=+162.051733641" lastFinishedPulling="2026-05-26 16:04:17.79807795 +0000 UTC m=+164.908635722" observedRunningTime="2026-05-26 16:04:19.059403426 +0000 UTC m=+166.169961218" watchObservedRunningTime="2026-05-26 16:04:19.060869572 +0000 UTC m=+166.171427364"
May 26 16:04:19.987565 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:19.987532    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"]
May 26 16:04:19.989782 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:19.989759    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"
May 26 16:04:19.992261 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:19.992233    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 26 16:04:19.992376 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:19.992243    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dxh42\""
May 26 16:04:19.998685 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:19.998662    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"]
May 26 16:04:20.071203 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:20.071170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f5e6d8e-f192-4a84-b593-23c0178cb017-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-68dfq\" (UID: \"8f5e6d8e-f192-4a84-b593-23c0178cb017\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"
May 26 16:04:20.171623 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:20.171594    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f5e6d8e-f192-4a84-b593-23c0178cb017-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-68dfq\" (UID: \"8f5e6d8e-f192-4a84-b593-23c0178cb017\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"
May 26 16:04:20.171811 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:20.171743    2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 26 16:04:20.171811 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:20.171810    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5e6d8e-f192-4a84-b593-23c0178cb017-tls-certificates podName:8f5e6d8e-f192-4a84-b593-23c0178cb017 nodeName:}" failed. No retries permitted until 2026-05-26 16:04:20.671789393 +0000 UTC m=+167.782347164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8f5e6d8e-f192-4a84-b593-23c0178cb017-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-68dfq" (UID: "8f5e6d8e-f192-4a84-b593-23c0178cb017") : secret "prometheus-operator-admission-webhook-tls" not found
May 26 16:04:20.675310 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:20.675269    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f5e6d8e-f192-4a84-b593-23c0178cb017-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-68dfq\" (UID: \"8f5e6d8e-f192-4a84-b593-23c0178cb017\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"
May 26 16:04:20.677976 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:20.677947    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f5e6d8e-f192-4a84-b593-23c0178cb017-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-68dfq\" (UID: \"8f5e6d8e-f192-4a84-b593-23c0178cb017\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"
May 26 16:04:20.902086 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:20.902046    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"
May 26 16:04:21.059051 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:21.059007    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"]
May 26 16:04:21.063497 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:21.063464    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5e6d8e_f192_4a84_b593_23c0178cb017.slice/crio-faef450031bbb4cfa0938132c4bb77bb096654b30bdd71afb8992b8958fc1e7c WatchSource:0}: Error finding container faef450031bbb4cfa0938132c4bb77bb096654b30bdd71afb8992b8958fc1e7c: Status 404 returned error can't find the container with id faef450031bbb4cfa0938132c4bb77bb096654b30bdd71afb8992b8958fc1e7c
May 26 16:04:22.009418 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.009379    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f7568db95-sjm8x"]
May 26 16:04:22.012729 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.012696    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.015249 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.015229    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 16:04:22.016535 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.016500    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 16:04:22.016657 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.016599    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 16:04:22.016733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.016717    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 16:04:22.017129 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.016855    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9p442\""
May 26 16:04:22.017129 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.016893    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 16:04:22.024068 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.023373    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7568db95-sjm8x"]
May 26 16:04:22.055784 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.055746    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq" event={"ID":"8f5e6d8e-f192-4a84-b593-23c0178cb017","Type":"ContainerStarted","Data":"faef450031bbb4cfa0938132c4bb77bb096654b30bdd71afb8992b8958fc1e7c"}
May 26 16:04:22.088362 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.088327    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-service-ca\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.088504 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.088372    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-console-config\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.088504 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.088405    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-oauth-config\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.088504 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.088434    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-serving-cert\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.088667 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.088502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-oauth-serving-cert\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.088667 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.088529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slzs2\" (UniqueName: \"kubernetes.io/projected/5ec1298c-caf5-4864-8da8-510b1720f58d-kube-api-access-slzs2\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.189760 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.189504    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-oauth-serving-cert\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.189760 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.189557    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-slzs2\" (UniqueName: \"kubernetes.io/projected/5ec1298c-caf5-4864-8da8-510b1720f58d-kube-api-access-slzs2\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.189760 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.189651    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-service-ca\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.189760 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.189681    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-console-config\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.189760 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.189714    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-oauth-config\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.189760 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.189742    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-serving-cert\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.190341 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.190313    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-oauth-serving-cert\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.190706 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.190657    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-service-ca\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.190706 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.190703    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-console-config\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.192758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.192729    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-oauth-config\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.193041 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.192979    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-serving-cert\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.198646 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.198604    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slzs2\" (UniqueName: \"kubernetes.io/projected/5ec1298c-caf5-4864-8da8-510b1720f58d-kube-api-access-slzs2\") pod \"console-f7568db95-sjm8x\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") " pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.328873 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.328801    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:22.489528 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:22.489495    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7568db95-sjm8x"]
May 26 16:04:22.493792 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:22.493748    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec1298c_caf5_4864_8da8_510b1720f58d.slice/crio-5a1132f026373edf735d0357b28080ee96f3815cf8c5ec964c2968250c166237 WatchSource:0}: Error finding container 5a1132f026373edf735d0357b28080ee96f3815cf8c5ec964c2968250c166237: Status 404 returned error can't find the container with id 5a1132f026373edf735d0357b28080ee96f3815cf8c5ec964c2968250c166237
May 26 16:04:23.060541 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:23.060501    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq" event={"ID":"8f5e6d8e-f192-4a84-b593-23c0178cb017","Type":"ContainerStarted","Data":"1a393eb946ad31e9780e740cb804e03e1e4bdf26b384aabc65ffd0f9f88528e3"}
May 26 16:04:23.061322 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:23.061285    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"
May 26 16:04:23.062417 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:23.062385    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7568db95-sjm8x" event={"ID":"5ec1298c-caf5-4864-8da8-510b1720f58d","Type":"ContainerStarted","Data":"5a1132f026373edf735d0357b28080ee96f3815cf8c5ec964c2968250c166237"}
May 26 16:04:23.067362 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:23.067336    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq"
May 26 16:04:23.075851 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:23.075795    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-68dfq" podStartSLOduration=2.790539526 podStartE2EDuration="4.075780717s" podCreationTimestamp="2026-05-26 16:04:19 +0000 UTC" firstStartedPulling="2026-05-26 16:04:21.065550692 +0000 UTC m=+168.176108481" lastFinishedPulling="2026-05-26 16:04:22.350791891 +0000 UTC m=+169.461349672" observedRunningTime="2026-05-26 16:04:23.075249807 +0000 UTC m=+170.185807599" watchObservedRunningTime="2026-05-26 16:04:23.075780717 +0000 UTC m=+170.186338503"
May 26 16:04:24.039386 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.039353    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"]
May 26 16:04:24.044822 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.044796    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.047453 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.047422    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 26 16:04:24.047683 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.047662    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 16:04:24.047794 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.047765    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 16:04:24.048300 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.048257    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 26 16:04:24.048476 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.048459    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bsq5c\""
May 26 16:04:24.048764 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.048597    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 16:04:24.053158 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.052968    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"]
May 26 16:04:24.107015 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.106969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/812f9eb6-37db-46cb-8001-bc1a4110c16e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.107400 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.107116    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdbkz\" (UniqueName: \"kubernetes.io/projected/812f9eb6-37db-46cb-8001-bc1a4110c16e-kube-api-access-sdbkz\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.107400 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.107217    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/812f9eb6-37db-46cb-8001-bc1a4110c16e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.107400 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.107270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/812f9eb6-37db-46cb-8001-bc1a4110c16e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.133860 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.133835    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:04:24.208217 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.208177    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/812f9eb6-37db-46cb-8001-bc1a4110c16e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.208370 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.208260    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdbkz\" (UniqueName: \"kubernetes.io/projected/812f9eb6-37db-46cb-8001-bc1a4110c16e-kube-api-access-sdbkz\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.208370 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.208317    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/812f9eb6-37db-46cb-8001-bc1a4110c16e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.208370 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.208359    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/812f9eb6-37db-46cb-8001-bc1a4110c16e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.208542 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:24.208459    2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 26 16:04:24.208542 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:24.208530    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/812f9eb6-37db-46cb-8001-bc1a4110c16e-prometheus-operator-tls podName:812f9eb6-37db-46cb-8001-bc1a4110c16e nodeName:}" failed. No retries permitted until 2026-05-26 16:04:24.708508137 +0000 UTC m=+171.819065925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/812f9eb6-37db-46cb-8001-bc1a4110c16e-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-rdfsv" (UID: "812f9eb6-37db-46cb-8001-bc1a4110c16e") : secret "prometheus-operator-tls" not found
May 26 16:04:24.208971 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.208914    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/812f9eb6-37db-46cb-8001-bc1a4110c16e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.210952 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.210929    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/812f9eb6-37db-46cb-8001-bc1a4110c16e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.216992 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.216968    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdbkz\" (UniqueName: \"kubernetes.io/projected/812f9eb6-37db-46cb-8001-bc1a4110c16e-kube-api-access-sdbkz\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.489270 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.489238    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:04:24.712620 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.712585    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/812f9eb6-37db-46cb-8001-bc1a4110c16e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.715217 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.715187    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/812f9eb6-37db-46cb-8001-bc1a4110c16e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-rdfsv\" (UID: \"812f9eb6-37db-46cb-8001-bc1a4110c16e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:24.957250 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:24.957117    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"
May 26 16:04:27.051918 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:27.051886    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cxzqq"
May 26 16:04:30.605411 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.605376    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8546d986dd-hf27v"]
May 26 16:04:30.609948 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.609908    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.619671 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.619645    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 16:04:30.620016 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.619975    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8546d986dd-hf27v"]
May 26 16:04:30.658736 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.658693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-trusted-ca-bundle\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.658876 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.658750    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-oauth-serving-cert\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.658876 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.658788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-console-config\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.658876 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.658856    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-oauth-config\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.659081 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.658895    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-service-ca\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.659081 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.658928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-serving-cert\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.659081 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.658957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p267g\" (UniqueName: \"kubernetes.io/projected/25481c18-d114-449a-a0e1-f088645eae88-kube-api-access-p267g\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.759555 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.759516    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-oauth-serving-cert\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.759739 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.759569    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-console-config\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.759739 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.759602    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-oauth-config\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.759739 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.759622    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-service-ca\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.759739 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.759644    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-serving-cert\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.759739 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.759671    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p267g\" (UniqueName: \"kubernetes.io/projected/25481c18-d114-449a-a0e1-f088645eae88-kube-api-access-p267g\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.759739 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.759725    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-trusted-ca-bundle\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.760468 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.760405    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-console-config\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.760468 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.760410    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-oauth-serving-cert\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.760660 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.760629    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-service-ca\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.760786 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.760660    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-trusted-ca-bundle\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.762332 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.762312    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-oauth-config\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.762559 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.762535    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-serving-cert\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.771941 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.771920    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p267g\" (UniqueName: \"kubernetes.io/projected/25481c18-d114-449a-a0e1-f088645eae88-kube-api-access-p267g\") pod \"console-8546d986dd-hf27v\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") " pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:30.922943 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:30.922830    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:32.039773 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.039651    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8546d986dd-hf27v"]
May 26 16:04:32.043115 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:32.043081    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25481c18_d114_449a_a0e1_f088645eae88.slice/crio-c21db81c59e1d0ab902d667303ac765db9689e13e7c28d89bdc47d50f0dc1580 WatchSource:0}: Error finding container c21db81c59e1d0ab902d667303ac765db9689e13e7c28d89bdc47d50f0dc1580: Status 404 returned error can't find the container with id c21db81c59e1d0ab902d667303ac765db9689e13e7c28d89bdc47d50f0dc1580
May 26 16:04:32.062956 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.062927    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv"]
May 26 16:04:32.066559 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:32.066528    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812f9eb6_37db_46cb_8001_bc1a4110c16e.slice/crio-b03d11a7614e76646deab5495ede5355db6672bef30f4f836873adb506634094 WatchSource:0}: Error finding container b03d11a7614e76646deab5495ede5355db6672bef30f4f836873adb506634094: Status 404 returned error can't find the container with id b03d11a7614e76646deab5495ede5355db6672bef30f4f836873adb506634094
May 26 16:04:32.087913 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.087858    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-fxjwv" event={"ID":"218941f9-9f6b-4222-a147-240b78053057","Type":"ContainerStarted","Data":"e5e7bec09e02a7185ffafa3381cfe167d3411c7a84ebef351eff9dd9055dd274"}
May 26 16:04:32.088221 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.088192    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-fxjwv"
May 26 16:04:32.089117 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.089082    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8546d986dd-hf27v" event={"ID":"25481c18-d114-449a-a0e1-f088645eae88","Type":"ContainerStarted","Data":"c21db81c59e1d0ab902d667303ac765db9689e13e7c28d89bdc47d50f0dc1580"}
May 26 16:04:32.089451 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.089430    2567 patch_prober.go:28] interesting pod/downloads-57bd96b888-fxjwv container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.13:8080/\": dial tcp 10.134.0.13:8080: connect: connection refused" start-of-body=
May 26 16:04:32.089540 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.089472    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-fxjwv" podUID="218941f9-9f6b-4222-a147-240b78053057" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.13:8080/\": dial tcp 10.134.0.13:8080: connect: connection refused"
May 26 16:04:32.090311 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.090290    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv" event={"ID":"812f9eb6-37db-46cb-8001-bc1a4110c16e","Type":"ContainerStarted","Data":"b03d11a7614e76646deab5495ede5355db6672bef30f4f836873adb506634094"}
May 26 16:04:32.091443 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.091421    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7568db95-sjm8x" event={"ID":"5ec1298c-caf5-4864-8da8-510b1720f58d","Type":"ContainerStarted","Data":"d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351"}
May 26 16:04:32.108143 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.108100    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-fxjwv" podStartSLOduration=0.722874579 podStartE2EDuration="18.108088634s" podCreationTimestamp="2026-05-26 16:04:14 +0000 UTC" firstStartedPulling="2026-05-26 16:04:14.576545109 +0000 UTC m=+161.687102881" lastFinishedPulling="2026-05-26 16:04:31.961759149 +0000 UTC m=+179.072316936" observedRunningTime="2026-05-26 16:04:32.10657425 +0000 UTC m=+179.217132039" watchObservedRunningTime="2026-05-26 16:04:32.108088634 +0000 UTC m=+179.218646458"
May 26 16:04:32.125640 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.125511    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f7568db95-sjm8x" podStartSLOduration=1.725711189 podStartE2EDuration="11.125495229s" podCreationTimestamp="2026-05-26 16:04:21 +0000 UTC" firstStartedPulling="2026-05-26 16:04:22.495819423 +0000 UTC m=+169.606377208" lastFinishedPulling="2026-05-26 16:04:31.895603468 +0000 UTC m=+179.006161248" observedRunningTime="2026-05-26 16:04:32.124617615 +0000 UTC m=+179.235175407" watchObservedRunningTime="2026-05-26 16:04:32.125495229 +0000 UTC m=+179.236053022"
May 26 16:04:32.329100 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.329048    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:32.329264 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.329204    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:32.334751 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:32.334725    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:33.097571 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:33.097501    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8546d986dd-hf27v" event={"ID":"25481c18-d114-449a-a0e1-f088645eae88","Type":"ContainerStarted","Data":"3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae"}
May 26 16:04:33.103393 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:33.103355    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:04:33.113581 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:33.113556    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-fxjwv"
May 26 16:04:33.115652 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:33.115611    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8546d986dd-hf27v" podStartSLOduration=3.115593539 podStartE2EDuration="3.115593539s" podCreationTimestamp="2026-05-26 16:04:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:04:33.114545452 +0000 UTC m=+180.225103454" watchObservedRunningTime="2026-05-26 16:04:33.115593539 +0000 UTC m=+180.226151330"
May 26 16:04:34.102643 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:34.102597    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv" event={"ID":"812f9eb6-37db-46cb-8001-bc1a4110c16e","Type":"ContainerStarted","Data":"c5883d005a93ac3bc677ca623f147792a8a55913ca12a2c3bd910ba5aac80625"}
May 26 16:04:34.102643 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:34.102648    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv" event={"ID":"812f9eb6-37db-46cb-8001-bc1a4110c16e","Type":"ContainerStarted","Data":"eca7074a83175c95c3609492ee5d55fd33077e81fd5873e944a800efe342475e"}
May 26 16:04:34.119759 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:34.119708    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-rdfsv" podStartSLOduration=8.828498809 podStartE2EDuration="10.119694017s" podCreationTimestamp="2026-05-26 16:04:24 +0000 UTC" firstStartedPulling="2026-05-26 16:04:32.068653333 +0000 UTC m=+179.179211103" lastFinishedPulling="2026-05-26 16:04:33.359848534 +0000 UTC m=+180.470406311" observedRunningTime="2026-05-26 16:04:34.11841211 +0000 UTC m=+181.228969903" watchObservedRunningTime="2026-05-26 16:04:34.119694017 +0000 UTC m=+181.230251809"
May 26 16:04:36.418107 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.418069    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"]
May 26 16:04:36.445515 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.445481    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"]
May 26 16:04:36.445664 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.445618    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.448593 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.448563    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 26 16:04:36.448733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.448564    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qgnx7\""
May 26 16:04:36.448733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.448680    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 26 16:04:36.454708 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.454685    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n6db4"]
May 26 16:04:36.477350 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.477323    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.479956 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.479685    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5w4vj\""
May 26 16:04:36.479956 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.479709    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 16:04:36.479956 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.479712    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 16:04:36.480226 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.479990    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 16:04:36.509878 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.509847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abc0a6b8-2759-49b8-9921-96bc113e456a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.510026 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.509889    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abc0a6b8-2759-49b8-9921-96bc113e456a-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.510081 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.510021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8gx6\" (UniqueName: \"kubernetes.io/projected/abc0a6b8-2759-49b8-9921-96bc113e456a-kube-api-access-m8gx6\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.510081 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.510060    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abc0a6b8-2759-49b8-9921-96bc113e456a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.611164 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611125    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abc0a6b8-2759-49b8-9921-96bc113e456a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.611347 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611172    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f48fcdf-e636-4961-9fd2-7c1a461748ee-metrics-client-ca\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.611347 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611202    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abc0a6b8-2759-49b8-9921-96bc113e456a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.611347 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.611347 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w997x\" (UniqueName: \"kubernetes.io/projected/4f48fcdf-e636-4961-9fd2-7c1a461748ee-kube-api-access-w997x\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.611347 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611276    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abc0a6b8-2759-49b8-9921-96bc113e456a-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.611347 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611302    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f48fcdf-e636-4961-9fd2-7c1a461748ee-sys\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.611347 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-textfile\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.611695 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.611695 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-tls\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.611695 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-wtmp\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.611695 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611587    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8gx6\" (UniqueName: \"kubernetes.io/projected/abc0a6b8-2759-49b8-9921-96bc113e456a-kube-api-access-m8gx6\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.611695 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.611649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f48fcdf-e636-4961-9fd2-7c1a461748ee-root\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.612089 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.612062    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abc0a6b8-2759-49b8-9921-96bc113e456a-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.613959 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.613929    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abc0a6b8-2759-49b8-9921-96bc113e456a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.614092 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.614049    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abc0a6b8-2759-49b8-9921-96bc113e456a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.619561 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.619536    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8gx6\" (UniqueName: \"kubernetes.io/projected/abc0a6b8-2759-49b8-9921-96bc113e456a-kube-api-access-m8gx6\") pod \"openshift-state-metrics-9c959559f-zjwj7\" (UID: \"abc0a6b8-2759-49b8-9921-96bc113e456a\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.712783 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.712697    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f48fcdf-e636-4961-9fd2-7c1a461748ee-sys\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.712783 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.712754    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-textfile\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.712987 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.712787    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.712987 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.712813    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f48fcdf-e636-4961-9fd2-7c1a461748ee-sys\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.712987 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.712840    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-tls\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.712987 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.712865    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-wtmp\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.712987 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.712926    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f48fcdf-e636-4961-9fd2-7c1a461748ee-root\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.712987 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.712970    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f48fcdf-e636-4961-9fd2-7c1a461748ee-metrics-client-ca\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.713373 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.713017    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.713373 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.713056    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w997x\" (UniqueName: \"kubernetes.io/projected/4f48fcdf-e636-4961-9fd2-7c1a461748ee-kube-api-access-w997x\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.713373 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.713206    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-textfile\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.713373 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.713337    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-wtmp\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.713571 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.713404    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f48fcdf-e636-4961-9fd2-7c1a461748ee-root\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.713628 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:36.713576    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 26 16:04:36.713678 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:36.713633    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-tls podName:4f48fcdf-e636-4961-9fd2-7c1a461748ee nodeName:}" failed. No retries permitted until 2026-05-26 16:04:37.213612893 +0000 UTC m=+184.324170681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-tls") pod "node-exporter-n6db4" (UID: "4f48fcdf-e636-4961-9fd2-7c1a461748ee") : secret "node-exporter-tls" not found
May 26 16:04:36.714462 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.714435    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.714818 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.714794    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f48fcdf-e636-4961-9fd2-7c1a461748ee-metrics-client-ca\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.716046 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.716022    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.724229 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.724185    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w997x\" (UniqueName: \"kubernetes.io/projected/4f48fcdf-e636-4961-9fd2-7c1a461748ee-kube-api-access-w997x\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:36.756755 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.756730    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"
May 26 16:04:36.894749 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:36.894715    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7"]
May 26 16:04:36.897793 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:36.897762    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc0a6b8_2759_49b8_9921_96bc113e456a.slice/crio-6ea09d15298f08fc66dfdf67ee0c252d9fcacb9c1108b8f626d1e9a03f26176d WatchSource:0}: Error finding container 6ea09d15298f08fc66dfdf67ee0c252d9fcacb9c1108b8f626d1e9a03f26176d: Status 404 returned error can't find the container with id 6ea09d15298f08fc66dfdf67ee0c252d9fcacb9c1108b8f626d1e9a03f26176d
May 26 16:04:37.111793 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:37.111763    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7" event={"ID":"abc0a6b8-2759-49b8-9921-96bc113e456a","Type":"ContainerStarted","Data":"37d8e4af3a5a0e7475687b62a4d30775fb558336108f6912ed7ee5cb2b328d90"}
May 26 16:04:37.111922 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:37.111804    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7" event={"ID":"abc0a6b8-2759-49b8-9921-96bc113e456a","Type":"ContainerStarted","Data":"6ea09d15298f08fc66dfdf67ee0c252d9fcacb9c1108b8f626d1e9a03f26176d"}
May 26 16:04:37.217014 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:37.216967    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-tls\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:37.219568 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:37.219544    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f48fcdf-e636-4961-9fd2-7c1a461748ee-node-exporter-tls\") pod \"node-exporter-n6db4\" (UID: \"4f48fcdf-e636-4961-9fd2-7c1a461748ee\") " pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:37.388428 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:37.388354    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n6db4"
May 26 16:04:37.397962 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:37.397934    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f48fcdf_e636_4961_9fd2_7c1a461748ee.slice/crio-3ea64d99d8aa4fc832b841ae87e766034afc9b4da4ac1d8837d79a0d17567b9a WatchSource:0}: Error finding container 3ea64d99d8aa4fc832b841ae87e766034afc9b4da4ac1d8837d79a0d17567b9a: Status 404 returned error can't find the container with id 3ea64d99d8aa4fc832b841ae87e766034afc9b4da4ac1d8837d79a0d17567b9a
May 26 16:04:38.124085 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:38.124028    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n6db4" event={"ID":"4f48fcdf-e636-4961-9fd2-7c1a461748ee","Type":"ContainerStarted","Data":"3ea64d99d8aa4fc832b841ae87e766034afc9b4da4ac1d8837d79a0d17567b9a"}
May 26 16:04:38.127344 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:38.127298    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7" event={"ID":"abc0a6b8-2759-49b8-9921-96bc113e456a","Type":"ContainerStarted","Data":"02cfb5d4b9b1da47b3dad0c28034c0fc1af5d03614afa461de61d514a0b95eab"}
May 26 16:04:39.145915 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.145868    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg" podUID="6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" containerName="registry" containerID="cri-o://95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108" gracePeriod=30
May 26 16:04:39.362946 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.361339    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-65465c5db5-d42q8"]
May 26 16:04:39.383051 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.382989    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65465c5db5-d42q8"]
May 26 16:04:39.383213 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.383197    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.388149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.386816    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 26 16:04:39.388149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.387035    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 26 16:04:39.388149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.387247    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5oh9f2ri4a8p1\""
May 26 16:04:39.388149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.387423    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 26 16:04:39.388149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.387608    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dd8tz\""
May 26 16:04:39.388149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.387807    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 26 16:04:39.388149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.387974    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 26 16:04:39.438262 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.437936    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.438262 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.437991    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.438262 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.438065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-grpc-tls\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.438262 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.438128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-tls\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.438262 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.438165    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec62e47e-f33f-4a8b-99fe-58a282736ba4-metrics-client-ca\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.438262 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.438199    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.438262 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.438241    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l87c4\" (UniqueName: \"kubernetes.io/projected/ec62e47e-f33f-4a8b-99fe-58a282736ba4-kube-api-access-l87c4\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.438602 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.438285    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.444703 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.444492    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:04:39.539355 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539323    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tmzp\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-kube-api-access-8tmzp\") pod \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") "
May 26 16:04:39.539570 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539369    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") pod \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") "
May 26 16:04:39.539570 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539399    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-image-registry-private-configuration\") pod \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") "
May 26 16:04:39.539570 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539423    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-ca-trust-extracted\") pod \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") "
May 26 16:04:39.539570 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539445    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-trusted-ca\") pod \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") "
May 26 16:04:39.539570 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539494    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-certificates\") pod \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") "
May 26 16:04:39.539570 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539534    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-installation-pull-secrets\") pod \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") "
May 26 16:04:39.539872 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539577    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-bound-sa-token\") pod \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\" (UID: \"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc\") "
May 26 16:04:39.539872 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539686    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.539872 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539732    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.539872 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539766    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-grpc-tls\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.539872 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539839    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-tls\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.540144 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539881    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec62e47e-f33f-4a8b-99fe-58a282736ba4-metrics-client-ca\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.540144 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539923    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.540144 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539953    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l87c4\" (UniqueName: \"kubernetes.io/projected/ec62e47e-f33f-4a8b-99fe-58a282736ba4-kube-api-access-l87c4\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.540144 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.540021    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.543053 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.542915    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.543735 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.543357    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.544207 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539870    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:04:39.544207 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.539896    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:04:39.544675 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.544563    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec62e47e-f33f-4a8b-99fe-58a282736ba4-metrics-client-ca\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.544675 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.544640    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:04:39.545036 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.544987    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.545125 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.545045    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-grpc-tls\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.545183 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.545142    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:04:39.545183 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.545160    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:04:39.545280 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.545218    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:04:39.546472 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.546450    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.546830 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.546804    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-kube-api-access-8tmzp" (OuterVolumeSpecName: "kube-api-access-8tmzp") pod "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc"). InnerVolumeSpecName "kube-api-access-8tmzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:04:39.546923 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.546885    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec62e47e-f33f-4a8b-99fe-58a282736ba4-secret-thanos-querier-tls\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.551566 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.551545    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l87c4\" (UniqueName: \"kubernetes.io/projected/ec62e47e-f33f-4a8b-99fe-58a282736ba4-kube-api-access-l87c4\") pod \"thanos-querier-65465c5db5-d42q8\" (UID: \"ec62e47e-f33f-4a8b-99fe-58a282736ba4\") " pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.552664 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.552640    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" (UID: "6c2fe1b0-a9fc-4b74-9a78-82070ff232bc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:04:39.641046 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.641015    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tmzp\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-kube-api-access-8tmzp\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:04:39.641046 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.641048    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-tls\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:04:39.641243 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.641060    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-image-registry-private-configuration\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:04:39.641243 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.641071    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-ca-trust-extracted\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:04:39.641243 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.641080    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-trusted-ca\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:04:39.641243 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.641090    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-registry-certificates\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:04:39.641243 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.641098    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-installation-pull-secrets\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:04:39.641243 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.641107    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc-bound-sa-token\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:04:39.697165 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.697096    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:39.850586 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:39.850548    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65465c5db5-d42q8"]
May 26 16:04:39.854621 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:39.854577    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec62e47e_f33f_4a8b_99fe_58a282736ba4.slice/crio-034ca36e8f558692221e8f275c878cf076ecc4ef943c329e67ce2ebcd427eeca WatchSource:0}: Error finding container 034ca36e8f558692221e8f275c878cf076ecc4ef943c329e67ce2ebcd427eeca: Status 404 returned error can't find the container with id 034ca36e8f558692221e8f275c878cf076ecc4ef943c329e67ce2ebcd427eeca
May 26 16:04:40.135357 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.135320    2567 generic.go:358] "Generic (PLEG): container finished" podID="4f48fcdf-e636-4961-9fd2-7c1a461748ee" containerID="536cff0810eb3ab7b756030d32540e67286c7c948cb275eb480c5b39c15a94ea" exitCode=0
May 26 16:04:40.135537 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.135408    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n6db4" event={"ID":"4f48fcdf-e636-4961-9fd2-7c1a461748ee","Type":"ContainerDied","Data":"536cff0810eb3ab7b756030d32540e67286c7c948cb275eb480c5b39c15a94ea"}
May 26 16:04:40.136762 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.136735    2567 generic.go:358] "Generic (PLEG): container finished" podID="6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" containerID="95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108" exitCode=0
May 26 16:04:40.136890 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.136793    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg"
May 26 16:04:40.136890 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.136823    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg" event={"ID":"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc","Type":"ContainerDied","Data":"95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108"}
May 26 16:04:40.136890 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.136857    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd8bbc449-f82vg" event={"ID":"6c2fe1b0-a9fc-4b74-9a78-82070ff232bc","Type":"ContainerDied","Data":"d3716aa803e5b143a424bb87e55a55ab0e2c7e0664a72b9a70546137f61dbcdf"}
May 26 16:04:40.136890 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.136879    2567 scope.go:117] "RemoveContainer" containerID="95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108"
May 26 16:04:40.139835 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.139788    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7" event={"ID":"abc0a6b8-2759-49b8-9921-96bc113e456a","Type":"ContainerStarted","Data":"89fa95fd919b4e04c45765a8950c4dd63d7496772ca29018e1ed02c751b4836f"}
May 26 16:04:40.141029 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.140969    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8" event={"ID":"ec62e47e-f33f-4a8b-99fe-58a282736ba4","Type":"ContainerStarted","Data":"034ca36e8f558692221e8f275c878cf076ecc4ef943c329e67ce2ebcd427eeca"}
May 26 16:04:40.146387 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.146312    2567 scope.go:117] "RemoveContainer" containerID="95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108"
May 26 16:04:40.146716 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:40.146634    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108\": container with ID starting with 95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108 not found: ID does not exist" containerID="95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108"
May 26 16:04:40.146716 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.146668    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108"} err="failed to get container status \"95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108\": rpc error: code = NotFound desc = could not find container \"95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108\": container with ID starting with 95b24644c4212e2f741fbbb80015f0f9f623fdf5e2f7476606adcab9e91fa108 not found: ID does not exist"
May 26 16:04:40.166141 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.166114    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fd8bbc449-f82vg"]
May 26 16:04:40.170351 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.170329    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fd8bbc449-f82vg"]
May 26 16:04:40.186335 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.186281    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zjwj7" podStartSLOduration=2.128570112 podStartE2EDuration="4.186268133s" podCreationTimestamp="2026-05-26 16:04:36 +0000 UTC" firstStartedPulling="2026-05-26 16:04:37.14695578 +0000 UTC m=+184.257513550" lastFinishedPulling="2026-05-26 16:04:39.204653801 +0000 UTC m=+186.315211571" observedRunningTime="2026-05-26 16:04:40.185681053 +0000 UTC m=+187.296238847" watchObservedRunningTime="2026-05-26 16:04:40.186268133 +0000 UTC m=+187.296825926"
May 26 16:04:40.923348 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.923310    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:40.923681 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.923655    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:40.929575 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:40.929549    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:41.146533 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.146489    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n6db4" event={"ID":"4f48fcdf-e636-4961-9fd2-7c1a461748ee","Type":"ContainerStarted","Data":"acd5fa0503cc41f52777ac76409362945c0210d61a655c2f3730b05158def733"}
May 26 16:04:41.146970 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.146538    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n6db4" event={"ID":"4f48fcdf-e636-4961-9fd2-7c1a461748ee","Type":"ContainerStarted","Data":"e56dbc9c630f879e4c5cfbbd0b552915092b009ca6bf31326146c5807c825789"}
May 26 16:04:41.153113 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.153088    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:04:41.167748 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.167708    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n6db4" podStartSLOduration=3.360833332 podStartE2EDuration="5.167696244s" podCreationTimestamp="2026-05-26 16:04:36 +0000 UTC" firstStartedPulling="2026-05-26 16:04:37.399863455 +0000 UTC m=+184.510421243" lastFinishedPulling="2026-05-26 16:04:39.206726383 +0000 UTC m=+186.317284155" observedRunningTime="2026-05-26 16:04:41.166257729 +0000 UTC m=+188.276815533" watchObservedRunningTime="2026-05-26 16:04:41.167696244 +0000 UTC m=+188.278254050"
May 26 16:04:41.185534 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.185469    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"]
May 26 16:04:41.185810 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.185796    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" containerName="registry"
May 26 16:04:41.185877 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.185812    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" containerName="registry"
May 26 16:04:41.185877 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.185866    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" containerName="registry"
May 26 16:04:41.205079 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.205019    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8546d986dd-hf27v"]
May 26 16:04:41.205079 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.205057    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"]
May 26 16:04:41.205243 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.205103    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"
May 26 16:04:41.207418 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.207397    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 26 16:04:41.207584 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.207404    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-g7872\""
May 26 16:04:41.219790 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.219766    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-864f7cdf8b-hnswn"]
May 26 16:04:41.240272 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.240249    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864f7cdf8b-hnswn"]
May 26 16:04:41.240397 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.240382    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.357309 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.357276    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-service-ca\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.357309 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.357320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-trusted-ca-bundle\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.357552 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.357349    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-console-config\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.357552 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.357377    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-oauth-serving-cert\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.357552 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.357406    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8rn\" (UniqueName: \"kubernetes.io/projected/a848c0f7-ad0e-4421-a4be-57f70c629670-kube-api-access-fz8rn\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.357552 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.357457    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea269d77-4959-4804-82a3-ffe314fa3712-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-rkx82\" (UID: \"ea269d77-4959-4804-82a3-ffe314fa3712\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"
May 26 16:04:41.357552 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.357473    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-serving-cert\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.357552 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.357503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-oauth-config\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.458556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.458481    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-service-ca\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.458556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.458526    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-trusted-ca-bundle\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.458556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.458555    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-console-config\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.458814 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.458574    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-oauth-serving-cert\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.458814 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.458595    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8rn\" (UniqueName: \"kubernetes.io/projected/a848c0f7-ad0e-4421-a4be-57f70c629670-kube-api-access-fz8rn\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.458814 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.458648    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea269d77-4959-4804-82a3-ffe314fa3712-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-rkx82\" (UID: \"ea269d77-4959-4804-82a3-ffe314fa3712\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"
May 26 16:04:41.458814 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.458664    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-serving-cert\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.458814 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.458692    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-oauth-config\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.458814 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:41.458776    2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 26 16:04:41.459157 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:04:41.458849    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea269d77-4959-4804-82a3-ffe314fa3712-monitoring-plugin-cert podName:ea269d77-4959-4804-82a3-ffe314fa3712 nodeName:}" failed. No retries permitted until 2026-05-26 16:04:41.958826761 +0000 UTC m=+189.069384548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ea269d77-4959-4804-82a3-ffe314fa3712-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-rkx82" (UID: "ea269d77-4959-4804-82a3-ffe314fa3712") : secret "monitoring-plugin-cert" not found
May 26 16:04:41.459333 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.459312    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-service-ca\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.459405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.459314    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-console-config\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.459473 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.459452    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-oauth-serving-cert\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.459603 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.459583    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-trusted-ca-bundle\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.461103 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.461079    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-oauth-config\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.461380 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.461358    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-serving-cert\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.467270 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.467251    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8rn\" (UniqueName: \"kubernetes.io/projected/a848c0f7-ad0e-4421-a4be-57f70c629670-kube-api-access-fz8rn\") pod \"console-864f7cdf8b-hnswn\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") " pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.493720 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.493686    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c2fe1b0-a9fc-4b74-9a78-82070ff232bc" path="/var/lib/kubelet/pods/6c2fe1b0-a9fc-4b74-9a78-82070ff232bc/volumes"
May 26 16:04:41.549170 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.549143    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:41.961717 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.961677    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea269d77-4959-4804-82a3-ffe314fa3712-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-rkx82\" (UID: \"ea269d77-4959-4804-82a3-ffe314fa3712\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"
May 26 16:04:41.964734 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:41.964701    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea269d77-4959-4804-82a3-ffe314fa3712-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-rkx82\" (UID: \"ea269d77-4959-4804-82a3-ffe314fa3712\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"
May 26 16:04:42.116268 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:42.116239    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"
May 26 16:04:42.171884 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:42.171864    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864f7cdf8b-hnswn"]
May 26 16:04:42.244244 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:42.244213    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"]
May 26 16:04:42.388637 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:04:42.388600    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea269d77_4959_4804_82a3_ffe314fa3712.slice/crio-badb3731da0ccc44e11cd18482175fb1c628017b8739db8e472e37a70d90130a WatchSource:0}: Error finding container badb3731da0ccc44e11cd18482175fb1c628017b8739db8e472e37a70d90130a: Status 404 returned error can't find the container with id badb3731da0ccc44e11cd18482175fb1c628017b8739db8e472e37a70d90130a
May 26 16:04:43.156330 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:43.156248    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82" event={"ID":"ea269d77-4959-4804-82a3-ffe314fa3712","Type":"ContainerStarted","Data":"badb3731da0ccc44e11cd18482175fb1c628017b8739db8e472e37a70d90130a"}
May 26 16:04:43.158637 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:43.158606    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8" event={"ID":"ec62e47e-f33f-4a8b-99fe-58a282736ba4","Type":"ContainerStarted","Data":"abafa8d7749f55673d96d08817a53335de2a75cfa41b1c5d7bc24d2885c7216c"}
May 26 16:04:43.158766 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:43.158644    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8" event={"ID":"ec62e47e-f33f-4a8b-99fe-58a282736ba4","Type":"ContainerStarted","Data":"8f93998c9b0d696caf973b5976199f6a86c5be24ea15216488e6cbb9c53ecd7e"}
May 26 16:04:43.158766 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:43.158658    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8" event={"ID":"ec62e47e-f33f-4a8b-99fe-58a282736ba4","Type":"ContainerStarted","Data":"291ed8a6aeb761b40a7bf1d244cfb8a9a0807fdf504d0a12169f566b33fac3ed"}
May 26 16:04:43.160160 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:43.160119    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864f7cdf8b-hnswn" event={"ID":"a848c0f7-ad0e-4421-a4be-57f70c629670","Type":"ContainerStarted","Data":"2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def"}
May 26 16:04:43.160278 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:43.160170    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864f7cdf8b-hnswn" event={"ID":"a848c0f7-ad0e-4421-a4be-57f70c629670","Type":"ContainerStarted","Data":"6182445804e99875b318bb7f0d4e72285490f9c5b68ef8980c8cfd409856801b"}
May 26 16:04:43.179928 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:43.179888    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-864f7cdf8b-hnswn" podStartSLOduration=2.179875876 podStartE2EDuration="2.179875876s" podCreationTimestamp="2026-05-26 16:04:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:04:43.178205041 +0000 UTC m=+190.288762823" watchObservedRunningTime="2026-05-26 16:04:43.179875876 +0000 UTC m=+190.290433665"
May 26 16:04:45.167832 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:45.167794    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82" event={"ID":"ea269d77-4959-4804-82a3-ffe314fa3712","Type":"ContainerStarted","Data":"4cb01fc6929c49bcb71275b3d68d0de99bdb54f1f150628d482e56d502bd9158"}
May 26 16:04:45.168322 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:45.167973    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"
May 26 16:04:45.170742 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:45.170712    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8" event={"ID":"ec62e47e-f33f-4a8b-99fe-58a282736ba4","Type":"ContainerStarted","Data":"3e199f7167e42ec1455e580f6704202ab1cf5c5e7e70d0d95039e58e440ada37"}
May 26 16:04:45.170863 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:45.170747    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8" event={"ID":"ec62e47e-f33f-4a8b-99fe-58a282736ba4","Type":"ContainerStarted","Data":"04e966fbd7f842eb9ab53d1cb4054031116a5ea45ab66ea838331124278d6944"}
May 26 16:04:45.170863 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:45.170760    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8" event={"ID":"ec62e47e-f33f-4a8b-99fe-58a282736ba4","Type":"ContainerStarted","Data":"f4a2d2c3fc71f772d99b71ccc09e816c258918f8a3a917dfa84058e030b37c18"}
May 26 16:04:45.170863 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:45.170858    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:45.173350 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:45.173327    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82"
May 26 16:04:45.181988 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:45.181945    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-rkx82" podStartSLOduration=2.231423184 podStartE2EDuration="4.181933166s" podCreationTimestamp="2026-05-26 16:04:41 +0000 UTC" firstStartedPulling="2026-05-26 16:04:42.413564017 +0000 UTC m=+189.524121789" lastFinishedPulling="2026-05-26 16:04:44.364073987 +0000 UTC m=+191.474631771" observedRunningTime="2026-05-26 16:04:45.181429975 +0000 UTC m=+192.291987768" watchObservedRunningTime="2026-05-26 16:04:45.181933166 +0000 UTC m=+192.292491002"
May 26 16:04:45.201049 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:45.201012    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8" podStartSLOduration=1.689860682 podStartE2EDuration="6.200986308s" podCreationTimestamp="2026-05-26 16:04:39 +0000 UTC" firstStartedPulling="2026-05-26 16:04:39.857042387 +0000 UTC m=+186.967600159" lastFinishedPulling="2026-05-26 16:04:44.368167998 +0000 UTC m=+191.478725785" observedRunningTime="2026-05-26 16:04:45.200036838 +0000 UTC m=+192.310594630" watchObservedRunningTime="2026-05-26 16:04:45.200986308 +0000 UTC m=+192.311544099"
May 26 16:04:51.180172 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:51.180144    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-65465c5db5-d42q8"
May 26 16:04:51.549504 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:51.549465    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:51.550281 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:51.550256    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:51.555351 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:51.555327    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:52.195096 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:52.195066    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:04:52.237647 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:52.237620    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f7568db95-sjm8x"]
May 26 16:04:59.214657 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:59.214622    2567 generic.go:358] "Generic (PLEG): container finished" podID="b66e3c90-b65a-4101-b103-487d5b168a2c" containerID="fe7ee711c0b5ae91cad2503aa2608b2e606a89615105e63edf976b74cca1c44e" exitCode=0
May 26 16:04:59.215142 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:59.214698    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554" event={"ID":"b66e3c90-b65a-4101-b103-487d5b168a2c","Type":"ContainerDied","Data":"fe7ee711c0b5ae91cad2503aa2608b2e606a89615105e63edf976b74cca1c44e"}
May 26 16:04:59.215142 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:04:59.215108    2567 scope.go:117] "RemoveContainer" containerID="fe7ee711c0b5ae91cad2503aa2608b2e606a89615105e63edf976b74cca1c44e"
May 26 16:05:00.218978 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:00.218938    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2n554" event={"ID":"b66e3c90-b65a-4101-b103-487d5b168a2c","Type":"ContainerStarted","Data":"44e6b496916438537454eb4fcef54fc80f229ffbca45a226bdf845ab223aedb7"}
May 26 16:05:08.181223 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.181156    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-8546d986dd-hf27v" podUID="25481c18-d114-449a-a0e1-f088645eae88" containerName="console" containerID="cri-o://3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae" gracePeriod=15
May 26 16:05:08.476832 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.476808    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8546d986dd-hf27v_25481c18-d114-449a-a0e1-f088645eae88/console/0.log"
May 26 16:05:08.476925 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.476867    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:05:08.666469 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.666439    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-trusted-ca-bundle\") pod \"25481c18-d114-449a-a0e1-f088645eae88\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") "
May 26 16:05:08.666469 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.666472    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-serving-cert\") pod \"25481c18-d114-449a-a0e1-f088645eae88\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") "
May 26 16:05:08.666691 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.666492    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p267g\" (UniqueName: \"kubernetes.io/projected/25481c18-d114-449a-a0e1-f088645eae88-kube-api-access-p267g\") pod \"25481c18-d114-449a-a0e1-f088645eae88\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") "
May 26 16:05:08.666691 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.666527    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-console-config\") pod \"25481c18-d114-449a-a0e1-f088645eae88\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") "
May 26 16:05:08.666691 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.666556    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-oauth-serving-cert\") pod \"25481c18-d114-449a-a0e1-f088645eae88\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") "
May 26 16:05:08.666691 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.666614    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-service-ca\") pod \"25481c18-d114-449a-a0e1-f088645eae88\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") "
May 26 16:05:08.666691 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.666662    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-oauth-config\") pod \"25481c18-d114-449a-a0e1-f088645eae88\" (UID: \"25481c18-d114-449a-a0e1-f088645eae88\") "
May 26 16:05:08.667015 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.666967    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "25481c18-d114-449a-a0e1-f088645eae88" (UID: "25481c18-d114-449a-a0e1-f088645eae88"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:05:08.667108 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.667075    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25481c18-d114-449a-a0e1-f088645eae88" (UID: "25481c18-d114-449a-a0e1-f088645eae88"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:05:08.667159 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.667095    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-console-config" (OuterVolumeSpecName: "console-config") pod "25481c18-d114-449a-a0e1-f088645eae88" (UID: "25481c18-d114-449a-a0e1-f088645eae88"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:05:08.667268 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.667241    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-service-ca" (OuterVolumeSpecName: "service-ca") pod "25481c18-d114-449a-a0e1-f088645eae88" (UID: "25481c18-d114-449a-a0e1-f088645eae88"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:05:08.668832 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.668802    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25481c18-d114-449a-a0e1-f088645eae88" (UID: "25481c18-d114-449a-a0e1-f088645eae88"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:05:08.668927 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.668875    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25481c18-d114-449a-a0e1-f088645eae88-kube-api-access-p267g" (OuterVolumeSpecName: "kube-api-access-p267g") pod "25481c18-d114-449a-a0e1-f088645eae88" (UID: "25481c18-d114-449a-a0e1-f088645eae88"). InnerVolumeSpecName "kube-api-access-p267g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:05:08.668927 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.668908    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25481c18-d114-449a-a0e1-f088645eae88" (UID: "25481c18-d114-449a-a0e1-f088645eae88"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:05:08.767959 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.767936    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-trusted-ca-bundle\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:08.767959 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.767959    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:08.768138 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.767969    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p267g\" (UniqueName: \"kubernetes.io/projected/25481c18-d114-449a-a0e1-f088645eae88-kube-api-access-p267g\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:08.768138 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.767980    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-console-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:08.768138 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.767990    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-oauth-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:08.768138 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.768020    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25481c18-d114-449a-a0e1-f088645eae88-service-ca\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:08.768138 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:08.768032    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25481c18-d114-449a-a0e1-f088645eae88-console-oauth-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:09.245144 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.245116    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8546d986dd-hf27v_25481c18-d114-449a-a0e1-f088645eae88/console/0.log"
May 26 16:05:09.245563 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.245155    2567 generic.go:358] "Generic (PLEG): container finished" podID="25481c18-d114-449a-a0e1-f088645eae88" containerID="3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae" exitCode=2
May 26 16:05:09.245563 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.245219    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8546d986dd-hf27v"
May 26 16:05:09.245563 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.245232    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8546d986dd-hf27v" event={"ID":"25481c18-d114-449a-a0e1-f088645eae88","Type":"ContainerDied","Data":"3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae"}
May 26 16:05:09.245563 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.245259    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8546d986dd-hf27v" event={"ID":"25481c18-d114-449a-a0e1-f088645eae88","Type":"ContainerDied","Data":"c21db81c59e1d0ab902d667303ac765db9689e13e7c28d89bdc47d50f0dc1580"}
May 26 16:05:09.245563 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.245273    2567 scope.go:117] "RemoveContainer" containerID="3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae"
May 26 16:05:09.260072 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.260047    2567 scope.go:117] "RemoveContainer" containerID="3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae"
May 26 16:05:09.260293 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:05:09.260273    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae\": container with ID starting with 3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae not found: ID does not exist" containerID="3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae"
May 26 16:05:09.260343 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.260301    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae"} err="failed to get container status \"3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae\": rpc error: code = NotFound desc = could not find container \"3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae\": container with ID starting with 3066eb430570c5374dcd06a89e029a28ad2a6ee53de85742aafda592f9b9a4ae not found: ID does not exist"
May 26 16:05:09.264565 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.264544    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8546d986dd-hf27v"]
May 26 16:05:09.268119 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.268100    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8546d986dd-hf27v"]
May 26 16:05:09.493497 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:09.493463    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25481c18-d114-449a-a0e1-f088645eae88" path="/var/lib/kubelet/pods/25481c18-d114-449a-a0e1-f088645eae88/volumes"
May 26 16:05:17.256756 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.256691    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f7568db95-sjm8x" podUID="5ec1298c-caf5-4864-8da8-510b1720f58d" containerName="console" containerID="cri-o://d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351" gracePeriod=15
May 26 16:05:17.513703 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.513642    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f7568db95-sjm8x_5ec1298c-caf5-4864-8da8-510b1720f58d/console/0.log"
May 26 16:05:17.513703 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.513696    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:05:17.543354 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543331    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-console-config\") pod \"5ec1298c-caf5-4864-8da8-510b1720f58d\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") "
May 26 16:05:17.543482 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543385    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-service-ca\") pod \"5ec1298c-caf5-4864-8da8-510b1720f58d\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") "
May 26 16:05:17.543568 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543551    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slzs2\" (UniqueName: \"kubernetes.io/projected/5ec1298c-caf5-4864-8da8-510b1720f58d-kube-api-access-slzs2\") pod \"5ec1298c-caf5-4864-8da8-510b1720f58d\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") "
May 26 16:05:17.543619 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543594    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-oauth-config\") pod \"5ec1298c-caf5-4864-8da8-510b1720f58d\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") "
May 26 16:05:17.543675 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543621    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-oauth-serving-cert\") pod \"5ec1298c-caf5-4864-8da8-510b1720f58d\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") "
May 26 16:05:17.543675 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543655    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-serving-cert\") pod \"5ec1298c-caf5-4864-8da8-510b1720f58d\" (UID: \"5ec1298c-caf5-4864-8da8-510b1720f58d\") "
May 26 16:05:17.543774 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543735    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-console-config" (OuterVolumeSpecName: "console-config") pod "5ec1298c-caf5-4864-8da8-510b1720f58d" (UID: "5ec1298c-caf5-4864-8da8-510b1720f58d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:05:17.543774 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543742    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ec1298c-caf5-4864-8da8-510b1720f58d" (UID: "5ec1298c-caf5-4864-8da8-510b1720f58d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:05:17.543890 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543870    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-service-ca\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:17.543949 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543892    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-console-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:17.544028 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.543990    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ec1298c-caf5-4864-8da8-510b1720f58d" (UID: "5ec1298c-caf5-4864-8da8-510b1720f58d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:05:17.545678 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.545651    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ec1298c-caf5-4864-8da8-510b1720f58d" (UID: "5ec1298c-caf5-4864-8da8-510b1720f58d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:05:17.545773 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.545674    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ec1298c-caf5-4864-8da8-510b1720f58d" (UID: "5ec1298c-caf5-4864-8da8-510b1720f58d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:05:17.545773 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.545736    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec1298c-caf5-4864-8da8-510b1720f58d-kube-api-access-slzs2" (OuterVolumeSpecName: "kube-api-access-slzs2") pod "5ec1298c-caf5-4864-8da8-510b1720f58d" (UID: "5ec1298c-caf5-4864-8da8-510b1720f58d"). InnerVolumeSpecName "kube-api-access-slzs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:05:17.644270 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.644240    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slzs2\" (UniqueName: \"kubernetes.io/projected/5ec1298c-caf5-4864-8da8-510b1720f58d-kube-api-access-slzs2\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:17.644270 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.644266    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-oauth-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:17.644270 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.644276    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec1298c-caf5-4864-8da8-510b1720f58d-oauth-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:17.644454 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:17.644285    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec1298c-caf5-4864-8da8-510b1720f58d-console-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:05:18.271541 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.271514    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f7568db95-sjm8x_5ec1298c-caf5-4864-8da8-510b1720f58d/console/0.log"
May 26 16:05:18.271944 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.271551    2567 generic.go:358] "Generic (PLEG): container finished" podID="5ec1298c-caf5-4864-8da8-510b1720f58d" containerID="d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351" exitCode=2
May 26 16:05:18.271944 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.271584    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7568db95-sjm8x" event={"ID":"5ec1298c-caf5-4864-8da8-510b1720f58d","Type":"ContainerDied","Data":"d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351"}
May 26 16:05:18.271944 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.271611    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7568db95-sjm8x"
May 26 16:05:18.271944 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.271620    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7568db95-sjm8x" event={"ID":"5ec1298c-caf5-4864-8da8-510b1720f58d","Type":"ContainerDied","Data":"5a1132f026373edf735d0357b28080ee96f3815cf8c5ec964c2968250c166237"}
May 26 16:05:18.271944 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.271638    2567 scope.go:117] "RemoveContainer" containerID="d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351"
May 26 16:05:18.279313 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.279298    2567 scope.go:117] "RemoveContainer" containerID="d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351"
May 26 16:05:18.279567 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:05:18.279544    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351\": container with ID starting with d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351 not found: ID does not exist" containerID="d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351"
May 26 16:05:18.279658 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.279572    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351"} err="failed to get container status \"d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351\": rpc error: code = NotFound desc = could not find container \"d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351\": container with ID starting with d5882796315941f42724c88636773710a5fe9ef2ed5adfbba4a9dbc6c122f351 not found: ID does not exist"
May 26 16:05:18.290643 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.290623    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f7568db95-sjm8x"]
May 26 16:05:18.293973 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:18.293954    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f7568db95-sjm8x"]
May 26 16:05:19.492920 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:19.492888    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ec1298c-caf5-4864-8da8-510b1720f58d" path="/var/lib/kubelet/pods/5ec1298c-caf5-4864-8da8-510b1720f58d/volumes"
May 26 16:05:44.358129 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:44.358091    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:05:44.360264 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:44.360245    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e-metrics-certs\") pod \"network-metrics-daemon-6lm2r\" (UID: \"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e\") " pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:05:44.592981 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:44.592956    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fjs6m\""
May 26 16:05:44.600900 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:44.600880    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6lm2r"
May 26 16:05:44.721335 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:44.721307    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6lm2r"]
May 26 16:05:44.722327 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:05:44.722292    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4afe74f9_5fdc_4aeb_8b6a_5bc60dd1e76e.slice/crio-57f0114d09eb94a1a3f879b6ce2865e41e0aa4c9193e9a5bd237dd9a325e6340 WatchSource:0}: Error finding container 57f0114d09eb94a1a3f879b6ce2865e41e0aa4c9193e9a5bd237dd9a325e6340: Status 404 returned error can't find the container with id 57f0114d09eb94a1a3f879b6ce2865e41e0aa4c9193e9a5bd237dd9a325e6340
May 26 16:05:45.353773 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:45.353732    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6lm2r" event={"ID":"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e","Type":"ContainerStarted","Data":"57f0114d09eb94a1a3f879b6ce2865e41e0aa4c9193e9a5bd237dd9a325e6340"}
May 26 16:05:46.363015 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:46.362965    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6lm2r" event={"ID":"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e","Type":"ContainerStarted","Data":"f6d94959f4a54a9c2e909440d7ca3300e78a3bd64069ef4db39f16c89262c64a"}
May 26 16:05:46.363407 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:46.363025    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6lm2r" event={"ID":"4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e","Type":"ContainerStarted","Data":"d61fd50ae2b088952dd57ac7aa3d87bbe8afbd21301260d5c7364cb0f8f9a0ae"}
May 26 16:05:46.379289 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:05:46.379239    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6lm2r" podStartSLOduration=252.478620895 podStartE2EDuration="4m13.379227987s" podCreationTimestamp="2026-05-26 16:01:33 +0000 UTC" firstStartedPulling="2026-05-26 16:05:44.724038494 +0000 UTC m=+251.834596265" lastFinishedPulling="2026-05-26 16:05:45.624645587 +0000 UTC m=+252.735203357" observedRunningTime="2026-05-26 16:05:46.378226165 +0000 UTC m=+253.488783968" watchObservedRunningTime="2026-05-26 16:05:46.379227987 +0000 UTC m=+253.489785780"
May 26 16:06:00.649962 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.649871    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cd94686dc-2wldh"]
May 26 16:06:00.650577 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.650552    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25481c18-d114-449a-a0e1-f088645eae88" containerName="console"
May 26 16:06:00.650644 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.650580    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="25481c18-d114-449a-a0e1-f088645eae88" containerName="console"
May 26 16:06:00.650644 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.650618    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec1298c-caf5-4864-8da8-510b1720f58d" containerName="console"
May 26 16:06:00.650644 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.650628    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec1298c-caf5-4864-8da8-510b1720f58d" containerName="console"
May 26 16:06:00.650781 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.650755    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ec1298c-caf5-4864-8da8-510b1720f58d" containerName="console"
May 26 16:06:00.650781 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.650771    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="25481c18-d114-449a-a0e1-f088645eae88" containerName="console"
May 26 16:06:00.655556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.655529    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.658661 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.658636    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 26 16:06:00.658827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.658684    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nws8f\""
May 26 16:06:00.658827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.658639    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 26 16:06:00.658827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.658639    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 26 16:06:00.659051 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.658688    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 26 16:06:00.659051 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.658639    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 26 16:06:00.666149 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.666081    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 26 16:06:00.667324 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.667301    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cd94686dc-2wldh"]
May 26 16:06:00.782763 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.782721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-federate-client-tls\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.782937 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.782779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.782937 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.782809    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73200007-6318-4267-9c0f-3640f0b8ffd6-serving-certs-ca-bundle\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.782937 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.782849    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73200007-6318-4267-9c0f-3640f0b8ffd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.783114 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.782945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-secret-telemeter-client\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.783114 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.782981    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-telemeter-client-tls\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.783114 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.783026    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73200007-6318-4267-9c0f-3640f0b8ffd6-metrics-client-ca\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.783114 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.783084    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c59b7\" (UniqueName: \"kubernetes.io/projected/73200007-6318-4267-9c0f-3640f0b8ffd6-kube-api-access-c59b7\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.884079 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884037    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73200007-6318-4267-9c0f-3640f0b8ffd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.884259 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884090    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-secret-telemeter-client\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.884259 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884115    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-telemeter-client-tls\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.884259 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884205    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73200007-6318-4267-9c0f-3640f0b8ffd6-metrics-client-ca\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.884418 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884281    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c59b7\" (UniqueName: \"kubernetes.io/projected/73200007-6318-4267-9c0f-3640f0b8ffd6-kube-api-access-c59b7\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.884418 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884315    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-federate-client-tls\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.884418 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884345    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.884418 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884374    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73200007-6318-4267-9c0f-3640f0b8ffd6-serving-certs-ca-bundle\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.884981 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884954    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73200007-6318-4267-9c0f-3640f0b8ffd6-metrics-client-ca\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.885138 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884977    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73200007-6318-4267-9c0f-3640f0b8ffd6-serving-certs-ca-bundle\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.885138 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.884981    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73200007-6318-4267-9c0f-3640f0b8ffd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.886773 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.886738    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-secret-telemeter-client\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.886891 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.886803    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.887229 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.887209    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-telemeter-client-tls\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.887357 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.887335    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/73200007-6318-4267-9c0f-3640f0b8ffd6-federate-client-tls\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.892070 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.892048    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c59b7\" (UniqueName: \"kubernetes.io/projected/73200007-6318-4267-9c0f-3640f0b8ffd6-kube-api-access-c59b7\") pod \"telemeter-client-7cd94686dc-2wldh\" (UID: \"73200007-6318-4267-9c0f-3640f0b8ffd6\") " pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:00.969035 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:00.968585    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh"
May 26 16:06:01.107591 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:01.107560    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cd94686dc-2wldh"]
May 26 16:06:01.110383 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:06:01.110353    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73200007_6318_4267_9c0f_3640f0b8ffd6.slice/crio-85ca4ca810fd4affbf89393e6e9b924d0e1908f7515033b10a669325f1dca96e WatchSource:0}: Error finding container 85ca4ca810fd4affbf89393e6e9b924d0e1908f7515033b10a669325f1dca96e: Status 404 returned error can't find the container with id 85ca4ca810fd4affbf89393e6e9b924d0e1908f7515033b10a669325f1dca96e
May 26 16:06:01.409221 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:01.409133    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh" event={"ID":"73200007-6318-4267-9c0f-3640f0b8ffd6","Type":"ContainerStarted","Data":"85ca4ca810fd4affbf89393e6e9b924d0e1908f7515033b10a669325f1dca96e"}
May 26 16:06:03.415181 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:03.415095    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh" event={"ID":"73200007-6318-4267-9c0f-3640f0b8ffd6","Type":"ContainerStarted","Data":"5795d0c81253ab66db6c06fd396ebd076111d7077480735e00c62693c9bf8f74"}
May 26 16:06:05.423061 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:05.423019    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh" event={"ID":"73200007-6318-4267-9c0f-3640f0b8ffd6","Type":"ContainerStarted","Data":"bbf53ad74d86dcb0cd8004f858740d81f44c5a375feb05fce17f621f9d0e0ab6"}
May 26 16:06:05.423061 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:05.423062    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh" event={"ID":"73200007-6318-4267-9c0f-3640f0b8ffd6","Type":"ContainerStarted","Data":"db97c8ee395b11389345eaa0c02ff58338a02b0fec9321b3cd0883e3e9c992f1"}
May 26 16:06:05.443375 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:05.443327    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cd94686dc-2wldh" podStartSLOduration=2.204125357 podStartE2EDuration="5.443315455s" podCreationTimestamp="2026-05-26 16:06:00 +0000 UTC" firstStartedPulling="2026-05-26 16:06:01.112749483 +0000 UTC m=+268.223307255" lastFinishedPulling="2026-05-26 16:06:04.35193958 +0000 UTC m=+271.462497353" observedRunningTime="2026-05-26 16:06:05.441870411 +0000 UTC m=+272.552428203" watchObservedRunningTime="2026-05-26 16:06:05.443315455 +0000 UTC m=+272.553873247"
May 26 16:06:06.102686 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.102655    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-85cc55fd79-qkw6q"]
May 26 16:06:06.104672 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.104655    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.114865 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.114839    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85cc55fd79-qkw6q"]
May 26 16:06:06.228390 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.228355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-oauth-config\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.228390 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.228390    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-oauth-serving-cert\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.228614 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.228409    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-serving-cert\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.228614 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.228496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-service-ca\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.228614 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.228541    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-trusted-ca-bundle\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.228722 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.228618    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-config\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.228722 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.228665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wpm7\" (UniqueName: \"kubernetes.io/projected/dee964ab-54b3-4668-b8a6-e7cbdb46e549-kube-api-access-6wpm7\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.329139 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.329117    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-config\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.329266 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.329159    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wpm7\" (UniqueName: \"kubernetes.io/projected/dee964ab-54b3-4668-b8a6-e7cbdb46e549-kube-api-access-6wpm7\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.329266 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.329216    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-oauth-config\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.329266 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.329233    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-oauth-serving-cert\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.329266 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.329254    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-serving-cert\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.329466 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.329273    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-service-ca\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.329466 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.329393    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-trusted-ca-bundle\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.329861 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.329834    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-config\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.330035 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.329874    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-oauth-serving-cert\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.330192 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.330161    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-service-ca\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.330252 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.330238    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-trusted-ca-bundle\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.331676 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.331651    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-serving-cert\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.331754 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.331727    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-oauth-config\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.336620 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.336595    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wpm7\" (UniqueName: \"kubernetes.io/projected/dee964ab-54b3-4668-b8a6-e7cbdb46e549-kube-api-access-6wpm7\") pod \"console-85cc55fd79-qkw6q\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") " pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.413083 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.413032    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:06.533796 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:06.533766    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85cc55fd79-qkw6q"]
May 26 16:06:06.535986 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:06:06.535959    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee964ab_54b3_4668_b8a6_e7cbdb46e549.slice/crio-7f73da6095b7263ed9790fec5c8053b20ad532719a9b77ca1d2d1dffddf96691 WatchSource:0}: Error finding container 7f73da6095b7263ed9790fec5c8053b20ad532719a9b77ca1d2d1dffddf96691: Status 404 returned error can't find the container with id 7f73da6095b7263ed9790fec5c8053b20ad532719a9b77ca1d2d1dffddf96691
May 26 16:06:07.430205 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:07.430168    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cc55fd79-qkw6q" event={"ID":"dee964ab-54b3-4668-b8a6-e7cbdb46e549","Type":"ContainerStarted","Data":"191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b"}
May 26 16:06:07.430205 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:07.430210    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cc55fd79-qkw6q" event={"ID":"dee964ab-54b3-4668-b8a6-e7cbdb46e549","Type":"ContainerStarted","Data":"7f73da6095b7263ed9790fec5c8053b20ad532719a9b77ca1d2d1dffddf96691"}
May 26 16:06:07.447057 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:07.446991    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-85cc55fd79-qkw6q" podStartSLOduration=1.4469791779999999 podStartE2EDuration="1.446979178s" podCreationTimestamp="2026-05-26 16:06:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:06:07.445616106 +0000 UTC m=+274.556173899" watchObservedRunningTime="2026-05-26 16:06:07.446979178 +0000 UTC m=+274.557536970"
May 26 16:06:16.414166 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:16.414112    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:16.414166 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:16.414181    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:16.419039 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:16.418991    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:16.466260 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:16.466236    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:06:16.510114 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:16.510085    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-864f7cdf8b-hnswn"]
May 26 16:06:33.414083 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:33.414042    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:06:33.414569 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:33.414327    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:06:33.422789 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:33.422757    2567 kubelet.go:1628] "Image garbage collection succeeded"
May 26 16:06:41.528494 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.528457    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-864f7cdf8b-hnswn" podUID="a848c0f7-ad0e-4421-a4be-57f70c629670" containerName="console" containerID="cri-o://2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def" gracePeriod=15
May 26 16:06:41.780053 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.779985    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-864f7cdf8b-hnswn_a848c0f7-ad0e-4421-a4be-57f70c629670/console/0.log"
May 26 16:06:41.780157 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.780074    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:06:41.880628 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.880599    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-oauth-config\") pod \"a848c0f7-ad0e-4421-a4be-57f70c629670\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") "
May 26 16:06:41.880787 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.880645    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-trusted-ca-bundle\") pod \"a848c0f7-ad0e-4421-a4be-57f70c629670\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") "
May 26 16:06:41.880787 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.880681    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-oauth-serving-cert\") pod \"a848c0f7-ad0e-4421-a4be-57f70c629670\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") "
May 26 16:06:41.880787 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.880757    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-console-config\") pod \"a848c0f7-ad0e-4421-a4be-57f70c629670\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") "
May 26 16:06:41.880963 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.880790    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-service-ca\") pod \"a848c0f7-ad0e-4421-a4be-57f70c629670\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") "
May 26 16:06:41.880963 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.880823    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-serving-cert\") pod \"a848c0f7-ad0e-4421-a4be-57f70c629670\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") "
May 26 16:06:41.880963 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.880850    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz8rn\" (UniqueName: \"kubernetes.io/projected/a848c0f7-ad0e-4421-a4be-57f70c629670-kube-api-access-fz8rn\") pod \"a848c0f7-ad0e-4421-a4be-57f70c629670\" (UID: \"a848c0f7-ad0e-4421-a4be-57f70c629670\") "
May 26 16:06:41.881150 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.881120    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a848c0f7-ad0e-4421-a4be-57f70c629670" (UID: "a848c0f7-ad0e-4421-a4be-57f70c629670"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:06:41.881221 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.881160    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-console-config" (OuterVolumeSpecName: "console-config") pod "a848c0f7-ad0e-4421-a4be-57f70c629670" (UID: "a848c0f7-ad0e-4421-a4be-57f70c629670"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:06:41.881221 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.881170    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a848c0f7-ad0e-4421-a4be-57f70c629670" (UID: "a848c0f7-ad0e-4421-a4be-57f70c629670"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:06:41.881221 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.881177    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-service-ca" (OuterVolumeSpecName: "service-ca") pod "a848c0f7-ad0e-4421-a4be-57f70c629670" (UID: "a848c0f7-ad0e-4421-a4be-57f70c629670"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:06:41.882739 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.882715    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a848c0f7-ad0e-4421-a4be-57f70c629670" (UID: "a848c0f7-ad0e-4421-a4be-57f70c629670"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:06:41.882854 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.882741    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a848c0f7-ad0e-4421-a4be-57f70c629670" (UID: "a848c0f7-ad0e-4421-a4be-57f70c629670"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:06:41.882854 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.882814    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a848c0f7-ad0e-4421-a4be-57f70c629670-kube-api-access-fz8rn" (OuterVolumeSpecName: "kube-api-access-fz8rn") pod "a848c0f7-ad0e-4421-a4be-57f70c629670" (UID: "a848c0f7-ad0e-4421-a4be-57f70c629670"). InnerVolumeSpecName "kube-api-access-fz8rn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:06:41.982074 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.982035    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-console-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:06:41.982074 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.982070    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-service-ca\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:06:41.982074 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.982081    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:06:41.982272 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.982090    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz8rn\" (UniqueName: \"kubernetes.io/projected/a848c0f7-ad0e-4421-a4be-57f70c629670-kube-api-access-fz8rn\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:06:41.982272 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.982099    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a848c0f7-ad0e-4421-a4be-57f70c629670-console-oauth-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:06:41.982272 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.982107    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-trusted-ca-bundle\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:06:41.982272 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:41.982116    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a848c0f7-ad0e-4421-a4be-57f70c629670-oauth-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:06:42.538332 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.538305    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-864f7cdf8b-hnswn_a848c0f7-ad0e-4421-a4be-57f70c629670/console/0.log"
May 26 16:06:42.538796 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.538343    2567 generic.go:358] "Generic (PLEG): container finished" podID="a848c0f7-ad0e-4421-a4be-57f70c629670" containerID="2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def" exitCode=2
May 26 16:06:42.538796 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.538377    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864f7cdf8b-hnswn" event={"ID":"a848c0f7-ad0e-4421-a4be-57f70c629670","Type":"ContainerDied","Data":"2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def"}
May 26 16:06:42.538796 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.538428    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864f7cdf8b-hnswn" event={"ID":"a848c0f7-ad0e-4421-a4be-57f70c629670","Type":"ContainerDied","Data":"6182445804e99875b318bb7f0d4e72285490f9c5b68ef8980c8cfd409856801b"}
May 26 16:06:42.538796 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.538429    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864f7cdf8b-hnswn"
May 26 16:06:42.538796 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.538492    2567 scope.go:117] "RemoveContainer" containerID="2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def"
May 26 16:06:42.546483 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.546468    2567 scope.go:117] "RemoveContainer" containerID="2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def"
May 26 16:06:42.546741 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:06:42.546719    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def\": container with ID starting with 2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def not found: ID does not exist" containerID="2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def"
May 26 16:06:42.546796 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.546748    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def"} err="failed to get container status \"2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def\": rpc error: code = NotFound desc = could not find container \"2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def\": container with ID starting with 2bee9fb8084ec88b38516513c647f782dc63f87705cd363d6e60dfc04dc45def not found: ID does not exist"
May 26 16:06:42.558030 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.558009    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-864f7cdf8b-hnswn"]
May 26 16:06:42.561478 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:42.561458    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-864f7cdf8b-hnswn"]
May 26 16:06:43.493291 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:06:43.493260    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a848c0f7-ad0e-4421-a4be-57f70c629670" path="/var/lib/kubelet/pods/a848c0f7-ad0e-4421-a4be-57f70c629670/volumes"
May 26 16:07:12.103270 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.103238    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d665f884f-njv2h"]
May 26 16:07:12.103641 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.103527    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a848c0f7-ad0e-4421-a4be-57f70c629670" containerName="console"
May 26 16:07:12.103641 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.103538    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a848c0f7-ad0e-4421-a4be-57f70c629670" containerName="console"
May 26 16:07:12.103641 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.103595    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="a848c0f7-ad0e-4421-a4be-57f70c629670" containerName="console"
May 26 16:07:12.105385 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.105363    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.116986 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.116962    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d665f884f-njv2h"]
May 26 16:07:12.204296 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.204262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-oauth-config\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.204296 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.204297    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-service-ca\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.204464 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.204323    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-serving-cert\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.204464 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.204405    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkbvr\" (UniqueName: \"kubernetes.io/projected/c44abbfc-2060-4745-b130-47185bc6df74-kube-api-access-gkbvr\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.204464 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.204437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-console-config\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.204464 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.204457    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-trusted-ca-bundle\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.204577 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.204505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-oauth-serving-cert\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.305238 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.305210    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkbvr\" (UniqueName: \"kubernetes.io/projected/c44abbfc-2060-4745-b130-47185bc6df74-kube-api-access-gkbvr\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.305328 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.305245    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-console-config\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.305328 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.305268    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-trusted-ca-bundle\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.305328 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.305294    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-oauth-serving-cert\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.305458 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.305337    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-oauth-config\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.305458 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.305354    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-service-ca\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.305458 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.305370    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-serving-cert\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.306096 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.306067    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-service-ca\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.306255 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.306227    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-trusted-ca-bundle\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.306342 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.306235    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-oauth-serving-cert\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.306342 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.306310    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-console-config\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.307824 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.307803    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-oauth-config\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.307898 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.307862    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-serving-cert\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.312276 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.312259    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkbvr\" (UniqueName: \"kubernetes.io/projected/c44abbfc-2060-4745-b130-47185bc6df74-kube-api-access-gkbvr\") pod \"console-6d665f884f-njv2h\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") " pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.414753 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.414683    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:12.535571 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.535541    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d665f884f-njv2h"]
May 26 16:07:12.538756 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:07:12.538727    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44abbfc_2060_4745_b130_47185bc6df74.slice/crio-552a67afb52a4e928d96fe13abcae631f8b0ba59753c8f7894de88744ac48d4e WatchSource:0}: Error finding container 552a67afb52a4e928d96fe13abcae631f8b0ba59753c8f7894de88744ac48d4e: Status 404 returned error can't find the container with id 552a67afb52a4e928d96fe13abcae631f8b0ba59753c8f7894de88744ac48d4e
May 26 16:07:12.541021 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.540983    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:07:12.623700 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.623663    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d665f884f-njv2h" event={"ID":"c44abbfc-2060-4745-b130-47185bc6df74","Type":"ContainerStarted","Data":"a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422"}
May 26 16:07:12.623855 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.623703    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d665f884f-njv2h" event={"ID":"c44abbfc-2060-4745-b130-47185bc6df74","Type":"ContainerStarted","Data":"552a67afb52a4e928d96fe13abcae631f8b0ba59753c8f7894de88744ac48d4e"}
May 26 16:07:12.640885 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:12.640835    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d665f884f-njv2h" podStartSLOduration=0.640819588 podStartE2EDuration="640.819588ms" podCreationTimestamp="2026-05-26 16:07:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:07:12.639087902 +0000 UTC m=+339.749645694" watchObservedRunningTime="2026-05-26 16:07:12.640819588 +0000 UTC m=+339.751377380"
May 26 16:07:22.415100 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:22.415065    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:22.415458 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:22.415139    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:22.419624 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:22.419602    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:22.659598 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:22.659565    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:07:22.704630 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:22.704528    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85cc55fd79-qkw6q"]
May 26 16:07:33.910953 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:33.910920    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lhh97"]
May 26 16:07:33.913121 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:33.913105    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:33.915252 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:33.915232    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 16:07:33.924025 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:33.923984    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhh97"]
May 26 16:07:34.075098 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.075065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fae7d651-a152-4e04-922a-86bcb8f7387d-kubelet-config\") pod \"global-pull-secret-syncer-lhh97\" (UID: \"fae7d651-a152-4e04-922a-86bcb8f7387d\") " pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.075098 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.075102    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7d651-a152-4e04-922a-86bcb8f7387d-original-pull-secret\") pod \"global-pull-secret-syncer-lhh97\" (UID: \"fae7d651-a152-4e04-922a-86bcb8f7387d\") " pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.075283 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.075129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fae7d651-a152-4e04-922a-86bcb8f7387d-dbus\") pod \"global-pull-secret-syncer-lhh97\" (UID: \"fae7d651-a152-4e04-922a-86bcb8f7387d\") " pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.176417 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.176332    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fae7d651-a152-4e04-922a-86bcb8f7387d-kubelet-config\") pod \"global-pull-secret-syncer-lhh97\" (UID: \"fae7d651-a152-4e04-922a-86bcb8f7387d\") " pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.176417 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.176370    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7d651-a152-4e04-922a-86bcb8f7387d-original-pull-secret\") pod \"global-pull-secret-syncer-lhh97\" (UID: \"fae7d651-a152-4e04-922a-86bcb8f7387d\") " pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.176581 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.176457    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fae7d651-a152-4e04-922a-86bcb8f7387d-kubelet-config\") pod \"global-pull-secret-syncer-lhh97\" (UID: \"fae7d651-a152-4e04-922a-86bcb8f7387d\") " pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.176581 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.176497    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fae7d651-a152-4e04-922a-86bcb8f7387d-dbus\") pod \"global-pull-secret-syncer-lhh97\" (UID: \"fae7d651-a152-4e04-922a-86bcb8f7387d\") " pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.176648 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.176625    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fae7d651-a152-4e04-922a-86bcb8f7387d-dbus\") pod \"global-pull-secret-syncer-lhh97\" (UID: \"fae7d651-a152-4e04-922a-86bcb8f7387d\") " pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.178528 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.178509    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7d651-a152-4e04-922a-86bcb8f7387d-original-pull-secret\") pod \"global-pull-secret-syncer-lhh97\" (UID: \"fae7d651-a152-4e04-922a-86bcb8f7387d\") " pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.221231 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.221202    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhh97"
May 26 16:07:34.339669 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.339643    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhh97"]
May 26 16:07:34.342123 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:07:34.342093    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfae7d651_a152_4e04_922a_86bcb8f7387d.slice/crio-bfc6a9391ad1260ffa229a90797051f364abd0f17be90185d88f04a4d2b1ad18 WatchSource:0}: Error finding container bfc6a9391ad1260ffa229a90797051f364abd0f17be90185d88f04a4d2b1ad18: Status 404 returned error can't find the container with id bfc6a9391ad1260ffa229a90797051f364abd0f17be90185d88f04a4d2b1ad18
May 26 16:07:34.690284 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:34.690249    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhh97" event={"ID":"fae7d651-a152-4e04-922a-86bcb8f7387d","Type":"ContainerStarted","Data":"bfc6a9391ad1260ffa229a90797051f364abd0f17be90185d88f04a4d2b1ad18"}
May 26 16:07:38.704646 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:38.704564    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhh97" event={"ID":"fae7d651-a152-4e04-922a-86bcb8f7387d","Type":"ContainerStarted","Data":"9552d001ea3f575e81de5063eb0a266dc47664267dd866aa938faa3dbb88d7fe"}
May 26 16:07:38.719556 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:38.719510    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lhh97" podStartSLOduration=1.8134869500000002 podStartE2EDuration="5.719496481s" podCreationTimestamp="2026-05-26 16:07:33 +0000 UTC" firstStartedPulling="2026-05-26 16:07:34.343730551 +0000 UTC m=+361.454288320" lastFinishedPulling="2026-05-26 16:07:38.249740081 +0000 UTC m=+365.360297851" observedRunningTime="2026-05-26 16:07:38.717623366 +0000 UTC m=+365.828181159" watchObservedRunningTime="2026-05-26 16:07:38.719496481 +0000 UTC m=+365.830054272"
May 26 16:07:47.723820 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.723749    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-85cc55fd79-qkw6q" podUID="dee964ab-54b3-4668-b8a6-e7cbdb46e549" containerName="console" containerID="cri-o://191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b" gracePeriod=15
May 26 16:07:47.963391 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.963368    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85cc55fd79-qkw6q_dee964ab-54b3-4668-b8a6-e7cbdb46e549/console/0.log"
May 26 16:07:47.963506 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.963439    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:07:47.968816 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.968794    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-serving-cert\") pod \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") "
May 26 16:07:47.968924 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.968835    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-oauth-config\") pod \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") "
May 26 16:07:47.968924 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.968870    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-trusted-ca-bundle\") pod \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") "
May 26 16:07:47.968924 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.968894    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-config\") pod \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") "
May 26 16:07:47.969104 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.968942    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-oauth-serving-cert\") pod \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") "
May 26 16:07:47.969104 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.968968    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-service-ca\") pod \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") "
May 26 16:07:47.969104 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.969038    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wpm7\" (UniqueName: \"kubernetes.io/projected/dee964ab-54b3-4668-b8a6-e7cbdb46e549-kube-api-access-6wpm7\") pod \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\" (UID: \"dee964ab-54b3-4668-b8a6-e7cbdb46e549\") "
May 26 16:07:47.969405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.969364    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-config" (OuterVolumeSpecName: "console-config") pod "dee964ab-54b3-4668-b8a6-e7cbdb46e549" (UID: "dee964ab-54b3-4668-b8a6-e7cbdb46e549"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:07:47.969405 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.969381    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dee964ab-54b3-4668-b8a6-e7cbdb46e549" (UID: "dee964ab-54b3-4668-b8a6-e7cbdb46e549"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:07:47.969531 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.969394    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dee964ab-54b3-4668-b8a6-e7cbdb46e549" (UID: "dee964ab-54b3-4668-b8a6-e7cbdb46e549"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:07:47.969531 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.969437    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-service-ca" (OuterVolumeSpecName: "service-ca") pod "dee964ab-54b3-4668-b8a6-e7cbdb46e549" (UID: "dee964ab-54b3-4668-b8a6-e7cbdb46e549"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:07:47.970929 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.970900    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dee964ab-54b3-4668-b8a6-e7cbdb46e549" (UID: "dee964ab-54b3-4668-b8a6-e7cbdb46e549"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:07:47.971024 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.970987    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dee964ab-54b3-4668-b8a6-e7cbdb46e549" (UID: "dee964ab-54b3-4668-b8a6-e7cbdb46e549"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:07:47.971087 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:47.971067    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee964ab-54b3-4668-b8a6-e7cbdb46e549-kube-api-access-6wpm7" (OuterVolumeSpecName: "kube-api-access-6wpm7") pod "dee964ab-54b3-4668-b8a6-e7cbdb46e549" (UID: "dee964ab-54b3-4668-b8a6-e7cbdb46e549"). InnerVolumeSpecName "kube-api-access-6wpm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:07:48.069572 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.069540    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wpm7\" (UniqueName: \"kubernetes.io/projected/dee964ab-54b3-4668-b8a6-e7cbdb46e549-kube-api-access-6wpm7\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:07:48.069572 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.069566    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:07:48.069572 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.069575    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-oauth-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:07:48.069792 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.069584    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-trusted-ca-bundle\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:07:48.069792 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.069593    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-console-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:07:48.069792 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.069602    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-oauth-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:07:48.069792 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.069612    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee964ab-54b3-4668-b8a6-e7cbdb46e549-service-ca\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:07:48.734883 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.734859    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85cc55fd79-qkw6q_dee964ab-54b3-4668-b8a6-e7cbdb46e549/console/0.log"
May 26 16:07:48.735303 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.734899    2567 generic.go:358] "Generic (PLEG): container finished" podID="dee964ab-54b3-4668-b8a6-e7cbdb46e549" containerID="191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b" exitCode=2
May 26 16:07:48.735303 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.734945    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cc55fd79-qkw6q" event={"ID":"dee964ab-54b3-4668-b8a6-e7cbdb46e549","Type":"ContainerDied","Data":"191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b"}
May 26 16:07:48.735303 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.734969    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cc55fd79-qkw6q" event={"ID":"dee964ab-54b3-4668-b8a6-e7cbdb46e549","Type":"ContainerDied","Data":"7f73da6095b7263ed9790fec5c8053b20ad532719a9b77ca1d2d1dffddf96691"}
May 26 16:07:48.735303 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.734974    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cc55fd79-qkw6q"
May 26 16:07:48.735303 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.734987    2567 scope.go:117] "RemoveContainer" containerID="191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b"
May 26 16:07:48.743123 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.743106    2567 scope.go:117] "RemoveContainer" containerID="191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b"
May 26 16:07:48.743375 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:07:48.743357    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b\": container with ID starting with 191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b not found: ID does not exist" containerID="191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b"
May 26 16:07:48.743433 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.743385    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b"} err="failed to get container status \"191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b\": rpc error: code = NotFound desc = could not find container \"191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b\": container with ID starting with 191c464c3e2523aa6fb450369bd15f40dab6f483b77980028ec394cbaa8a471b not found: ID does not exist"
May 26 16:07:48.754190 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.754169    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85cc55fd79-qkw6q"]
May 26 16:07:48.760368 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:48.760346    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85cc55fd79-qkw6q"]
May 26 16:07:49.498581 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:49.498548    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dee964ab-54b3-4668-b8a6-e7cbdb46e549" path="/var/lib/kubelet/pods/dee964ab-54b3-4668-b8a6-e7cbdb46e549/volumes"
May 26 16:07:56.181211 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.181178    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"]
May 26 16:07:56.181593 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.181508    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee964ab-54b3-4668-b8a6-e7cbdb46e549" containerName="console"
May 26 16:07:56.181593 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.181520    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee964ab-54b3-4668-b8a6-e7cbdb46e549" containerName="console"
May 26 16:07:56.181593 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.181582    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="dee964ab-54b3-4668-b8a6-e7cbdb46e549" containerName="console"
May 26 16:07:56.184638 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.184621    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.187026 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.186987    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 26 16:07:56.187150 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.187126    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 26 16:07:56.187874 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.187856    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngfn2\""
May 26 16:07:56.192393 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.192375    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"]
May 26 16:07:56.222073 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.222042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm42j\" (UniqueName: \"kubernetes.io/projected/6b4636e8-ca64-40ea-9f9f-abedf63c9286-kube-api-access-vm42j\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.222195 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.222082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.222195 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.222169    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.323215 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.323183    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.323362 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.323233    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vm42j\" (UniqueName: \"kubernetes.io/projected/6b4636e8-ca64-40ea-9f9f-abedf63c9286-kube-api-access-vm42j\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.323362 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.323273    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.323617 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.323602    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.323656 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.323642    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.331650 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.331629    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm42j\" (UniqueName: \"kubernetes.io/projected/6b4636e8-ca64-40ea-9f9f-abedf63c9286-kube-api-access-vm42j\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.493900 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.493874    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:07:56.615845 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.615823    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"]
May 26 16:07:56.618298 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:07:56.618267    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4636e8_ca64_40ea_9f9f_abedf63c9286.slice/crio-3a643b2cd894c3a3d78db3551ccc533c769a90bb2f76624aa434c8c23b3bc910 WatchSource:0}: Error finding container 3a643b2cd894c3a3d78db3551ccc533c769a90bb2f76624aa434c8c23b3bc910: Status 404 returned error can't find the container with id 3a643b2cd894c3a3d78db3551ccc533c769a90bb2f76624aa434c8c23b3bc910
May 26 16:07:56.758403 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:07:56.758322    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs" event={"ID":"6b4636e8-ca64-40ea-9f9f-abedf63c9286","Type":"ContainerStarted","Data":"3a643b2cd894c3a3d78db3551ccc533c769a90bb2f76624aa434c8c23b3bc910"}
May 26 16:08:04.783185 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:04.783152    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs" event={"ID":"6b4636e8-ca64-40ea-9f9f-abedf63c9286","Type":"ContainerStarted","Data":"64474d0cbe2cea1fb79737ff3e6e4914d34452e642ac5cf1e58febe731de6eaa"}
May 26 16:08:05.787342 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:05.787302    2567 generic.go:358] "Generic (PLEG): container finished" podID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerID="64474d0cbe2cea1fb79737ff3e6e4914d34452e642ac5cf1e58febe731de6eaa" exitCode=0
May 26 16:08:05.787729 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:05.787354    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs" event={"ID":"6b4636e8-ca64-40ea-9f9f-abedf63c9286","Type":"ContainerDied","Data":"64474d0cbe2cea1fb79737ff3e6e4914d34452e642ac5cf1e58febe731de6eaa"}
May 26 16:08:07.795437 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:07.795396    2567 generic.go:358] "Generic (PLEG): container finished" podID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerID="f7f369fdd052e5a0486c18936f53958ff81ba7c1e6d51579d776e767ec80c2d9" exitCode=0
May 26 16:08:07.795754 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:07.795462    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs" event={"ID":"6b4636e8-ca64-40ea-9f9f-abedf63c9286","Type":"ContainerDied","Data":"f7f369fdd052e5a0486c18936f53958ff81ba7c1e6d51579d776e767ec80c2d9"}
May 26 16:08:14.818727 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:14.818650    2567 generic.go:358] "Generic (PLEG): container finished" podID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerID="859154ad739a885b571510c6cc26c14ba849d66a8f626ae3240d75dd061b910c" exitCode=0
May 26 16:08:14.819114 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:14.818730    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs" event={"ID":"6b4636e8-ca64-40ea-9f9f-abedf63c9286","Type":"ContainerDied","Data":"859154ad739a885b571510c6cc26c14ba849d66a8f626ae3240d75dd061b910c"}
May 26 16:08:15.944110 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:15.944086    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:08:15.974982 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:15.974950    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-bundle\") pod \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") "
May 26 16:08:15.975144 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:15.975015    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm42j\" (UniqueName: \"kubernetes.io/projected/6b4636e8-ca64-40ea-9f9f-abedf63c9286-kube-api-access-vm42j\") pod \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") "
May 26 16:08:15.975144 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:15.975057    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-util\") pod \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\" (UID: \"6b4636e8-ca64-40ea-9f9f-abedf63c9286\") "
May 26 16:08:15.975669 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:15.975640    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-bundle" (OuterVolumeSpecName: "bundle") pod "6b4636e8-ca64-40ea-9f9f-abedf63c9286" (UID: "6b4636e8-ca64-40ea-9f9f-abedf63c9286"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:08:15.977049 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:15.977024    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4636e8-ca64-40ea-9f9f-abedf63c9286-kube-api-access-vm42j" (OuterVolumeSpecName: "kube-api-access-vm42j") pod "6b4636e8-ca64-40ea-9f9f-abedf63c9286" (UID: "6b4636e8-ca64-40ea-9f9f-abedf63c9286"). InnerVolumeSpecName "kube-api-access-vm42j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:08:15.979265 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:15.979242    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-util" (OuterVolumeSpecName: "util") pod "6b4636e8-ca64-40ea-9f9f-abedf63c9286" (UID: "6b4636e8-ca64-40ea-9f9f-abedf63c9286"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:08:16.076097 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:16.076020    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-bundle\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:08:16.076097 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:16.076051    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm42j\" (UniqueName: \"kubernetes.io/projected/6b4636e8-ca64-40ea-9f9f-abedf63c9286-kube-api-access-vm42j\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:08:16.076097 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:16.076065    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b4636e8-ca64-40ea-9f9f-abedf63c9286-util\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:08:16.826339 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:16.826307    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs" event={"ID":"6b4636e8-ca64-40ea-9f9f-abedf63c9286","Type":"ContainerDied","Data":"3a643b2cd894c3a3d78db3551ccc533c769a90bb2f76624aa434c8c23b3bc910"}
May 26 16:08:16.826339 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:16.826340    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a643b2cd894c3a3d78db3551ccc533c769a90bb2f76624aa434c8c23b3bc910"
May 26 16:08:16.826339 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:16.826350    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c5p4qs"
May 26 16:08:22.890759 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.890721    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"]
May 26 16:08:22.891263 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.891046    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerName="extract"
May 26 16:08:22.891263 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.891058    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerName="extract"
May 26 16:08:22.891263 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.891074    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerName="util"
May 26 16:08:22.891263 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.891080    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerName="util"
May 26 16:08:22.891263 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.891087    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerName="pull"
May 26 16:08:22.891263 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.891092    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerName="pull"
May 26 16:08:22.891263 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.891142    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b4636e8-ca64-40ea-9f9f-abedf63c9286" containerName="extract"
May 26 16:08:22.897359 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.897341    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:22.899851 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.899829    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
May 26 16:08:22.899966 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.899836    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
May 26 16:08:22.899966 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.899957    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
May 26 16:08:22.900105 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.900036    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-2wcvb\""
May 26 16:08:22.904975 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:22.904952    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"]
May 26 16:08:23.028594 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:23.028564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/88f28ed5-bd01-4462-9a6c-b8d49bd6b14f-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-46nrf\" (UID: \"88f28ed5-bd01-4462-9a6c-b8d49bd6b14f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:23.028758 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:23.028607    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkbt6\" (UniqueName: \"kubernetes.io/projected/88f28ed5-bd01-4462-9a6c-b8d49bd6b14f-kube-api-access-bkbt6\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-46nrf\" (UID: \"88f28ed5-bd01-4462-9a6c-b8d49bd6b14f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:23.129316 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:23.129278    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/88f28ed5-bd01-4462-9a6c-b8d49bd6b14f-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-46nrf\" (UID: \"88f28ed5-bd01-4462-9a6c-b8d49bd6b14f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:23.129472 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:23.129322    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkbt6\" (UniqueName: \"kubernetes.io/projected/88f28ed5-bd01-4462-9a6c-b8d49bd6b14f-kube-api-access-bkbt6\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-46nrf\" (UID: \"88f28ed5-bd01-4462-9a6c-b8d49bd6b14f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:23.131501 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:23.131476    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/88f28ed5-bd01-4462-9a6c-b8d49bd6b14f-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-46nrf\" (UID: \"88f28ed5-bd01-4462-9a6c-b8d49bd6b14f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:23.137984 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:23.137956    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkbt6\" (UniqueName: \"kubernetes.io/projected/88f28ed5-bd01-4462-9a6c-b8d49bd6b14f-kube-api-access-bkbt6\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-46nrf\" (UID: \"88f28ed5-bd01-4462-9a6c-b8d49bd6b14f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:23.208387 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:23.208318    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:23.350967 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:23.350945    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"]
May 26 16:08:23.353910 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:08:23.353883    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f28ed5_bd01_4462_9a6c_b8d49bd6b14f.slice/crio-7695dccd879b48a718ade32b9ed6d831ea8fc2ec3b3440ae226ac011a7f17c1f WatchSource:0}: Error finding container 7695dccd879b48a718ade32b9ed6d831ea8fc2ec3b3440ae226ac011a7f17c1f: Status 404 returned error can't find the container with id 7695dccd879b48a718ade32b9ed6d831ea8fc2ec3b3440ae226ac011a7f17c1f
May 26 16:08:23.847989 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:23.847951    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf" event={"ID":"88f28ed5-bd01-4462-9a6c-b8d49bd6b14f","Type":"ContainerStarted","Data":"7695dccd879b48a718ade32b9ed6d831ea8fc2ec3b3440ae226ac011a7f17c1f"}
May 26 16:08:27.861920 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:27.861887    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf" event={"ID":"88f28ed5-bd01-4462-9a6c-b8d49bd6b14f","Type":"ContainerStarted","Data":"14e6258c258d4a2c680874ac678807f7cf0c790f95d8d38852f7b6b47dc59c76"}
May 26 16:08:27.862299 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:27.862050    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:27.882742 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:27.882690    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf" podStartSLOduration=1.508276409 podStartE2EDuration="5.882676852s" podCreationTimestamp="2026-05-26 16:08:22 +0000 UTC" firstStartedPulling="2026-05-26 16:08:23.356194566 +0000 UTC m=+410.466752337" lastFinishedPulling="2026-05-26 16:08:27.730595 +0000 UTC m=+414.841152780" observedRunningTime="2026-05-26 16:08:27.881293837 +0000 UTC m=+414.991851630" watchObservedRunningTime="2026-05-26 16:08:27.882676852 +0000 UTC m=+414.993234643"
May 26 16:08:28.286062 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.286026    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-6lgmz"]
May 26 16:08:28.289298 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.289282    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.291486 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.291458    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
May 26 16:08:28.291486 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.291481    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
May 26 16:08:28.291486 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.291490    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-v72pr\""
May 26 16:08:28.297216 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.297193    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-6lgmz"]
May 26 16:08:28.374456 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.374411    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khbd6\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-kube-api-access-khbd6\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.374456 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.374460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.374683 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.374538    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/74673757-0850-45ef-88e4-c0f52cf66e2a-cabundle0\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.475636 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.475595    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khbd6\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-kube-api-access-khbd6\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.475824 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.475646    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.475824 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.475698    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/74673757-0850-45ef-88e4-c0f52cf66e2a-cabundle0\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.475943 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.475823    2567 projected.go:264] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
May 26 16:08:28.475943 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.475849    2567 secret.go:281] references non-existent secret key: ca.crt
May 26 16:08:28.475943 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.475859    2567 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 26 16:08:28.475943 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.475891    2567 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-6lgmz: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
May 26 16:08:28.476156 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.475957    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates podName:74673757-0850-45ef-88e4-c0f52cf66e2a nodeName:}" failed. No retries permitted until 2026-05-26 16:08:28.975937023 +0000 UTC m=+416.086494795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates") pod "keda-operator-ffbb595cb-6lgmz" (UID: "74673757-0850-45ef-88e4-c0f52cf66e2a") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
May 26 16:08:28.476483 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.476464    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/74673757-0850-45ef-88e4-c0f52cf66e2a-cabundle0\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.484832 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.484805    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khbd6\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-kube-api-access-khbd6\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.625239 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.625151    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"]
May 26 16:08:28.629436 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.629410    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:28.631632 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.631609    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
May 26 16:08:28.634264 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.634237    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"]
May 26 16:08:28.777542 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.777506    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:28.777706 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.777569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:28.777706 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.777607    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5kp\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-kube-api-access-nr5kp\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:28.878167 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.878088    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:28.878167 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.878143    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:28.878167 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.878162    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5kp\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-kube-api-access-nr5kp\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:28.878653 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.878216    2567 secret.go:281] references non-existent secret key: tls.crt
May 26 16:08:28.878653 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.878232    2567 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 26 16:08:28.878653 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.878248    2567 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n: references non-existent secret key: tls.crt
May 26 16:08:28.878653 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.878307    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates podName:ed3a4b74-79a2-48bd-b97b-e712144fb4e5 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:29.378292588 +0000 UTC m=+416.488850363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates") pod "keda-metrics-apiserver-7c9f485588-2pr5n" (UID: "ed3a4b74-79a2-48bd-b97b-e712144fb4e5") : references non-existent secret key: tls.crt
May 26 16:08:28.878653 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.878546    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:28.889612 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.889588    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5kp\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-kube-api-access-nr5kp\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:28.901144 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.901120    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-ds2d5"]
May 26 16:08:28.904483 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.904468    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:28.906508 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.906492    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
May 26 16:08:28.913663 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.913643    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-ds2d5"]
May 26 16:08:28.979049 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.978991    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:28.979049 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.979048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ccs9\" (UniqueName: \"kubernetes.io/projected/be862b99-6ec7-4fb2-afb0-c1af25737dcb-kube-api-access-9ccs9\") pod \"keda-admission-cf49989db-ds2d5\" (UID: \"be862b99-6ec7-4fb2-afb0-c1af25737dcb\") " pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:28.979275 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:28.979110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/be862b99-6ec7-4fb2-afb0-c1af25737dcb-certificates\") pod \"keda-admission-cf49989db-ds2d5\" (UID: \"be862b99-6ec7-4fb2-afb0-c1af25737dcb\") " pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:28.979275 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.979154    2567 secret.go:281] references non-existent secret key: ca.crt
May 26 16:08:28.979275 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.979178    2567 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 26 16:08:28.979275 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.979189    2567 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-6lgmz: references non-existent secret key: ca.crt
May 26 16:08:28.979275 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:28.979244    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates podName:74673757-0850-45ef-88e4-c0f52cf66e2a nodeName:}" failed. No retries permitted until 2026-05-26 16:08:29.97922391 +0000 UTC m=+417.089781682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates") pod "keda-operator-ffbb595cb-6lgmz" (UID: "74673757-0850-45ef-88e4-c0f52cf66e2a") : references non-existent secret key: ca.crt
May 26 16:08:29.079702 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:29.079664    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/be862b99-6ec7-4fb2-afb0-c1af25737dcb-certificates\") pod \"keda-admission-cf49989db-ds2d5\" (UID: \"be862b99-6ec7-4fb2-afb0-c1af25737dcb\") " pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:29.079853 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:29.079750    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ccs9\" (UniqueName: \"kubernetes.io/projected/be862b99-6ec7-4fb2-afb0-c1af25737dcb-kube-api-access-9ccs9\") pod \"keda-admission-cf49989db-ds2d5\" (UID: \"be862b99-6ec7-4fb2-afb0-c1af25737dcb\") " pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:29.079853 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.079814    2567 projected.go:264] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
May 26 16:08:29.079853 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.079847    2567 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-cf49989db-ds2d5: secret "keda-admission-webhooks-certs" not found
May 26 16:08:29.079952 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.079913    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be862b99-6ec7-4fb2-afb0-c1af25737dcb-certificates podName:be862b99-6ec7-4fb2-afb0-c1af25737dcb nodeName:}" failed. No retries permitted until 2026-05-26 16:08:29.579896004 +0000 UTC m=+416.690453786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/be862b99-6ec7-4fb2-afb0-c1af25737dcb-certificates") pod "keda-admission-cf49989db-ds2d5" (UID: "be862b99-6ec7-4fb2-afb0-c1af25737dcb") : secret "keda-admission-webhooks-certs" not found
May 26 16:08:29.088961 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:29.088924    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ccs9\" (UniqueName: \"kubernetes.io/projected/be862b99-6ec7-4fb2-afb0-c1af25737dcb-kube-api-access-9ccs9\") pod \"keda-admission-cf49989db-ds2d5\" (UID: \"be862b99-6ec7-4fb2-afb0-c1af25737dcb\") " pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:29.383525 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:29.383484    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:29.383698 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.383622    2567 secret.go:281] references non-existent secret key: tls.crt
May 26 16:08:29.383698 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.383641    2567 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 26 16:08:29.383698 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.383658    2567 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n: references non-existent secret key: tls.crt
May 26 16:08:29.383792 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.383708    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates podName:ed3a4b74-79a2-48bd-b97b-e712144fb4e5 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:30.383693467 +0000 UTC m=+417.494251236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates") pod "keda-metrics-apiserver-7c9f485588-2pr5n" (UID: "ed3a4b74-79a2-48bd-b97b-e712144fb4e5") : references non-existent secret key: tls.crt
May 26 16:08:29.585679 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:29.585650    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/be862b99-6ec7-4fb2-afb0-c1af25737dcb-certificates\") pod \"keda-admission-cf49989db-ds2d5\" (UID: \"be862b99-6ec7-4fb2-afb0-c1af25737dcb\") " pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:29.588016 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:29.587968    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/be862b99-6ec7-4fb2-afb0-c1af25737dcb-certificates\") pod \"keda-admission-cf49989db-ds2d5\" (UID: \"be862b99-6ec7-4fb2-afb0-c1af25737dcb\") " pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:29.814684 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:29.814649    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:29.939986 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:29.939959    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-ds2d5"]
May 26 16:08:29.942869 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:08:29.942844    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe862b99_6ec7_4fb2_afb0_c1af25737dcb.slice/crio-61246a49df4a7ab48fe4e28ed4a87bd19aa115ad54b8b19419b2f00fe88007a2 WatchSource:0}: Error finding container 61246a49df4a7ab48fe4e28ed4a87bd19aa115ad54b8b19419b2f00fe88007a2: Status 404 returned error can't find the container with id 61246a49df4a7ab48fe4e28ed4a87bd19aa115ad54b8b19419b2f00fe88007a2
May 26 16:08:29.989520 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:29.989494    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:29.989620 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.989604    2567 secret.go:281] references non-existent secret key: ca.crt
May 26 16:08:29.989669 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.989624    2567 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 26 16:08:29.989669 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.989633    2567 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-6lgmz: references non-existent secret key: ca.crt
May 26 16:08:29.989731 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:29.989679    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates podName:74673757-0850-45ef-88e4-c0f52cf66e2a nodeName:}" failed. No retries permitted until 2026-05-26 16:08:31.989665868 +0000 UTC m=+419.100223637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates") pod "keda-operator-ffbb595cb-6lgmz" (UID: "74673757-0850-45ef-88e4-c0f52cf66e2a") : references non-existent secret key: ca.crt
May 26 16:08:30.394051 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:30.394016    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:30.394228 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:30.394157    2567 secret.go:281] references non-existent secret key: tls.crt
May 26 16:08:30.394228 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:30.394177    2567 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 26 16:08:30.394228 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:30.394196    2567 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n: references non-existent secret key: tls.crt
May 26 16:08:30.394339 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:30.394256    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates podName:ed3a4b74-79a2-48bd-b97b-e712144fb4e5 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:32.394237453 +0000 UTC m=+419.504795224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates") pod "keda-metrics-apiserver-7c9f485588-2pr5n" (UID: "ed3a4b74-79a2-48bd-b97b-e712144fb4e5") : references non-existent secret key: tls.crt
May 26 16:08:30.874174 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:30.874140    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-ds2d5" event={"ID":"be862b99-6ec7-4fb2-afb0-c1af25737dcb","Type":"ContainerStarted","Data":"61246a49df4a7ab48fe4e28ed4a87bd19aa115ad54b8b19419b2f00fe88007a2"}
May 26 16:08:31.879390 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:31.879353    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-ds2d5" event={"ID":"be862b99-6ec7-4fb2-afb0-c1af25737dcb","Type":"ContainerStarted","Data":"90a961c34b4478ecc2d9132bd917caf2aae77b47893be35a5b09d420959e70d4"}
May 26 16:08:31.879764 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:31.879419    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:08:31.895585 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:31.895542    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-ds2d5" podStartSLOduration=2.6589148209999998 podStartE2EDuration="3.895529013s" podCreationTimestamp="2026-05-26 16:08:28 +0000 UTC" firstStartedPulling="2026-05-26 16:08:29.944204169 +0000 UTC m=+417.054761943" lastFinishedPulling="2026-05-26 16:08:31.180818349 +0000 UTC m=+418.291376135" observedRunningTime="2026-05-26 16:08:31.894060888 +0000 UTC m=+419.004618680" watchObservedRunningTime="2026-05-26 16:08:31.895529013 +0000 UTC m=+419.006086805"
May 26 16:08:32.008124 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:32.008082    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:32.008325 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:32.008308    2567 secret.go:281] references non-existent secret key: ca.crt
May 26 16:08:32.008396 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:32.008327    2567 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 26 16:08:32.008396 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:32.008336    2567 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-6lgmz: references non-existent secret key: ca.crt
May 26 16:08:32.008396 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:32.008384    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates podName:74673757-0850-45ef-88e4-c0f52cf66e2a nodeName:}" failed. No retries permitted until 2026-05-26 16:08:36.008370154 +0000 UTC m=+423.118927924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates") pod "keda-operator-ffbb595cb-6lgmz" (UID: "74673757-0850-45ef-88e4-c0f52cf66e2a") : references non-existent secret key: ca.crt
May 26 16:08:32.411383 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:32.411345    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:32.411596 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:32.411506    2567 secret.go:281] references non-existent secret key: tls.crt
May 26 16:08:32.411596 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:32.411529    2567 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 26 16:08:32.411596 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:32.411551    2567 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n: references non-existent secret key: tls.crt
May 26 16:08:32.411748 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:08:32.411617    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates podName:ed3a4b74-79a2-48bd-b97b-e712144fb4e5 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:36.411595297 +0000 UTC m=+423.522153070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates") pod "keda-metrics-apiserver-7c9f485588-2pr5n" (UID: "ed3a4b74-79a2-48bd-b97b-e712144fb4e5") : references non-existent secret key: tls.crt
May 26 16:08:36.041702 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.041665    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:36.044133 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.044111    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/74673757-0850-45ef-88e4-c0f52cf66e2a-certificates\") pod \"keda-operator-ffbb595cb-6lgmz\" (UID: \"74673757-0850-45ef-88e4-c0f52cf66e2a\") " pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:36.100632 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.100601    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:36.221070 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.221046    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-6lgmz"]
May 26 16:08:36.223608 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:08:36.223579    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74673757_0850_45ef_88e4_c0f52cf66e2a.slice/crio-825c1d1207cf8389af010eaeeeb196a156f9173cb67df4865b25ffd35c84b8bd WatchSource:0}: Error finding container 825c1d1207cf8389af010eaeeeb196a156f9173cb67df4865b25ffd35c84b8bd: Status 404 returned error can't find the container with id 825c1d1207cf8389af010eaeeeb196a156f9173cb67df4865b25ffd35c84b8bd
May 26 16:08:36.453320 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.453229    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:36.455718 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.455694    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ed3a4b74-79a2-48bd-b97b-e712144fb4e5-certificates\") pod \"keda-metrics-apiserver-7c9f485588-2pr5n\" (UID: \"ed3a4b74-79a2-48bd-b97b-e712144fb4e5\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:36.740096 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.740067    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:36.865609 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.865578    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"]
May 26 16:08:36.869251 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:08:36.869224    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3a4b74_79a2_48bd_b97b_e712144fb4e5.slice/crio-0c9c54c2575e87fdc87036b99538ce5a7cb67c531cadbcdc7e573ed3bbeb5654 WatchSource:0}: Error finding container 0c9c54c2575e87fdc87036b99538ce5a7cb67c531cadbcdc7e573ed3bbeb5654: Status 404 returned error can't find the container with id 0c9c54c2575e87fdc87036b99538ce5a7cb67c531cadbcdc7e573ed3bbeb5654
May 26 16:08:36.898564 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.898530    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-6lgmz" event={"ID":"74673757-0850-45ef-88e4-c0f52cf66e2a","Type":"ContainerStarted","Data":"825c1d1207cf8389af010eaeeeb196a156f9173cb67df4865b25ffd35c84b8bd"}
May 26 16:08:36.899728 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:36.899696    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n" event={"ID":"ed3a4b74-79a2-48bd-b97b-e712144fb4e5","Type":"ContainerStarted","Data":"0c9c54c2575e87fdc87036b99538ce5a7cb67c531cadbcdc7e573ed3bbeb5654"}
May 26 16:08:40.916580 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:40.916545    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-6lgmz" event={"ID":"74673757-0850-45ef-88e4-c0f52cf66e2a","Type":"ContainerStarted","Data":"61ffe7a517fa4e0146c3e63b39d5635dc741364d8545cf8ec4f125a837c6c316"}
May 26 16:08:40.916580 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:40.916588    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:08:40.917864 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:40.917839    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n" event={"ID":"ed3a4b74-79a2-48bd-b97b-e712144fb4e5","Type":"ContainerStarted","Data":"52aa0e7c83057342aa9d080cafa144f6f1a029e0cf6cd723fe8a2fc57ca584a4"}
May 26 16:08:40.917975 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:40.917961    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:40.933969 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:40.933928    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-operator-ffbb595cb-6lgmz" podStartSLOduration=9.12499745 podStartE2EDuration="12.933914747s" podCreationTimestamp="2026-05-26 16:08:28 +0000 UTC" firstStartedPulling="2026-05-26 16:08:36.225098325 +0000 UTC m=+423.335656095" lastFinishedPulling="2026-05-26 16:08:40.034015613 +0000 UTC m=+427.144573392" observedRunningTime="2026-05-26 16:08:40.932167796 +0000 UTC m=+428.042725588" watchObservedRunningTime="2026-05-26 16:08:40.933914747 +0000 UTC m=+428.044472539"
May 26 16:08:40.947973 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:40.947932    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n" podStartSLOduration=9.784021828 podStartE2EDuration="12.947921005s" podCreationTimestamp="2026-05-26 16:08:28 +0000 UTC" firstStartedPulling="2026-05-26 16:08:36.870800666 +0000 UTC m=+423.981358437" lastFinishedPulling="2026-05-26 16:08:40.034699833 +0000 UTC m=+427.145257614" observedRunningTime="2026-05-26 16:08:40.946200234 +0000 UTC m=+428.056758026" watchObservedRunningTime="2026-05-26 16:08:40.947921005 +0000 UTC m=+428.058478798"
May 26 16:08:48.867634 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:48.867602    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-46nrf"
May 26 16:08:51.925216 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:51.925191    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-2pr5n"
May 26 16:08:52.884435 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:08:52.884365    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-ds2d5"
May 26 16:09:01.922532 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:01.922501    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-ffbb595cb-6lgmz"
May 26 16:09:33.139909 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.139878    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-6b94ff949c-rh86v"]
May 26 16:09:33.141843 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.141827    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:09:33.144544 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.144519    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-hpr6s\""
May 26 16:09:33.144803 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.144778    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
May 26 16:09:33.145767 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.145752    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 26 16:09:33.145849 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.145753    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 26 16:09:33.152422 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.152401    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-6b94ff949c-rh86v"]
May 26 16:09:33.170085 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.170053    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-79f457656b-hntx2"]
May 26 16:09:33.172151 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.172137    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:09:33.174364 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.174347    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
May 26 16:09:33.174565 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.174552    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-gzm8h\""
May 26 16:09:33.180637 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.180614    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-hntx2"]
May 26 16:09:33.204782 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.204755    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn6k4\" (UniqueName: \"kubernetes.io/projected/8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e-kube-api-access-gn6k4\") pod \"llmisvc-controller-manager-6b94ff949c-rh86v\" (UID: \"8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:09:33.204886 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.204824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e-cert\") pod \"llmisvc-controller-manager-6b94ff949c-rh86v\" (UID: \"8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:09:33.305576 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.305551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/206eaea4-55f0-4728-bffa-8d898cccca80-data\") pod \"seaweedfs-79f457656b-hntx2\" (UID: \"206eaea4-55f0-4728-bffa-8d898cccca80\") " pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:09:33.305699 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.305591    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e-cert\") pod \"llmisvc-controller-manager-6b94ff949c-rh86v\" (UID: \"8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:09:33.305699 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.305620    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6k4\" (UniqueName: \"kubernetes.io/projected/8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e-kube-api-access-gn6k4\") pod \"llmisvc-controller-manager-6b94ff949c-rh86v\" (UID: \"8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:09:33.305775 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.305701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzt2v\" (UniqueName: \"kubernetes.io/projected/206eaea4-55f0-4728-bffa-8d898cccca80-kube-api-access-qzt2v\") pod \"seaweedfs-79f457656b-hntx2\" (UID: \"206eaea4-55f0-4728-bffa-8d898cccca80\") " pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:09:33.307879 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.307858    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e-cert\") pod \"llmisvc-controller-manager-6b94ff949c-rh86v\" (UID: \"8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:09:33.314353 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.314334    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn6k4\" (UniqueName: \"kubernetes.io/projected/8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e-kube-api-access-gn6k4\") pod \"llmisvc-controller-manager-6b94ff949c-rh86v\" (UID: \"8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:09:33.406950 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.406885    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzt2v\" (UniqueName: \"kubernetes.io/projected/206eaea4-55f0-4728-bffa-8d898cccca80-kube-api-access-qzt2v\") pod \"seaweedfs-79f457656b-hntx2\" (UID: \"206eaea4-55f0-4728-bffa-8d898cccca80\") " pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:09:33.406950 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.406919    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/206eaea4-55f0-4728-bffa-8d898cccca80-data\") pod \"seaweedfs-79f457656b-hntx2\" (UID: \"206eaea4-55f0-4728-bffa-8d898cccca80\") " pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:09:33.407226 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.407211    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/206eaea4-55f0-4728-bffa-8d898cccca80-data\") pod \"seaweedfs-79f457656b-hntx2\" (UID: \"206eaea4-55f0-4728-bffa-8d898cccca80\") " pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:09:33.415950 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.415930    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzt2v\" (UniqueName: \"kubernetes.io/projected/206eaea4-55f0-4728-bffa-8d898cccca80-kube-api-access-qzt2v\") pod \"seaweedfs-79f457656b-hntx2\" (UID: \"206eaea4-55f0-4728-bffa-8d898cccca80\") " pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:09:33.454718 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.454694    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-hpr6s\""
May 26 16:09:33.462629 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.462611    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:09:33.484792 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.484772    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-gzm8h\""
May 26 16:09:33.492471 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.492452    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:09:33.605069 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.604886    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-6b94ff949c-rh86v"]
May 26 16:09:33.607685 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:09:33.607656    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8d59cbb9_1ebb_4019_88f1_d9f6aaa8244e.slice/crio-e0c1fbd731f82015961ea731a590cb4dbf7270d25ab0a40feeb9cf92e1009726 WatchSource:0}: Error finding container e0c1fbd731f82015961ea731a590cb4dbf7270d25ab0a40feeb9cf92e1009726: Status 404 returned error can't find the container with id e0c1fbd731f82015961ea731a590cb4dbf7270d25ab0a40feeb9cf92e1009726
May 26 16:09:33.628788 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:33.628764    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-hntx2"]
May 26 16:09:33.632350 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:09:33.632324    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206eaea4_55f0_4728_bffa_8d898cccca80.slice/crio-1fc26ba9d0d0813541960ba90088804c3e85bf0774eb7bf3298522856450adb2 WatchSource:0}: Error finding container 1fc26ba9d0d0813541960ba90088804c3e85bf0774eb7bf3298522856450adb2: Status 404 returned error can't find the container with id 1fc26ba9d0d0813541960ba90088804c3e85bf0774eb7bf3298522856450adb2
May 26 16:09:34.087039 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:34.086979    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-hntx2" event={"ID":"206eaea4-55f0-4728-bffa-8d898cccca80","Type":"ContainerStarted","Data":"1fc26ba9d0d0813541960ba90088804c3e85bf0774eb7bf3298522856450adb2"}
May 26 16:09:34.088076 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:34.088035    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v" event={"ID":"8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e","Type":"ContainerStarted","Data":"e0c1fbd731f82015961ea731a590cb4dbf7270d25ab0a40feeb9cf92e1009726"}
May 26 16:09:37.369495 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:37.369474    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
May 26 16:09:38.104724 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:38.104689    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-hntx2" event={"ID":"206eaea4-55f0-4728-bffa-8d898cccca80","Type":"ContainerStarted","Data":"13423d64ca8d2a923aaa57258bc41a228437a9cc3a1747a1169bc2aeae033f89"}
May 26 16:09:38.104908 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:38.104805    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:09:38.106145 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:38.106121    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v" event={"ID":"8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e","Type":"ContainerStarted","Data":"b984249c1c4d4a56e5ff05a7b751593a79acef6673206917a9d7c37b3063b9ec"}
May 26 16:09:38.106246 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:38.106186    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:09:38.120252 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:38.120210    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-79f457656b-hntx2" podStartSLOduration=1.386504345 podStartE2EDuration="5.12020009s" podCreationTimestamp="2026-05-26 16:09:33 +0000 UTC" firstStartedPulling="2026-05-26 16:09:33.633597582 +0000 UTC m=+480.744155351" lastFinishedPulling="2026-05-26 16:09:37.367293126 +0000 UTC m=+484.477851096" observedRunningTime="2026-05-26 16:09:38.119037774 +0000 UTC m=+485.229595567" watchObservedRunningTime="2026-05-26 16:09:38.12020009 +0000 UTC m=+485.230757940"
May 26 16:09:38.134058 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:38.133991    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v" podStartSLOduration=1.425524926 podStartE2EDuration="5.133978956s" podCreationTimestamp="2026-05-26 16:09:33 +0000 UTC" firstStartedPulling="2026-05-26 16:09:33.609141118 +0000 UTC m=+480.719698891" lastFinishedPulling="2026-05-26 16:09:37.317595151 +0000 UTC m=+484.428152921" observedRunningTime="2026-05-26 16:09:38.132726181 +0000 UTC m=+485.243283970" watchObservedRunningTime="2026-05-26 16:09:38.133978956 +0000 UTC m=+485.244536749"
May 26 16:09:44.111545 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:09:44.111516    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-79f457656b-hntx2"
May 26 16:10:09.110952 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:09.110917    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-6b94ff949c-rh86v"
May 26 16:10:43.508110 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.508032    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-86f7b4b499-95k92"]
May 26 16:10:43.511323 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.511306    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:10:43.513788 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.513766    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
May 26 16:10:43.513896 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.513841    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-4rwnr\""
May 26 16:10:43.520565 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.520547    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-95k92"]
May 26 16:10:43.663256 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.663226    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5n7m\" (UniqueName: \"kubernetes.io/projected/a6f98516-0d30-4ce3-a568-a3d523336616-kube-api-access-n5n7m\") pod \"model-serving-api-86f7b4b499-95k92\" (UID: \"a6f98516-0d30-4ce3-a568-a3d523336616\") " pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:10:43.663409 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.663272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f98516-0d30-4ce3-a568-a3d523336616-tls-certs\") pod \"model-serving-api-86f7b4b499-95k92\" (UID: \"a6f98516-0d30-4ce3-a568-a3d523336616\") " pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:10:43.764281 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.764208    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5n7m\" (UniqueName: \"kubernetes.io/projected/a6f98516-0d30-4ce3-a568-a3d523336616-kube-api-access-n5n7m\") pod \"model-serving-api-86f7b4b499-95k92\" (UID: \"a6f98516-0d30-4ce3-a568-a3d523336616\") " pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:10:43.764281 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.764260    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f98516-0d30-4ce3-a568-a3d523336616-tls-certs\") pod \"model-serving-api-86f7b4b499-95k92\" (UID: \"a6f98516-0d30-4ce3-a568-a3d523336616\") " pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:10:43.766616 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.766588    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f98516-0d30-4ce3-a568-a3d523336616-tls-certs\") pod \"model-serving-api-86f7b4b499-95k92\" (UID: \"a6f98516-0d30-4ce3-a568-a3d523336616\") " pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:10:43.772973 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.772946    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5n7m\" (UniqueName: \"kubernetes.io/projected/a6f98516-0d30-4ce3-a568-a3d523336616-kube-api-access-n5n7m\") pod \"model-serving-api-86f7b4b499-95k92\" (UID: \"a6f98516-0d30-4ce3-a568-a3d523336616\") " pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:10:43.821984 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.821959    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:10:43.944422 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:43.944398    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-95k92"]
May 26 16:10:43.946685 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:10:43.946651    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f98516_0d30_4ce3_a568_a3d523336616.slice/crio-9b73d0cf0385de8d0b0f605df47a30b7c3ea03b60fb19196b67a703261a134f0 WatchSource:0}: Error finding container 9b73d0cf0385de8d0b0f605df47a30b7c3ea03b60fb19196b67a703261a134f0: Status 404 returned error can't find the container with id 9b73d0cf0385de8d0b0f605df47a30b7c3ea03b60fb19196b67a703261a134f0
May 26 16:10:44.313810 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:44.313780    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-95k92" event={"ID":"a6f98516-0d30-4ce3-a568-a3d523336616","Type":"ContainerStarted","Data":"9b73d0cf0385de8d0b0f605df47a30b7c3ea03b60fb19196b67a703261a134f0"}
May 26 16:10:47.329268 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:47.329225    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-95k92" event={"ID":"a6f98516-0d30-4ce3-a568-a3d523336616","Type":"ContainerStarted","Data":"8b4001861ad6522eae915372862736d3a2fe99579519e2c3d2c4c6bfc7aef250"}
May 26 16:10:47.329647 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:47.329360    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:10:47.344825 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:47.344773    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/model-serving-api-86f7b4b499-95k92" podStartSLOduration=1.980979897 podStartE2EDuration="4.344759869s" podCreationTimestamp="2026-05-26 16:10:43 +0000 UTC" firstStartedPulling="2026-05-26 16:10:43.948419713 +0000 UTC m=+551.058977487" lastFinishedPulling="2026-05-26 16:10:46.312199678 +0000 UTC m=+553.422757459" observedRunningTime="2026-05-26 16:10:47.344248825 +0000 UTC m=+554.454806618" watchObservedRunningTime="2026-05-26 16:10:47.344759869 +0000 UTC m=+554.455317662"
May 26 16:10:58.336620 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:10:58.336588    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-86f7b4b499-95k92"
May 26 16:11:06.930687 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.930649    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-67499b696f-6fgwm"]
May 26 16:11:06.933832 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.933815    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:06.948349 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.948327    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67499b696f-6fgwm"]
May 26 16:11:06.954250 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.954229    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-oauth-serving-cert\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:06.954324 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.954260    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e96d9413-c981-4e61-a12f-aa2b51075655-console-serving-cert\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:06.954324 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.954283    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e96d9413-c981-4e61-a12f-aa2b51075655-console-oauth-config\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:06.954324 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.954306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-trusted-ca-bundle\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:06.954424 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.954328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-service-ca\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:06.954424 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.954346    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfktm\" (UniqueName: \"kubernetes.io/projected/e96d9413-c981-4e61-a12f-aa2b51075655-kube-api-access-pfktm\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:06.954424 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:06.954363    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-console-config\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.054976 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.054943    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-oauth-serving-cert\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055147 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.054987    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e96d9413-c981-4e61-a12f-aa2b51075655-console-serving-cert\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055147 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.055028    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e96d9413-c981-4e61-a12f-aa2b51075655-console-oauth-config\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055147 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.055045    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-trusted-ca-bundle\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055147 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.055065    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-service-ca\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055147 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.055091    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfktm\" (UniqueName: \"kubernetes.io/projected/e96d9413-c981-4e61-a12f-aa2b51075655-kube-api-access-pfktm\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055147 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.055122    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-console-config\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055755 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.055729    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-oauth-serving-cert\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055878 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.055830    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-console-config\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055931 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.055889    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-service-ca\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.055975 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.055946    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96d9413-c981-4e61-a12f-aa2b51075655-trusted-ca-bundle\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.057490 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.057473    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e96d9413-c981-4e61-a12f-aa2b51075655-console-serving-cert\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.057548 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.057501    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e96d9413-c981-4e61-a12f-aa2b51075655-console-oauth-config\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.063678 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.063659    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfktm\" (UniqueName: \"kubernetes.io/projected/e96d9413-c981-4e61-a12f-aa2b51075655-kube-api-access-pfktm\") pod \"console-67499b696f-6fgwm\" (UID: \"e96d9413-c981-4e61-a12f-aa2b51075655\") " pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.244369 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.244339    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:07.368693 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.368671    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67499b696f-6fgwm"]
May 26 16:11:07.370299 ip-10-0-140-223 kubenswrapper[2567]: W0526 16:11:07.370274    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96d9413_c981_4e61_a12f_aa2b51075655.slice/crio-d195a13da68d0caad71ab4c1b943a7be137ba9f11589eda12e00d5ab937b60fb WatchSource:0}: Error finding container d195a13da68d0caad71ab4c1b943a7be137ba9f11589eda12e00d5ab937b60fb: Status 404 returned error can't find the container with id d195a13da68d0caad71ab4c1b943a7be137ba9f11589eda12e00d5ab937b60fb
May 26 16:11:07.392683 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:07.392658    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67499b696f-6fgwm" event={"ID":"e96d9413-c981-4e61-a12f-aa2b51075655","Type":"ContainerStarted","Data":"d195a13da68d0caad71ab4c1b943a7be137ba9f11589eda12e00d5ab937b60fb"}
May 26 16:11:08.396771 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:08.396736    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67499b696f-6fgwm" event={"ID":"e96d9413-c981-4e61-a12f-aa2b51075655","Type":"ContainerStarted","Data":"a55444680287702fbbbd4b6a37a8a58fb14a1cefc40a8495a39d5fd8a95fc4d8"}
May 26 16:11:08.416827 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:08.416782    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-67499b696f-6fgwm" podStartSLOduration=2.416767059 podStartE2EDuration="2.416767059s" podCreationTimestamp="2026-05-26 16:11:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:11:08.414670514 +0000 UTC m=+575.525228317" watchObservedRunningTime="2026-05-26 16:11:08.416767059 +0000 UTC m=+575.527324851"
May 26 16:11:17.244696 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:17.244661    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:17.245182 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:17.244708    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:17.249354 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:17.249327    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:17.433839 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:17.433803    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67499b696f-6fgwm"
May 26 16:11:17.476082 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:17.476052    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d665f884f-njv2h"]
May 26 16:11:33.442733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:33.442705    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:11:33.444912 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:33.444890    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:11:42.497872 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.497808    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6d665f884f-njv2h" podUID="c44abbfc-2060-4745-b130-47185bc6df74" containerName="console" containerID="cri-o://a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422" gracePeriod=15
May 26 16:11:42.657176 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.657142    2567 patch_prober.go:28] interesting pod/console-6d665f884f-njv2h container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body=
May 26 16:11:42.657324 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.657214    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6d665f884f-njv2h" podUID="c44abbfc-2060-4745-b130-47185bc6df74" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 16:11:42.742957 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.742925    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d665f884f-njv2h_c44abbfc-2060-4745-b130-47185bc6df74/console/0.log"
May 26 16:11:42.743080 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.743011    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:11:42.827883 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.827811    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-oauth-serving-cert\") pod \"c44abbfc-2060-4745-b130-47185bc6df74\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") "
May 26 16:11:42.828052 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.827882    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-serving-cert\") pod \"c44abbfc-2060-4745-b130-47185bc6df74\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") "
May 26 16:11:42.828052 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.827915    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-oauth-config\") pod \"c44abbfc-2060-4745-b130-47185bc6df74\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") "
May 26 16:11:42.828052 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.827937    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-trusted-ca-bundle\") pod \"c44abbfc-2060-4745-b130-47185bc6df74\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") "
May 26 16:11:42.828052 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.827971    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-service-ca\") pod \"c44abbfc-2060-4745-b130-47185bc6df74\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") "
May 26 16:11:42.828052 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.828016    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkbvr\" (UniqueName: \"kubernetes.io/projected/c44abbfc-2060-4745-b130-47185bc6df74-kube-api-access-gkbvr\") pod \"c44abbfc-2060-4745-b130-47185bc6df74\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") "
May 26 16:11:42.828302 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.828076    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-console-config\") pod \"c44abbfc-2060-4745-b130-47185bc6df74\" (UID: \"c44abbfc-2060-4745-b130-47185bc6df74\") "
May 26 16:11:42.828302 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.828205    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c44abbfc-2060-4745-b130-47185bc6df74" (UID: "c44abbfc-2060-4745-b130-47185bc6df74"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:11:42.828461 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.828355    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-service-ca" (OuterVolumeSpecName: "service-ca") pod "c44abbfc-2060-4745-b130-47185bc6df74" (UID: "c44abbfc-2060-4745-b130-47185bc6df74"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:11:42.828461 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.828442    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c44abbfc-2060-4745-b130-47185bc6df74" (UID: "c44abbfc-2060-4745-b130-47185bc6df74"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:11:42.828574 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.828461    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-oauth-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:11:42.828574 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.828541    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-console-config" (OuterVolumeSpecName: "console-config") pod "c44abbfc-2060-4745-b130-47185bc6df74" (UID: "c44abbfc-2060-4745-b130-47185bc6df74"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:11:42.830169 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.830138    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c44abbfc-2060-4745-b130-47185bc6df74" (UID: "c44abbfc-2060-4745-b130-47185bc6df74"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:11:42.830250 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.830226    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c44abbfc-2060-4745-b130-47185bc6df74" (UID: "c44abbfc-2060-4745-b130-47185bc6df74"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:11:42.830291 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.830226    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c44abbfc-2060-4745-b130-47185bc6df74-kube-api-access-gkbvr" (OuterVolumeSpecName: "kube-api-access-gkbvr") pod "c44abbfc-2060-4745-b130-47185bc6df74" (UID: "c44abbfc-2060-4745-b130-47185bc6df74"). InnerVolumeSpecName "kube-api-access-gkbvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:11:42.929369 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.929340    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-console-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:11:42.929369 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.929367    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-serving-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:11:42.929542 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.929381    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c44abbfc-2060-4745-b130-47185bc6df74-console-oauth-config\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:11:42.929542 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.929393    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-trusted-ca-bundle\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:11:42.929542 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.929405    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c44abbfc-2060-4745-b130-47185bc6df74-service-ca\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:11:42.929542 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:42.929443    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkbvr\" (UniqueName: \"kubernetes.io/projected/c44abbfc-2060-4745-b130-47185bc6df74-kube-api-access-gkbvr\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
May 26 16:11:43.513423 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.513400    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d665f884f-njv2h_c44abbfc-2060-4745-b130-47185bc6df74/console/0.log"
May 26 16:11:43.513733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.513436    2567 generic.go:358] "Generic (PLEG): container finished" podID="c44abbfc-2060-4745-b130-47185bc6df74" containerID="a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422" exitCode=2
May 26 16:11:43.513733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.513466    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d665f884f-njv2h" event={"ID":"c44abbfc-2060-4745-b130-47185bc6df74","Type":"ContainerDied","Data":"a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422"}
May 26 16:11:43.513733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.513490    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d665f884f-njv2h"
May 26 16:11:43.513733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.513501    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d665f884f-njv2h" event={"ID":"c44abbfc-2060-4745-b130-47185bc6df74","Type":"ContainerDied","Data":"552a67afb52a4e928d96fe13abcae631f8b0ba59753c8f7894de88744ac48d4e"}
May 26 16:11:43.513733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.513519    2567 scope.go:117] "RemoveContainer" containerID="a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422"
May 26 16:11:43.521642 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.521628    2567 scope.go:117] "RemoveContainer" containerID="a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422"
May 26 16:11:43.521875 ip-10-0-140-223 kubenswrapper[2567]: E0526 16:11:43.521855    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422\": container with ID starting with a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422 not found: ID does not exist" containerID="a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422"
May 26 16:11:43.521939 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.521885    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422"} err="failed to get container status \"a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422\": rpc error: code = NotFound desc = could not find container \"a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422\": container with ID starting with a6753cccac6a6f11a78f88f9e1f704e159e0ef4be1859e14a151d6f638b17422 not found: ID does not exist"
May 26 16:11:43.529968 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.529942    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d665f884f-njv2h"]
May 26 16:11:43.533414 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:43.533396    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d665f884f-njv2h"]
May 26 16:11:45.494271 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:11:45.494240    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c44abbfc-2060-4745-b130-47185bc6df74" path="/var/lib/kubelet/pods/c44abbfc-2060-4745-b130-47185bc6df74/volumes"
May 26 16:16:33.465598 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:16:33.465572    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:16:33.468782 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:16:33.468762    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:21:33.488433 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:21:33.488407    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:21:33.492987 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:21:33.492968    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:26:33.516722 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:26:33.516683    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:26:33.518391 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:26:33.518371    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:31:33.545350 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:31:33.545324    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:31:33.548686 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:31:33.548662    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:36:33.568270 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:36:33.568236    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:36:33.572920 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:36:33.572901    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:41:33.590843 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:41:33.590803    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:41:33.599503 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:41:33.599479    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:46:33.617302 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:46:33.617217    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:46:33.624218 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:46:33.624195    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:51:33.641314 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:51:33.641288    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:51:33.648578 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:51:33.648558    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:56:33.666544 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:56:33.666516    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 16:56:33.674733 ip-10-0-140-223 kubenswrapper[2567]: I0526 16:56:33.674712    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 17:01:33.689979 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:01:33.689865    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 17:01:33.699617 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:01:33.699598    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 17:06:33.713454 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:06:33.713336    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 17:06:33.725154 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:06:33.725127    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 17:09:20.378427 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:20.378397    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lhh97_fae7d651-a152-4e04-922a-86bcb8f7387d/global-pull-secret-syncer/0.log"
May 26 17:09:20.535563 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:20.535535    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z56kl_a4cdf919-1a9c-4477-b7e9-1d2b553e0557/konnectivity-agent/0.log"
May 26 17:09:20.609118 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:20.609084    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-223.ec2.internal_c705c9c8886b8665628a0c46bc41272e/haproxy/0.log"
May 26 17:09:24.270680 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.270650    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-rkx82_ea269d77-4959-4804-82a3-ffe314fa3712/monitoring-plugin/0.log"
May 26 17:09:24.439301 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.439265    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n6db4_4f48fcdf-e636-4961-9fd2-7c1a461748ee/node-exporter/0.log"
May 26 17:09:24.457435 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.457410    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n6db4_4f48fcdf-e636-4961-9fd2-7c1a461748ee/kube-rbac-proxy/0.log"
May 26 17:09:24.475361 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.475341    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n6db4_4f48fcdf-e636-4961-9fd2-7c1a461748ee/init-textfile/0.log"
May 26 17:09:24.498271 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.498252    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-zjwj7_abc0a6b8-2759-49b8-9921-96bc113e456a/kube-rbac-proxy-main/0.log"
May 26 17:09:24.518544 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.518525    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-zjwj7_abc0a6b8-2759-49b8-9921-96bc113e456a/kube-rbac-proxy-self/0.log"
May 26 17:09:24.537342 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.537282    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-zjwj7_abc0a6b8-2759-49b8-9921-96bc113e456a/openshift-state-metrics/0.log"
May 26 17:09:24.752606 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.752577    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-rdfsv_812f9eb6-37db-46cb-8001-bc1a4110c16e/prometheus-operator/0.log"
May 26 17:09:24.768917 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.768588    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-rdfsv_812f9eb6-37db-46cb-8001-bc1a4110c16e/kube-rbac-proxy/0.log"
May 26 17:09:24.790134 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.790069    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-68dfq_8f5e6d8e-f192-4a84-b593-23c0178cb017/prometheus-operator-admission-webhook/0.log"
May 26 17:09:24.815346 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.815321    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cd94686dc-2wldh_73200007-6318-4267-9c0f-3640f0b8ffd6/telemeter-client/0.log"
May 26 17:09:24.832261 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.832236    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cd94686dc-2wldh_73200007-6318-4267-9c0f-3640f0b8ffd6/reload/0.log"
May 26 17:09:24.850685 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.850664    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cd94686dc-2wldh_73200007-6318-4267-9c0f-3640f0b8ffd6/kube-rbac-proxy/0.log"
May 26 17:09:24.877889 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.877867    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65465c5db5-d42q8_ec62e47e-f33f-4a8b-99fe-58a282736ba4/thanos-query/0.log"
May 26 17:09:24.898159 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.898141    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65465c5db5-d42q8_ec62e47e-f33f-4a8b-99fe-58a282736ba4/kube-rbac-proxy-web/0.log"
May 26 17:09:24.916014 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.915979    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65465c5db5-d42q8_ec62e47e-f33f-4a8b-99fe-58a282736ba4/kube-rbac-proxy/0.log"
May 26 17:09:24.935633 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.935614    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65465c5db5-d42q8_ec62e47e-f33f-4a8b-99fe-58a282736ba4/prom-label-proxy/0.log"
May 26 17:09:24.952510 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.952493    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65465c5db5-d42q8_ec62e47e-f33f-4a8b-99fe-58a282736ba4/kube-rbac-proxy-rules/0.log"
May 26 17:09:24.969116 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:24.969080    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65465c5db5-d42q8_ec62e47e-f33f-4a8b-99fe-58a282736ba4/kube-rbac-proxy-metrics/0.log"
May 26 17:09:26.905018 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:26.904977    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67499b696f-6fgwm_e96d9413-c981-4e61-a12f-aa2b51075655/console/0.log"
May 26 17:09:26.967652 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:26.967623    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-fxjwv_218941f9-9f6b-4222-a147-240b78053057/download-server/0.log"
May 26 17:09:27.323267 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.323236    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-c86qd_15f6460a-e59e-4fec-bb58-a67ff23fb47f/volume-data-source-validator/0.log"
May 26 17:09:27.746061 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.746027    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"]
May 26 17:09:27.746403 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.746390    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44abbfc-2060-4745-b130-47185bc6df74" containerName="console"
May 26 17:09:27.746453 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.746404    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44abbfc-2060-4745-b130-47185bc6df74" containerName="console"
May 26 17:09:27.746488 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.746463    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="c44abbfc-2060-4745-b130-47185bc6df74" containerName="console"
May 26 17:09:27.749628 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.749609    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.751933 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.751913    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r4v6g\"/\"default-dockercfg-pq547\""
May 26 17:09:27.752177 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.752162    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r4v6g\"/\"openshift-service-ca.crt\""
May 26 17:09:27.752816 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.752801    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r4v6g\"/\"kube-root-ca.crt\""
May 26 17:09:27.756259 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.756215    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"]
May 26 17:09:27.815282 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.815258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-proc\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.815419 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.815294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-podres\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.815419 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.815366    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-lib-modules\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.815419 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.815415    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg7bs\" (UniqueName: \"kubernetes.io/projected/71454801-ec74-4da5-971b-544bcd6dc1de-kube-api-access-cg7bs\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.815539 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.815442    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-sys\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.916533 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.916508    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg7bs\" (UniqueName: \"kubernetes.io/projected/71454801-ec74-4da5-971b-544bcd6dc1de-kube-api-access-cg7bs\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.916855 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.916543    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-sys\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.916855 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.916563    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-proc\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.916855 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.916596    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-podres\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.916855 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.916640    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-lib-modules\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.916855 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.916644    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-sys\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.916855 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.916642    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-proc\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.916855 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.916694    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-podres\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.916855 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.916724    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71454801-ec74-4da5-971b-544bcd6dc1de-lib-modules\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:27.924560 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:27.924531    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg7bs\" (UniqueName: \"kubernetes.io/projected/71454801-ec74-4da5-971b-544bcd6dc1de-kube-api-access-cg7bs\") pod \"perf-node-gather-daemonset-4jcgp\" (UID: \"71454801-ec74-4da5-971b-544bcd6dc1de\") " pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:28.011262 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.011200    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cxzqq_a7e59530-8135-4c3d-a7f2-f525837a7ba9/dns/0.log"
May 26 17:09:28.030600 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.030576    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cxzqq_a7e59530-8135-4c3d-a7f2-f525837a7ba9/kube-rbac-proxy/0.log"
May 26 17:09:28.059669 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.059648    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:28.092326 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.092306    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5j9n9_1d61634f-edec-49c7-8504-65bb9238526a/dns-node-resolver/0.log"
May 26 17:09:28.181801 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.181775    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"]
May 26 17:09:28.184310 ip-10-0-140-223 kubenswrapper[2567]: W0526 17:09:28.184286    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod71454801_ec74_4da5_971b_544bcd6dc1de.slice/crio-ce19777edd394302cc3541ece7190df1d2d9f5e8a1601470969a7aa6042ff477 WatchSource:0}: Error finding container ce19777edd394302cc3541ece7190df1d2d9f5e8a1601470969a7aa6042ff477: Status 404 returned error can't find the container with id ce19777edd394302cc3541ece7190df1d2d9f5e8a1601470969a7aa6042ff477
May 26 17:09:28.186204 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.186189    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 17:09:28.568882 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.568816    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6p6md_cbed895c-2cee-4938-92e8-823766bdf878/node-ca/0.log"
May 26 17:09:28.812547 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.812515    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp" event={"ID":"71454801-ec74-4da5-971b-544bcd6dc1de","Type":"ContainerStarted","Data":"d196f77a8c5c1decbd0d321260cb17d65dcdfe52c9710be0e37ea3955cac1dcc"}
May 26 17:09:28.812547 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.812550    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp" event={"ID":"71454801-ec74-4da5-971b-544bcd6dc1de","Type":"ContainerStarted","Data":"ce19777edd394302cc3541ece7190df1d2d9f5e8a1601470969a7aa6042ff477"}
May 26 17:09:28.812733 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.812655    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:28.828525 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:28.828434    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp" podStartSLOduration=1.828400808 podStartE2EDuration="1.828400808s" podCreationTimestamp="2026-05-26 17:09:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 17:09:28.827659496 +0000 UTC m=+4075.938217290" watchObservedRunningTime="2026-05-26 17:09:28.828400808 +0000 UTC m=+4075.938958605"
May 26 17:09:29.576162 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:29.576113    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dkldm_97e650be-df4d-4a81-81b6-9081e889b5cb/serve-healthcheck-canary/0.log"
May 26 17:09:30.008864 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:30.008836    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c8vfk_b72063e5-bd6f-4255-8bf4-696aa1e2cb6d/kube-rbac-proxy/0.log"
May 26 17:09:30.024632 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:30.024602    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c8vfk_b72063e5-bd6f-4255-8bf4-696aa1e2cb6d/exporter/0.log"
May 26 17:09:30.041715 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:30.041684    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c8vfk_b72063e5-bd6f-4255-8bf4-696aa1e2cb6d/extractor/0.log"
May 26 17:09:32.061634 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:32.061602    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-6b94ff949c-rh86v_8d59cbb9-1ebb-4019-88f1-d9f6aaa8244e/manager/0.log"
May 26 17:09:32.079229 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:32.079202    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-86f7b4b499-95k92_a6f98516-0d30-4ce3-a568-a3d523336616/server/0.log"
May 26 17:09:32.376293 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:32.376207    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-79f457656b-hntx2_206eaea4-55f0-4728-bffa-8d898cccca80/seaweedfs/0.log"
May 26 17:09:34.825776 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:34.825752    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r4v6g/perf-node-gather-daemonset-4jcgp"
May 26 17:09:35.883569 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:35.883519    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-xfqrn_79b8627f-00c5-4c1d-8bcc-0437b77ef736/migrator/0.log"
May 26 17:09:35.900183 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:35.900150    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-xfqrn_79b8627f-00c5-4c1d-8bcc-0437b77ef736/graceful-termination/0.log"
May 26 17:09:37.210341 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.210316    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2hkb4_6b69e8e5-6171-4d40-95f2-f5075947001d/kube-multus/0.log"
May 26 17:09:37.249844 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.249823    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xs28_5dce97a3-a3c3-4027-8fc0-4337abb334dc/kube-multus-additional-cni-plugins/0.log"
May 26 17:09:37.271389 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.271368    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xs28_5dce97a3-a3c3-4027-8fc0-4337abb334dc/egress-router-binary-copy/0.log"
May 26 17:09:37.291575 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.291552    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xs28_5dce97a3-a3c3-4027-8fc0-4337abb334dc/cni-plugins/0.log"
May 26 17:09:37.311200 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.311181    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xs28_5dce97a3-a3c3-4027-8fc0-4337abb334dc/bond-cni-plugin/0.log"
May 26 17:09:37.331586 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.331566    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xs28_5dce97a3-a3c3-4027-8fc0-4337abb334dc/routeoverride-cni/0.log"
May 26 17:09:37.348990 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.348974    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xs28_5dce97a3-a3c3-4027-8fc0-4337abb334dc/whereabouts-cni-bincopy/0.log"
May 26 17:09:37.372851 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.372799    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xs28_5dce97a3-a3c3-4027-8fc0-4337abb334dc/whereabouts-cni/0.log"
May 26 17:09:37.797902 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.797864    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6lm2r_4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e/network-metrics-daemon/0.log"
May 26 17:09:37.813634 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:37.813608    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6lm2r_4afe74f9-5fdc-4aeb-8b6a-5bc60dd1e76e/kube-rbac-proxy/0.log"
May 26 17:09:38.549867 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:38.549839    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-controller/0.log"
May 26 17:09:38.565693 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:38.565658    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/0.log"
May 26 17:09:38.600321 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:38.600301    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovn-acl-logging/1.log"
May 26 17:09:38.623158 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:38.623137    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/kube-rbac-proxy-node/0.log"
May 26 17:09:38.644440 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:38.644421    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/kube-rbac-proxy-ovn-metrics/0.log"
May 26 17:09:38.661226 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:38.661201    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/northd/0.log"
May 26 17:09:38.678670 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:38.678654    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/nbdb/0.log"
May 26 17:09:38.697372 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:38.697323    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/sbdb/0.log"
May 26 17:09:38.858198 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:38.858172    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mczj_a8f8a8ec-0016-4484-8496-6813990419c8/ovnkube-controller/0.log"
May 26 17:09:40.393110 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:40.393076    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5dpqg_e1586315-86d3-4140-bbde-20aeba976a6b/network-check-target-container/0.log"
May 26 17:09:41.338092 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:41.338067    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-942gr_31c83f62-4c69-4d04-af97-1c368229b2ef/iptables-alerter/0.log"
May 26 17:09:42.081596 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:42.081562    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tczz9_94127774-1122-4c33-a89c-0a89175d27d6/tuned/0.log"
May 26 17:09:43.637278 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:43.637251    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-xzjlm_6c451891-d799-48bf-b0ec-64979b36f50c/cluster-samples-operator/0.log"
May 26 17:09:43.652553 ip-10-0-140-223 kubenswrapper[2567]: I0526 17:09:43.652524    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-xzjlm_6c451891-d799-48bf-b0ec-64979b36f50c/cluster-samples-operator-watch/0.log"