May 26 11:22:30.256982 ip-10-0-130-251 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 11:22:30.256992 ip-10-0-130-251 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 11:22:30.256999 ip-10-0-130-251 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 11:22:30.257214 ip-10-0-130-251 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 11:22:39.741687 ip-10-0-130-251 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 11:22:39.741701 ip-10-0-130-251 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f52463b82b8c4cf6af80bc1e9f0b2be7 --
May 26 11:25:01.227242 ip-10-0-130-251 systemd[1]: Starting Kubernetes Kubelet...
May 26 11:25:01.733855 ip-10-0-130-251 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 11:25:01.733855 ip-10-0-130-251 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 11:25:01.733855 ip-10-0-130-251 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 11:25:01.733855 ip-10-0-130-251 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 11:25:01.733855 ip-10-0-130-251 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 11:25:01.735901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.735805    2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 11:25:01.741325 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741305    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 11:25:01.741325 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741323    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741331    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741335    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741338    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741341    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741344    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741347    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741350    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741354    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741356    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741359    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741362    2563 feature_gate.go:328] unrecognized feature gate: Example
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741364    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741367    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741370    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741372    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741375    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741378    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741381    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741384    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 11:25:01.741402 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741386    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741389    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741391    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741394    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741396    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741399    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741401    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741404    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741407    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741409    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741412    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741415    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741418    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741420    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741425    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741428    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741430    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741433    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741435    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741438    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 11:25:01.741878 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741440    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741443    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741445    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741448    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741450    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741452    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741455    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741458    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741460    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741463    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741466    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741468    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741471    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741473    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741477    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741480    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741483    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741486    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741490    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 11:25:01.742418 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741494    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741497    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741500    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741503    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741505    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741508    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741510    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741515    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741518    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741521    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741524    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741526    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741530    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741533    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741536    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741539    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741547    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741551    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741554    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 11:25:01.742891 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741557    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741559    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741562    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741565    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741567    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741570    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.741573    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742018    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742025    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742028    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742031    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742034    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742037    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742039    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742042    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742045    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742047    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742050    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742053    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742055    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 11:25:01.743368 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742058    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742061    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742063    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742066    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742069    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742071    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742074    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742078    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742082    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742085    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742087    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742090    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742092    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742095    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742097    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742100    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742103    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742105    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742108    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 11:25:01.743860 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742111    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742114    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742117    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742120    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742122    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742125    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742127    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742130    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742132    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742137    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742140    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742143    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742146    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742149    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742151    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742155    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742157    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742160    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742162    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 11:25:01.744373 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742165    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742167    2563 feature_gate.go:328] unrecognized feature gate: Example
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742170    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742174    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742177    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742179    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742181    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742184    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742187    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742190    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742192    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742195    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742197    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742200    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742203    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742206    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742209    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742211    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742213    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742216    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 11:25:01.744850 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742219    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742221    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742224    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742226    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742229    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742231    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742234    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742236    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742239    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742242    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742244    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742247    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742249    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742251    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742254    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742330    2563 flags.go:64] FLAG: --address="0.0.0.0"
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742338    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742347    2563 flags.go:64] FLAG: --anonymous-auth="true"
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742354    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742361    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742366    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 11:25:01.745393 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742372    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742377    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742380    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742388    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742392    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742395    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742398    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742402    2563 flags.go:64] FLAG: --cgroup-root=""
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742405    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742407    2563 flags.go:64] FLAG: --client-ca-file=""
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742410    2563 flags.go:64] FLAG: --cloud-config=""
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742413    2563 flags.go:64] FLAG: --cloud-provider="external"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742416    2563 flags.go:64] FLAG: --cluster-dns="[]"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742420    2563 flags.go:64] FLAG: --cluster-domain=""
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742424    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742427    2563 flags.go:64] FLAG: --config-dir=""
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742431    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742435    2563 flags.go:64] FLAG: --container-log-max-files="5"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742439    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742442    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742445    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742452    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742455    2563 flags.go:64] FLAG: --contention-profiling="false"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742458    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 11:25:01.745901 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742461    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742465    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742468    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742473    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742476    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742479    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742482    2563 flags.go:64] FLAG: --enable-load-reader="false"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742485    2563 flags.go:64] FLAG: --enable-server="true"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742488    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742493    2563 flags.go:64] FLAG: --event-burst="100"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742496    2563 flags.go:64] FLAG: --event-qps="50"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742501    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742504    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742507    2563 flags.go:64] FLAG: --eviction-hard=""
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742511    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742514    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742517    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742520    2563 flags.go:64] FLAG: --eviction-soft=""
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742523    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742526    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742529    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742532    2563 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742536    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742539    2563 flags.go:64] FLAG: --fail-swap-on="true"
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742542    2563 flags.go:64] FLAG: --feature-gates=""
May 26 11:25:01.746503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742546    2563 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742549    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742552    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742555    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742558    2563 flags.go:64] FLAG: --healthz-port="10248"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742562    2563 flags.go:64] FLAG: --help="false"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742565    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-130-251.ec2.internal"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742569    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742572    2563 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742575    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742578    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742581    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742584    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742587    2563 flags.go:64] FLAG: --image-service-endpoint=""
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742590    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742593    2563 flags.go:64] FLAG: --kube-api-burst="100"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742596    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742599    2563 flags.go:64] FLAG: --kube-api-qps="50"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742603    2563 flags.go:64] FLAG: --kube-reserved=""
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742606    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742609    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742612    2563 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742615    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742619    2563 flags.go:64] FLAG: --lock-file=""
May 26 11:25:01.747130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742622    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742625    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742628    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742633    2563 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742636    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742639    2563 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742642    2563 flags.go:64] FLAG: --logging-format="text"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742645    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742648    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742651    2563 flags.go:64] FLAG: --manifest-url=""
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742654    2563 flags.go:64] FLAG: --manifest-url-header=""
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742658    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742661    2563 flags.go:64] FLAG: --max-open-files="1000000"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742665    2563 flags.go:64] FLAG: --max-pods="110"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742669    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742672    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742675    2563 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742679    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742682    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742685    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742688    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742696    2563 flags.go:64] FLAG: --node-status-max-images="50"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742700    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742703    2563 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 11:25:01.747751 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742706    2563 flags.go:64] FLAG: --pod-cidr=""
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742709    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742716    2563 flags.go:64] FLAG: --pod-manifest-path=""
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742720    2563 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742724    2563 flags.go:64] FLAG: --pods-per-core="0"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742727    2563 flags.go:64] FLAG: --port="10250"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742730    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742733    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0854a983537c36247"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742736    2563 flags.go:64] FLAG: --qos-reserved=""
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742739    2563 flags.go:64] FLAG: --read-only-port="10255"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742742    2563 flags.go:64] FLAG: --register-node="true"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742745    2563 flags.go:64] FLAG: --register-schedulable="true"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742748    2563 flags.go:64] FLAG: --register-with-taints=""
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742752    2563 flags.go:64] FLAG: --registry-burst="10"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742755    2563 flags.go:64] FLAG: --registry-qps="5"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742758    2563 flags.go:64] FLAG: --reserved-cpus=""
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742760    2563 flags.go:64] FLAG: --reserved-memory=""
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742764    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742767    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742771    2563 flags.go:64] FLAG: --rotate-certificates="false"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742773    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742777    2563 flags.go:64] FLAG: --runonce="false"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742779    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742783    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742786    2563 flags.go:64] FLAG: --seccomp-default="false"
May 26 11:25:01.748363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742789    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742792    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742796    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742799    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742802    2563 flags.go:64] FLAG: --storage-driver-password="root"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742804    2563 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742807    2563 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742810    2563 flags.go:64] FLAG: --storage-driver-user="root"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742813    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742816    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742820    2563 flags.go:64] FLAG: --system-cgroups=""
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742823    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742829    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742832    2563 flags.go:64] FLAG: --tls-cert-file=""
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742835    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742839    2563 flags.go:64] FLAG: --tls-min-version=""
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742842    2563 flags.go:64] FLAG: --tls-private-key-file=""
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742847    2563 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742850    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742853    2563 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742856    2563 flags.go:64] FLAG: --v="2"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742860    2563 flags.go:64] FLAG: --version="false"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742865    2563 flags.go:64] FLAG: --vmodule=""
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742869    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.742872    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 11:25:01.749006 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742980    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742984    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742988    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742990    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742993    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.742997    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743001    2563 feature_gate.go:328] unrecognized feature gate: Example
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743004    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743008    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743011    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743014    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743017    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743020    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743022    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743026    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743028    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743031    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743036    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743039    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 11:25:01.749610 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743042    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743044    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743047    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743050    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743052    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743056    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743059    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743061    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743064    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743066    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743069    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743071    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743074    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743077    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743079    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743082    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743085    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743088    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743090    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743093    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 11:25:01.750319 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743095    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743098    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743101    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743103    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743106    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743108    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743111    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743113    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743116    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743118    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743122    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743125    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743128    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743130    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743133    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743135    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743138    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743142    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743144    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743147    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 11:25:01.751173 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743150    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743153    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743155    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743158    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743161    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743163    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743166    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743169    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743173    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743176    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743179    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743182    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743185    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743188    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743190    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743193    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743195    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743198    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743200    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 11:25:01.751720 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743202    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 11:25:01.752252 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743205    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 11:25:01.752252 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743208    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 11:25:01.752252 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743216    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 11:25:01.752252 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743218    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 26 11:25:01.752252 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743221    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 11:25:01.752252 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743223    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 11:25:01.752252 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.743226    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 11:25:01.752252 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.744042    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 11:25:01.753195 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.753170    2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 11:25:01.753234 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.753197    2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 11:25:01.753271 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753262    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 11:25:01.753271 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753270    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753274    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753278    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753281    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753284    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753287    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753290    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753292    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753295    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753298    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753300    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753303    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753306    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753308    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753311    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753314    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753317    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753319    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753322    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753324    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 11:25:01.753327 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753327    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753330    2563 feature_gate.go:328] unrecognized feature gate: Example
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753333    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753336    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753339    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753342    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753346    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753348    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753351    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753353    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753356    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753359    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753362    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753364    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753367    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753369    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753372    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753374    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753377    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 11:25:01.753824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753379    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753383    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753386    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753390    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753393    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753396    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753398    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753401    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753405    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753410    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753413    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753416    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753418    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753422    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753424    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753428    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753431    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753434    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753437    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 11:25:01.754307 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753440    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753443    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753445    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753448    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753451    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753454    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753457    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753459    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753461    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753464    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753467    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753469    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753472    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753475    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753477    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753480    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753483    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753486    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753489    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753492    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 11:25:01.754776 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753494    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753497    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753500    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753502    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753505    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753508    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753510    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.753515    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753653    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753659    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753663    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753665    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753668    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753671    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753674    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753677    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 11:25:01.755272 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753680    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753683    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753685    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753688    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753691    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753693    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753696    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753698    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753701    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753704    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753706    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753709    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753712    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753715    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753718    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753721    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753723    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753726    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753728    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753731    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 11:25:01.755664 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753733    2563 feature_gate.go:328] unrecognized feature gate: Example
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753736    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753739    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753741    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753744    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753747    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753751    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753755    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753758    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753761    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753763    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753766    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753769    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753771    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753774    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753776    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753779    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753781    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753784    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753787    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 11:25:01.756182 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753789    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753792    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753795    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753797    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753800    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753802    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753805    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753808    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753811    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753813    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753816    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753818    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753821    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753823    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753826    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753828    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753831    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753835    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753838    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753840    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 11:25:01.756668 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753843    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753846    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753848    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753851    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753855    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753858    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753862    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753864    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753868    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753870    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753873    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753875    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753878    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753880    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753883    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753886    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753888    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 11:25:01.757174 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:01.753890    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 11:25:01.757595 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.753895    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 11:25:01.757595 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.754857    2563 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 11:25:01.757595 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.757351    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 11:25:01.758484 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.758471    2563 server.go:1019] "Starting client certificate rotation"
May 26 11:25:01.758592 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.758574    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 11:25:01.759226 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.759214    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 11:25:01.786081 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.786057    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 11:25:01.789059 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.789032    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 11:25:01.810279 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.810253    2563 log.go:25] "Validated CRI v1 runtime API"
May 26 11:25:01.819031 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.819008    2563 log.go:25] "Validated CRI v1 image API"
May 26 11:25:01.820739 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.820714    2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 11:25:01.825210 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.825191    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 11:25:01.827947 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.827903    2563 fs.go:135] Filesystem UUIDs: map[1daed5af-7501-46fa-99e3-649921cd89c3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d1e7c953-0f57-4ebf-bc14-c1791bba73d1:/dev/nvme0n1p4]
May 26 11:25:01.827947 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.827926    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 11:25:01.832480 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.832360    2563 manager.go:217] Machine: {Timestamp:2026-05-26 11:25:01.831793531 +0000 UTC m=+0.471554298 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100934 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21ac62318e90612f145c7638773978 SystemUUID:ec21ac62-318e-9061-2f14-5c7638773978 BootID:f52463b8-2b8c-4cf6-af80-bc1e9f0b2be7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:c0:c6:83:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:c0:c6:83:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:47:eb:d9:19:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 11:25:01.833282 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.833269    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 11:25:01.833383 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.833370    2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 11:25:01.835681 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.835651    2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 11:25:01.835845 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.835684    2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-251.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 11:25:01.835898 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.835855    2563 topology_manager.go:138] "Creating topology manager with none policy"
May 26 11:25:01.835898 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.835864    2563 container_manager_linux.go:306] "Creating device plugin manager"
May 26 11:25:01.835898 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.835872    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 11:25:01.836849 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.836837    2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 11:25:01.838644 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.838634    2563 state_mem.go:36] "Initialized new in-memory state store"
May 26 11:25:01.838765 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.838756    2563 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 11:25:01.841732 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.841722    2563 kubelet.go:491] "Attempting to sync node with API server"
May 26 11:25:01.841778 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.841736    2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 11:25:01.841778 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.841748    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 11:25:01.841778 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.841758    2563 kubelet.go:397] "Adding apiserver pod source"
May 26 11:25:01.841778 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.841767    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 11:25:01.843113 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.843100    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 11:25:01.843172 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.843120    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 11:25:01.847363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.847347    2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 11:25:01.847656 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.847638    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78swk"
May 26 11:25:01.849568 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.849554    2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 11:25:01.850466 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850454    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 11:25:01.850505 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850471    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 11:25:01.850505 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850478    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 11:25:01.850505 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850485    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 11:25:01.850505 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850493    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 11:25:01.850505 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850499    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 11:25:01.850505 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850504    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 11:25:01.850678 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850510    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 11:25:01.850678 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850517    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 11:25:01.850678 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850524    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 11:25:01.850678 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850537    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 11:25:01.850892 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.850884    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 11:25:01.851858 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.851845    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 11:25:01.851858 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.851857    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 11:25:01.855227 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.855211    2563 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 11:25:01.855316 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.855252    2563 server.go:1295] "Started kubelet"
May 26 11:25:01.855316 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.855209    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78swk"
May 26 11:25:01.855420 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.855324    2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 11:25:01.855466 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.855328    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 11:25:01.856245 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.855426    2563 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 11:25:01.856463 ip-10-0-130-251 systemd[1]: Started Kubernetes Kubelet.
May 26 11:25:01.857132 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.857111    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 11:25:01.857552 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.857532    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 11:25:01.857651 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.857628    2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-251.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 11:25:01.858644 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.858627    2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 11:25:01.858753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.858739    2563 server.go:317] "Adding debug handlers to kubelet server"
May 26 11:25:01.867587 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.867552    2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 11:25:01.867947 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.867916    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 11:25:01.868552 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.868535    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 11:25:01.868660 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.868639    2563 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 11:25:01.868660 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.868658    2563 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 11:25:01.868804 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.868779    2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 11:25:01.868857 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.868831    2563 reconstruct.go:97] "Volume reconstruction finished"
May 26 11:25:01.868857 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.868840    2563 reconciler.go:26] "Reconciler: start to sync state"
May 26 11:25:01.869392 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.869345    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:01.869501 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.869483    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 11:25:01.869558 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.869503    2563 factory.go:55] Registering systemd factory
May 26 11:25:01.869558 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.869513    2563 factory.go:223] Registration of the systemd container factory successfully
May 26 11:25:01.869897 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.869815    2563 factory.go:153] Registering CRI-O factory
May 26 11:25:01.869897 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.869831    2563 factory.go:223] Registration of the crio container factory successfully
May 26 11:25:01.869897 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.869848    2563 factory.go:103] Registering Raw factory
May 26 11:25:01.869897 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.869857    2563 manager.go:1196] Started watching for new ooms in manager
May 26 11:25:01.870281 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.870267    2563 manager.go:319] Starting recovery of all containers
May 26 11:25:01.871945 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.871908    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 11:25:01.875662 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.875487    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-251.ec2.internal\" not found" node="ip-10-0-130-251.ec2.internal"
May 26 11:25:01.878795 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.878772    2563 manager.go:324] Recovery completed
May 26 11:25:01.880569 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.880546    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 26 11:25:01.883644 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.883631    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 11:25:01.885663 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.885649    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientMemory"
May 26 11:25:01.885729 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.885677    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasNoDiskPressure"
May 26 11:25:01.885729 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.885690    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientPID"
May 26 11:25:01.886294 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.886278    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 11:25:01.886294 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.886291    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 11:25:01.886387 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.886308    2563 state_mem.go:36] "Initialized new in-memory state store"
May 26 11:25:01.890187 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.890175    2563 policy_none.go:49] "None policy: Start"
May 26 11:25:01.890223 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.890192    2563 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 11:25:01.890223 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.890203    2563 state_mem.go:35] "Initializing new in-memory state store"
May 26 11:25:01.919924 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.919903    2563 manager.go:341] "Starting Device Plugin manager"
May 26 11:25:01.920039 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.919956    2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 11:25:01.920039 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.919966    2563 server.go:85] "Starting device plugin registration server"
May 26 11:25:01.920189 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.920178    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 11:25:01.920241 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.920193    2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 11:25:01.920310 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.920290    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 11:25:01.920411 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.920382    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 11:25:01.920411 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.920399    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 11:25:01.921159 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.921139    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 11:25:01.921244 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.921183    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:01.970301 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.970265    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 11:25:01.971511 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.971496    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 11:25:01.971570 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.971518    2563 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 11:25:01.971570 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.971538    2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 11:25:01.971570 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.971545    2563 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 11:25:01.971680 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:01.971585    2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 11:25:01.975918 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:01.975897    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 11:25:02.021073 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.020976    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 11:25:02.023645 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.023625    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientMemory"
May 26 11:25:02.023769 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.023661    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasNoDiskPressure"
May 26 11:25:02.023769 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.023675    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientPID"
May 26 11:25:02.023769 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.023705    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-251.ec2.internal"
May 26 11:25:02.039526 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.039496    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-251.ec2.internal"
May 26 11:25:02.039526 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.039526    2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-251.ec2.internal\": node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.072360 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.072307    2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal"]
May 26 11:25:02.072494 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.072409    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 11:25:02.073446 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.073431    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientMemory"
May 26 11:25:02.073540 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.073464    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasNoDiskPressure"
May 26 11:25:02.073540 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.073479    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientPID"
May 26 11:25:02.074765 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.074752    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 11:25:02.074919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.074905    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.074983 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.074947    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 11:25:02.075562 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.075536    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientMemory"
May 26 11:25:02.075671 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.075569    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasNoDiskPressure"
May 26 11:25:02.075671 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.075581    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientPID"
May 26 11:25:02.075671 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.075540    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientMemory"
May 26 11:25:02.075671 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.075646    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasNoDiskPressure"
May 26 11:25:02.075671 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.075661    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientPID"
May 26 11:25:02.076953 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.076922    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.077047 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.076967    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 11:25:02.078740 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.078720    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.078838 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.078769    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientMemory"
May 26 11:25:02.078838 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.078792    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasNoDiskPressure"
May 26 11:25:02.078838 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.078802    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeHasSufficientPID"
May 26 11:25:02.100836 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.100807    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-251.ec2.internal\" not found" node="ip-10-0-130-251.ec2.internal"
May 26 11:25:02.105370 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.105352    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-251.ec2.internal\" not found" node="ip-10-0-130-251.ec2.internal"
May 26 11:25:02.179552 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.179517    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.270679 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.270641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e84217bd481dcc6454c9b0feead11e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal\" (UID: \"3e84217bd481dcc6454c9b0feead11e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.270679 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.270680    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e84217bd481dcc6454c9b0feead11e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal\" (UID: \"3e84217bd481dcc6454c9b0feead11e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.270886 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.270702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42f8da2d362f9be132a5038f5b173c5f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-251.ec2.internal\" (UID: \"42f8da2d362f9be132a5038f5b173c5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.280418 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.280338    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.371350 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.371314    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42f8da2d362f9be132a5038f5b173c5f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-251.ec2.internal\" (UID: \"42f8da2d362f9be132a5038f5b173c5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.371509 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.371348    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e84217bd481dcc6454c9b0feead11e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal\" (UID: \"3e84217bd481dcc6454c9b0feead11e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.371509 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.371394    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e84217bd481dcc6454c9b0feead11e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal\" (UID: \"3e84217bd481dcc6454c9b0feead11e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.371509 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.371421    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42f8da2d362f9be132a5038f5b173c5f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-251.ec2.internal\" (UID: \"42f8da2d362f9be132a5038f5b173c5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.371509 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.371444    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e84217bd481dcc6454c9b0feead11e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal\" (UID: \"3e84217bd481dcc6454c9b0feead11e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.371509 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.371426    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e84217bd481dcc6454c9b0feead11e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal\" (UID: \"3e84217bd481dcc6454c9b0feead11e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.381418 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.381392    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.403590 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.403561    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.408370 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.408351    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal"
May 26 11:25:02.481507 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.481459    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.582053 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.581957    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.682501 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.682465    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.724967 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.724920    2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 11:25:02.758862 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.758831    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 11:25:02.759399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.759011    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 11:25:02.759399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.759021    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 11:25:02.759399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.759017    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 11:25:02.783314 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.783279    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.858074 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.857986    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 11:20:01 +0000 UTC" deadline="2027-12-22 11:09:40.981107487 +0000 UTC"
May 26 11:25:02.858074 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.858072    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13799h44m38.123039759s"
May 26 11:25:02.868084 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.868061    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 11:25:02.883080 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.883055    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 11:25:02.884043 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.884026    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.907519 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.907484    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jsr9j"
May 26 11:25:02.916585 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.916562    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jsr9j"
May 26 11:25:02.978647 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:02.978606    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f8da2d362f9be132a5038f5b173c5f.slice/crio-034980fc20a9ada1b1c07f4ba006c746de5b3c2cdb51c9513ae6436b781cec4f WatchSource:0}: Error finding container 034980fc20a9ada1b1c07f4ba006c746de5b3c2cdb51c9513ae6436b781cec4f: Status 404 returned error can't find the container with id 034980fc20a9ada1b1c07f4ba006c746de5b3c2cdb51c9513ae6436b781cec4f
May 26 11:25:02.978799 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:02.978785    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e84217bd481dcc6454c9b0feead11e9.slice/crio-808c213170689d7df5e6a9a6be8611a9ffff595eec00567e27a83ed7f0b1949f WatchSource:0}: Error finding container 808c213170689d7df5e6a9a6be8611a9ffff595eec00567e27a83ed7f0b1949f: Status 404 returned error can't find the container with id 808c213170689d7df5e6a9a6be8611a9ffff595eec00567e27a83ed7f0b1949f
May 26 11:25:02.984142 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:02.984123    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:02.984209 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:02.984194    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 11:25:03.084827 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:03.084791    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:03.185363 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:03.185268    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:03.285776 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:03.285744    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-251.ec2.internal\" not found"
May 26 11:25:03.357620 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.357590    2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 11:25:03.369570 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.369542    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal"
May 26 11:25:03.382135 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.382106    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 11:25:03.383385 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.383363    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal"
May 26 11:25:03.392365 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.392340    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 11:25:03.841700 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.841674    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 11:25:03.842701 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.842682    2563 apiserver.go:52] "Watching apiserver"
May 26 11:25:03.849829 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.849803    2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 11:25:03.851143 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.851117    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-ftcxs","openshift-network-diagnostics/network-check-target-vbsxn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng","openshift-dns/node-resolver-qlg6j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal","openshift-multus/multus-additional-cni-plugins-gxxgq","openshift-multus/network-metrics-daemon-2lvct","openshift-network-operator/iptables-alerter-h5vjn","openshift-ovn-kubernetes/ovnkube-node-mcr45","kube-system/konnectivity-agent-wrbzx","kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal","openshift-cluster-node-tuning-operator/tuned-j8xh4","openshift-image-registry/node-ca-wb6hv"]
May 26 11:25:03.855547 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.855526    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:03.855646 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:03.855616    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:03.855708 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.855680    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:03.855772 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:03.855736    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:03.857636 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.857615    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.860003 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.859742    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 11:25:03.860003 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.859829    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 11:25:03.860003 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.859874    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x9z9p\""
May 26 11:25:03.860003 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.859921    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 11:25:03.862979 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.862958    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.863055 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.862978    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.865248 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.865218    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.865922 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.865896    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 11:25:03.866034 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.865964    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 11:25:03.866034 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.866009    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9q2g2\""
May 26 11:25:03.866144 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.866118    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2q7kp\""
May 26 11:25:03.866144 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.866128    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 11:25:03.866243 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.866200    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 11:25:03.866243 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.866227    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 11:25:03.866450 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.866437    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 11:25:03.866872 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.866850    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 11:25:03.867129 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.867110    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 11:25:03.867452 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.867364    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:03.867886 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.867860    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dl8rh\""
May 26 11:25:03.869323 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.869289    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 11:25:03.869599 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.869579    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 11:25:03.869689 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.869632    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.869790 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.869774    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sxhc5\""
May 26 11:25:03.870166 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.870145    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 11:25:03.871573 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.871554    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 11:25:03.871695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.871662    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 11:25:03.871913 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.871893    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:03.872013 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.871961    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 11:25:03.872370 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.872351    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gbdkw\""
May 26 11:25:03.872466 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.872447    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 11:25:03.872536 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.872477    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 11:25:03.872536 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.872495    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 11:25:03.873966 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.873949    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2c9rg\""
May 26 11:25:03.874093 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.874054    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 11:25:03.874155 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.874146    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 11:25:03.874307 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.874290    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.876396 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.876379    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fdxhl\""
May 26 11:25:03.876714 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.876658    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 11:25:03.876714 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.876699    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 11:25:03.876884 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.876868    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:03.879097 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.879078    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 11:25:03.879849 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.879818    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 11:25:03.879958 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.879880    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tbk5m\""
May 26 11:25:03.879958 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.879887    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 11:25:03.881145 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-var-lib-cni-multus\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.881237 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-cni-bin\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881237 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881237 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881206    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-os-release\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.881237 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-var-lib-kubelet\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.881456 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-run-openvswitch\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881456 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881456 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd62691e-bc2b-431c-abe0-71566552c7b0-env-overrides\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881456 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd62691e-bc2b-431c-abe0-71566552c7b0-ovn-node-metrics-cert\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881456 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-run-k8s-cni-cncf-io\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.881651 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-run-systemd\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881651 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6h6b\" (UniqueName: \"kubernetes.io/projected/76d1a9f1-5bad-4ab1-93dc-2388810c4796-kube-api-access-w6h6b\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:03.881651 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.881651 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-system-cni-dir\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.881651 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-socket-dir-parent\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.881651 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-conf-dir\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881664    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-etc-openvswitch\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd62691e-bc2b-431c-abe0-71566552c7b0-ovnkube-script-lib\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e00385cd-25f1-4065-8b1e-f7b4965d9240-cni-binary-copy\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-systemd-units\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881788    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-node-log\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-cnibin\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-cni-dir\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-daemon-config\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.881888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-kubelet\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-hostroot\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-cni-netd\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.881987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzf9\" (UniqueName: \"kubernetes.io/projected/20546609-e39a-4863-a12b-747a69bc9204-kube-api-access-4kzf9\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882010    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e00385cd-25f1-4065-8b1e-f7b4965d9240-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e00385cd-25f1-4065-8b1e-f7b4965d9240-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-run-ovn\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-registration-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krpn8\" (UniqueName: \"kubernetes.io/projected/e00385cd-25f1-4065-8b1e-f7b4965d9240-kube-api-access-krpn8\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef8ff7da-ffea-4290-a8a4-74b20c234e8a-iptables-alerter-script\") pod \"iptables-alerter-h5vjn\" (UID: \"ef8ff7da-ffea-4290-a8a4-74b20c234e8a\") " pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd62691e-bc2b-431c-abe0-71566552c7b0-ovnkube-config\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-255sw\" (UniqueName: \"kubernetes.io/projected/ef8ff7da-ffea-4290-a8a4-74b20c234e8a-kube-api-access-255sw\") pod \"iptables-alerter-h5vjn\" (UID: \"ef8ff7da-ffea-4290-a8a4-74b20c234e8a\") " pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab49ede9-db47-4d76-a5b3-a546c6d9baaf-hosts-file\") pod \"node-resolver-qlg6j\" (UID: \"ab49ede9-db47-4d76-a5b3-a546c6d9baaf\") " pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-run-netns\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.882399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-var-lib-openvswitch\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-sys-fs\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab49ede9-db47-4d76-a5b3-a546c6d9baaf-tmp-dir\") pod \"node-resolver-qlg6j\" (UID: \"ab49ede9-db47-4d76-a5b3-a546c6d9baaf\") " pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrkh8\" (UniqueName: \"kubernetes.io/projected/ab49ede9-db47-4d76-a5b3-a546c6d9baaf-kube-api-access-mrkh8\") pod \"node-resolver-qlg6j\" (UID: \"ab49ede9-db47-4d76-a5b3-a546c6d9baaf\") " pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef8ff7da-ffea-4290-a8a4-74b20c234e8a-host-slash\") pod \"iptables-alerter-h5vjn\" (UID: \"ef8ff7da-ffea-4290-a8a4-74b20c234e8a\") " pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-cnibin\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a680106-cb94-4758-86e4-e293bc9c27a7-cni-binary-copy\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-slash\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-device-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-system-cni-dir\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-var-lib-cni-bin\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-os-release\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-run-multus-certs\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzm5c\" (UniqueName: \"kubernetes.io/projected/1a680106-cb94-4758-86e4-e293bc9c27a7-kube-api-access-mzm5c\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.883277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-socket-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.883971 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-run-netns\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.883971 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.882989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-etc-kubernetes\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.883971 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.883012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-log-socket\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.883971 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.883035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7vtk\" (UniqueName: \"kubernetes.io/projected/bd62691e-bc2b-431c-abe0-71566552c7b0-kube-api-access-v7vtk\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.917596 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.917556    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 11:20:02 +0000 UTC" deadline="2028-01-18 04:51:51.530802231 +0000 UTC"
May 26 11:25:03.917596 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.917591    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14441h26m47.613214686s"
May 26 11:25:03.920966 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.920942    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 11:25:03.969511 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.969484    2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 11:25:03.976062 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.976013    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal" event={"ID":"3e84217bd481dcc6454c9b0feead11e9","Type":"ContainerStarted","Data":"808c213170689d7df5e6a9a6be8611a9ffff595eec00567e27a83ed7f0b1949f"}
May 26 11:25:03.977153 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.977130    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal" event={"ID":"42f8da2d362f9be132a5038f5b173c5f","Type":"ContainerStarted","Data":"034980fc20a9ada1b1c07f4ba006c746de5b3c2cdb51c9513ae6436b781cec4f"}
May 26 11:25:03.983458 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/606c2274-61c4-4d6a-85eb-5c9f225860ee-agent-certs\") pod \"konnectivity-agent-wrbzx\" (UID: \"606c2274-61c4-4d6a-85eb-5c9f225860ee\") " pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:03.983579 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-sysconfig\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.983579 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-run\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.983579 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfa31a2-73fa-46cb-841b-bcce051793f2-tmp\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.983694 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ebd6dc0d-0732-49fe-ad88-7a6d8550514d-serviceca\") pod \"node-ca-wb6hv\" (UID: \"ebd6dc0d-0732-49fe-ad88-7a6d8550514d\") " pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:03.983694 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983608    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-255sw\" (UniqueName: \"kubernetes.io/projected/ef8ff7da-ffea-4290-a8a4-74b20c234e8a-kube-api-access-255sw\") pod \"iptables-alerter-h5vjn\" (UID: \"ef8ff7da-ffea-4290-a8a4-74b20c234e8a\") " pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:03.983694 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983625    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab49ede9-db47-4d76-a5b3-a546c6d9baaf-hosts-file\") pod \"node-resolver-qlg6j\" (UID: \"ab49ede9-db47-4d76-a5b3-a546c6d9baaf\") " pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.983694 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983655    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-run-netns\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.983694 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983679    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-var-lib-openvswitch\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983704    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983713    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab49ede9-db47-4d76-a5b3-a546c6d9baaf-hosts-file\") pod \"node-resolver-qlg6j\" (UID: \"ab49ede9-db47-4d76-a5b3-a546c6d9baaf\") " pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983727    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-sys-fs\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-modprobe-d\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-kubernetes\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983797    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab49ede9-db47-4d76-a5b3-a546c6d9baaf-tmp-dir\") pod \"node-resolver-qlg6j\" (UID: \"ab49ede9-db47-4d76-a5b3-a546c6d9baaf\") " pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983825    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrkh8\" (UniqueName: \"kubernetes.io/projected/ab49ede9-db47-4d76-a5b3-a546c6d9baaf-kube-api-access-mrkh8\") pod \"node-resolver-qlg6j\" (UID: \"ab49ede9-db47-4d76-a5b3-a546c6d9baaf\") " pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-run-netns\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983870    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.983904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/606c2274-61c4-4d6a-85eb-5c9f225860ee-konnectivity-ca\") pod \"konnectivity-agent-wrbzx\" (UID: \"606c2274-61c4-4d6a-85eb-5c9f225860ee\") " pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983912    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-var-lib-openvswitch\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-lib-modules\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983972    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef8ff7da-ffea-4290-a8a4-74b20c234e8a-host-slash\") pod \"iptables-alerter-h5vjn\" (UID: \"ef8ff7da-ffea-4290-a8a4-74b20c234e8a\") " pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.983988    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-sys-fs\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984001    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-cnibin\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984024    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a680106-cb94-4758-86e4-e293bc9c27a7-cni-binary-copy\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984030    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef8ff7da-ffea-4290-a8a4-74b20c234e8a-host-slash\") pod \"iptables-alerter-h5vjn\" (UID: \"ef8ff7da-ffea-4290-a8a4-74b20c234e8a\") " pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984047    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-slash\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-cnibin\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984088    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-device-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984133    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-device-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbnlf\" (UniqueName: \"kubernetes.io/projected/3cfa31a2-73fa-46cb-841b-bcce051793f2-kube-api-access-pbnlf\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984155    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-slash\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984169    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-system-cni-dir\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984190    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-var-lib-cni-bin\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984202    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-system-cni-dir\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.984367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984210    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984214    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab49ede9-db47-4d76-a5b3-a546c6d9baaf-tmp-dir\") pod \"node-resolver-qlg6j\" (UID: \"ab49ede9-db47-4d76-a5b3-a546c6d9baaf\") " pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984234    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-os-release\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984246    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-var-lib-cni-bin\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984264    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-run-multus-certs\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984288    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzm5c\" (UniqueName: \"kubernetes.io/projected/1a680106-cb94-4758-86e4-e293bc9c27a7-kube-api-access-mzm5c\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984313    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-os-release\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984336    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-run-multus-certs\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984373    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-socket-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:03.984389    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-sys\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984431    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-run-netns\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984455    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-etc-kubernetes\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:03.984472    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs podName:76d1a9f1-5bad-4ab1-93dc-2388810c4796 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:04.484449258 +0000 UTC m=+3.124210023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs") pod "network-metrics-daemon-2lvct" (UID: "76d1a9f1-5bad-4ab1-93dc-2388810c4796") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984489    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-etc-kubernetes\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984497    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-socket-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984511    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-run-netns\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985101 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984505    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-log-socket\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984547    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-log-socket\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984569    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a680106-cb94-4758-86e4-e293bc9c27a7-cni-binary-copy\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984570    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7vtk\" (UniqueName: \"kubernetes.io/projected/bd62691e-bc2b-431c-abe0-71566552c7b0-kube-api-access-v7vtk\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkz7b\" (UniqueName: \"kubernetes.io/projected/ebd6dc0d-0732-49fe-ad88-7a6d8550514d-kube-api-access-wkz7b\") pod \"node-ca-wb6hv\" (UID: \"ebd6dc0d-0732-49fe-ad88-7a6d8550514d\") " pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984655    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-var-lib-cni-multus\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984681    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-cni-bin\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984707    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-cni-bin\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-var-lib-cni-multus\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-host\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebd6dc0d-0732-49fe-ad88-7a6d8550514d-host\") pod \"node-ca-wb6hv\" (UID: \"ebd6dc0d-0732-49fe-ad88-7a6d8550514d\") " pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984873    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-os-release\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984901    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-var-lib-kubelet\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984927    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-run-openvswitch\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984975    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-var-lib-kubelet\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.985840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984993    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.984998    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-os-release\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985021    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd62691e-bc2b-431c-abe0-71566552c7b0-env-overrides\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985025    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-run-openvswitch\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985050    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985057    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd62691e-bc2b-431c-abe0-71566552c7b0-ovn-node-metrics-cert\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-sysctl-conf\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985125    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-run-k8s-cni-cncf-io\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985153    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-run-systemd\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985188    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-host-run-k8s-cni-cncf-io\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985192    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-run-systemd\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985232    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6h6b\" (UniqueName: \"kubernetes.io/projected/76d1a9f1-5bad-4ab1-93dc-2388810c4796-kube-api-access-w6h6b\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985260    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985283    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-system-cni-dir\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985308    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-socket-dir-parent\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985332    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-conf-dir\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985355    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-etc-openvswitch\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.986587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985380    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd62691e-bc2b-431c-abe0-71566552c7b0-ovnkube-script-lib\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985390    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-sysctl-d\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985437    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-conf-dir\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985462    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-etc-openvswitch\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985465    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd62691e-bc2b-431c-abe0-71566552c7b0-env-overrides\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985464    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985491    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-system-cni-dir\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985500    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e00385cd-25f1-4065-8b1e-f7b4965d9240-cni-binary-copy\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985541    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-socket-dir-parent\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985618    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-tuned\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985681    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-systemd-units\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985707    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-node-log\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985733    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-cnibin\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985737    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-systemd-units\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985759    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-cni-dir\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985782    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-node-log\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985783    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-daemon-config\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985840    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-kubelet\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985858    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e00385cd-25f1-4065-8b1e-f7b4965d9240-cnibin\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-systemd\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985902    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-hostroot\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985921    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-cni-dir\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985944    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-cni-netd\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985925    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd62691e-bc2b-431c-abe0-71566552c7b0-ovnkube-script-lib\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985974    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzf9\" (UniqueName: \"kubernetes.io/projected/20546609-e39a-4863-a12b-747a69bc9204-kube-api-access-4kzf9\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.985997    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-kubelet\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986001    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e00385cd-25f1-4065-8b1e-f7b4965d9240-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986007    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-host-cni-netd\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986030    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e00385cd-25f1-4065-8b1e-f7b4965d9240-cni-binary-copy\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986048    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e00385cd-25f1-4065-8b1e-f7b4965d9240-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986077    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-run-ovn\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a680106-cb94-4758-86e4-e293bc9c27a7-hostroot\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986101    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.987753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986128    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-registration-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-var-lib-kubelet\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986166    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd62691e-bc2b-431c-abe0-71566552c7b0-run-ovn\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986181    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krpn8\" (UniqueName: \"kubernetes.io/projected/e00385cd-25f1-4065-8b1e-f7b4965d9240-kube-api-access-krpn8\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986208    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef8ff7da-ffea-4290-a8a4-74b20c234e8a-iptables-alerter-script\") pod \"iptables-alerter-h5vjn\" (UID: \"ef8ff7da-ffea-4290-a8a4-74b20c234e8a\") " pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986234    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-registration-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986234    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd62691e-bc2b-431c-abe0-71566552c7b0-ovnkube-config\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986248    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20546609-e39a-4863-a12b-747a69bc9204-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986315    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a680106-cb94-4758-86e4-e293bc9c27a7-multus-daemon-config\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986505    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e00385cd-25f1-4065-8b1e-f7b4965d9240-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986597    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e00385cd-25f1-4065-8b1e-f7b4965d9240-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986660    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd62691e-bc2b-431c-abe0-71566552c7b0-ovnkube-config\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.988367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.986806    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef8ff7da-ffea-4290-a8a4-74b20c234e8a-iptables-alerter-script\") pod \"iptables-alerter-h5vjn\" (UID: \"ef8ff7da-ffea-4290-a8a4-74b20c234e8a\") " pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:03.988788 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.988773    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd62691e-bc2b-431c-abe0-71566552c7b0-ovn-node-metrics-cert\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:03.998501 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.998471    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrkh8\" (UniqueName: \"kubernetes.io/projected/ab49ede9-db47-4d76-a5b3-a546c6d9baaf-kube-api-access-mrkh8\") pod \"node-resolver-qlg6j\" (UID: \"ab49ede9-db47-4d76-a5b3-a546c6d9baaf\") " pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:03.998501 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:03.998495    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-255sw\" (UniqueName: \"kubernetes.io/projected/ef8ff7da-ffea-4290-a8a4-74b20c234e8a-kube-api-access-255sw\") pod \"iptables-alerter-h5vjn\" (UID: \"ef8ff7da-ffea-4290-a8a4-74b20c234e8a\") " pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:04.002127 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.002094    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 11:25:04.002127 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.002116    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 11:25:04.002127 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.002130    2563 projected.go:194] Error preparing data for projected volume kube-api-access-s2r2r for pod openshift-network-diagnostics/network-check-target-vbsxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:04.002321 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.002203    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r podName:9bdcc9e5-cf02-4970-ab1e-e6e858e52479 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:04.502182075 +0000 UTC m=+3.141943041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s2r2r" (UniqueName: "kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r") pod "network-check-target-vbsxn" (UID: "9bdcc9e5-cf02-4970-ab1e-e6e858e52479") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:04.002321 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.002234    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzm5c\" (UniqueName: \"kubernetes.io/projected/1a680106-cb94-4758-86e4-e293bc9c27a7-kube-api-access-mzm5c\") pod \"multus-ftcxs\" (UID: \"1a680106-cb94-4758-86e4-e293bc9c27a7\") " pod="openshift-multus/multus-ftcxs"
May 26 11:25:04.002321 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.002266    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krpn8\" (UniqueName: \"kubernetes.io/projected/e00385cd-25f1-4065-8b1e-f7b4965d9240-kube-api-access-krpn8\") pod \"multus-additional-cni-plugins-gxxgq\" (UID: \"e00385cd-25f1-4065-8b1e-f7b4965d9240\") " pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:04.002606 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.002586    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzf9\" (UniqueName: \"kubernetes.io/projected/20546609-e39a-4863-a12b-747a69bc9204-kube-api-access-4kzf9\") pod \"aws-ebs-csi-driver-node-dmqng\" (UID: \"20546609-e39a-4863-a12b-747a69bc9204\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:04.004110 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.004090    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7vtk\" (UniqueName: \"kubernetes.io/projected/bd62691e-bc2b-431c-abe0-71566552c7b0-kube-api-access-v7vtk\") pod \"ovnkube-node-mcr45\" (UID: \"bd62691e-bc2b-431c-abe0-71566552c7b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:04.008063 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.008042    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6h6b\" (UniqueName: \"kubernetes.io/projected/76d1a9f1-5bad-4ab1-93dc-2388810c4796-kube-api-access-w6h6b\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:04.087636 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087568    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/606c2274-61c4-4d6a-85eb-5c9f225860ee-agent-certs\") pod \"konnectivity-agent-wrbzx\" (UID: \"606c2274-61c4-4d6a-85eb-5c9f225860ee\") " pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:04.087636 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087613    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-sysconfig\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087636 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087636    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-run\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087661    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfa31a2-73fa-46cb-841b-bcce051793f2-tmp\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087682    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ebd6dc0d-0732-49fe-ad88-7a6d8550514d-serviceca\") pod \"node-ca-wb6hv\" (UID: \"ebd6dc0d-0732-49fe-ad88-7a6d8550514d\") " pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087706    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-modprobe-d\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087728    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-kubernetes\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087753    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/606c2274-61c4-4d6a-85eb-5c9f225860ee-konnectivity-ca\") pod \"konnectivity-agent-wrbzx\" (UID: \"606c2274-61c4-4d6a-85eb-5c9f225860ee\") " pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087762    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-sysconfig\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087765    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-run\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-kubernetes\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087779    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-lib-modules\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087863    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-modprobe-d\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087877    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbnlf\" (UniqueName: \"kubernetes.io/projected/3cfa31a2-73fa-46cb-841b-bcce051793f2-kube-api-access-pbnlf\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.087919 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087908    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-lib-modules\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087960    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-sys\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.087992    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkz7b\" (UniqueName: \"kubernetes.io/projected/ebd6dc0d-0732-49fe-ad88-7a6d8550514d-kube-api-access-wkz7b\") pod \"node-ca-wb6hv\" (UID: \"ebd6dc0d-0732-49fe-ad88-7a6d8550514d\") " pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088019    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-host\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088037    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-sys\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088043    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebd6dc0d-0732-49fe-ad88-7a6d8550514d-host\") pod \"node-ca-wb6hv\" (UID: \"ebd6dc0d-0732-49fe-ad88-7a6d8550514d\") " pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088081    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebd6dc0d-0732-49fe-ad88-7a6d8550514d-host\") pod \"node-ca-wb6hv\" (UID: \"ebd6dc0d-0732-49fe-ad88-7a6d8550514d\") " pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088101    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-sysctl-conf\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088121    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-host\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088138    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-sysctl-d\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088176    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-tuned\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088189    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ebd6dc0d-0732-49fe-ad88-7a6d8550514d-serviceca\") pod \"node-ca-wb6hv\" (UID: \"ebd6dc0d-0732-49fe-ad88-7a6d8550514d\") " pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088205    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-systemd\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088244    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-var-lib-kubelet\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088251    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-sysctl-conf\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088268    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-systemd\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088304    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/606c2274-61c4-4d6a-85eb-5c9f225860ee-konnectivity-ca\") pod \"konnectivity-agent-wrbzx\" (UID: \"606c2274-61c4-4d6a-85eb-5c9f225860ee\") " pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088316    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-var-lib-kubelet\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.088493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.088373    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-sysctl-d\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.090428 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.090398    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfa31a2-73fa-46cb-841b-bcce051793f2-tmp\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.090557 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.090458    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3cfa31a2-73fa-46cb-841b-bcce051793f2-etc-tuned\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.090633 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.090605    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/606c2274-61c4-4d6a-85eb-5c9f225860ee-agent-certs\") pod \"konnectivity-agent-wrbzx\" (UID: \"606c2274-61c4-4d6a-85eb-5c9f225860ee\") " pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:04.097789 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.097737    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkz7b\" (UniqueName: \"kubernetes.io/projected/ebd6dc0d-0732-49fe-ad88-7a6d8550514d-kube-api-access-wkz7b\") pod \"node-ca-wb6hv\" (UID: \"ebd6dc0d-0732-49fe-ad88-7a6d8550514d\") " pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:04.098476 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.098457    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbnlf\" (UniqueName: \"kubernetes.io/projected/3cfa31a2-73fa-46cb-841b-bcce051793f2-kube-api-access-pbnlf\") pod \"tuned-j8xh4\" (UID: \"3cfa31a2-73fa-46cb-841b-bcce051793f2\") " pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.172372 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.172335    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng"
May 26 11:25:04.179106 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.179078    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qlg6j"
May 26 11:25:04.187850 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.187816    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gxxgq"
May 26 11:25:04.193588 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.193568    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ftcxs"
May 26 11:25:04.200077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.200059    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5vjn"
May 26 11:25:04.207673 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.207652    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:04.215288 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.215272    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:04.221866 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.221848    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j8xh4"
May 26 11:25:04.227388 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.227370    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wb6hv"
May 26 11:25:04.491534 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.491457    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:04.491666 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.491592    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:04.491666 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.491659    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs podName:76d1a9f1-5bad-4ab1-93dc-2388810c4796 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:05.491643708 +0000 UTC m=+4.131404455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs") pod "network-metrics-daemon-2lvct" (UID: "76d1a9f1-5bad-4ab1-93dc-2388810c4796") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:04.592699 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.592675    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:04.592859 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.592833    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 11:25:04.592859 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.592862    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 11:25:04.593028 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.592876    2563 projected.go:194] Error preparing data for projected volume kube-api-access-s2r2r for pod openshift-network-diagnostics/network-check-target-vbsxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:04.593028 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.592955    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r podName:9bdcc9e5-cf02-4970-ab1e-e6e858e52479 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:05.59292002 +0000 UTC m=+4.232680782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2r2r" (UniqueName: "kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r") pod "network-check-target-vbsxn" (UID: "9bdcc9e5-cf02-4970-ab1e-e6e858e52479") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:04.595748 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:04.595676    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfa31a2_73fa_46cb_841b_bcce051793f2.slice/crio-da80ca6fed46c36d0a29cfa30ee5a37c6790bb94aa2a1e3d7fbc4b7411f72f16 WatchSource:0}: Error finding container da80ca6fed46c36d0a29cfa30ee5a37c6790bb94aa2a1e3d7fbc4b7411f72f16: Status 404 returned error can't find the container with id da80ca6fed46c36d0a29cfa30ee5a37c6790bb94aa2a1e3d7fbc4b7411f72f16
May 26 11:25:04.596166 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:04.596134    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd62691e_bc2b_431c_abe0_71566552c7b0.slice/crio-536ef70c3d5ae8fa55c71dd69d50a6edbe52f47fd5d8dca99dfefa1ae0ed6f8c WatchSource:0}: Error finding container 536ef70c3d5ae8fa55c71dd69d50a6edbe52f47fd5d8dca99dfefa1ae0ed6f8c: Status 404 returned error can't find the container with id 536ef70c3d5ae8fa55c71dd69d50a6edbe52f47fd5d8dca99dfefa1ae0ed6f8c
May 26 11:25:04.620162 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:04.620132    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a680106_cb94_4758_86e4_e293bc9c27a7.slice/crio-ef4e7279cd34119886da3a0b9a2aa7c78eaf93835679f1535e4136ef760cecae WatchSource:0}: Error finding container ef4e7279cd34119886da3a0b9a2aa7c78eaf93835679f1535e4136ef760cecae: Status 404 returned error can't find the container with id ef4e7279cd34119886da3a0b9a2aa7c78eaf93835679f1535e4136ef760cecae
May 26 11:25:04.622585 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:04.622560    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20546609_e39a_4863_a12b_747a69bc9204.slice/crio-6d13140352bf6b1edbb6667dfb81882390443dde8a90d99e6f7821c72be1df57 WatchSource:0}: Error finding container 6d13140352bf6b1edbb6667dfb81882390443dde8a90d99e6f7821c72be1df57: Status 404 returned error can't find the container with id 6d13140352bf6b1edbb6667dfb81882390443dde8a90d99e6f7821c72be1df57
May 26 11:25:04.623205 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:04.623089    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606c2274_61c4_4d6a_85eb_5c9f225860ee.slice/crio-65d9c52cdf73205a8c2eea3b68e3d360e3b076a1c7b9fb770aa6d7a6f5f113d7 WatchSource:0}: Error finding container 65d9c52cdf73205a8c2eea3b68e3d360e3b076a1c7b9fb770aa6d7a6f5f113d7: Status 404 returned error can't find the container with id 65d9c52cdf73205a8c2eea3b68e3d360e3b076a1c7b9fb770aa6d7a6f5f113d7
May 26 11:25:04.624029 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:04.623956    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00385cd_25f1_4065_8b1e_f7b4965d9240.slice/crio-cc39999008ad38fa0d990b9066879ac70e3a97341a7bc12192e3bef71e230d0a WatchSource:0}: Error finding container cc39999008ad38fa0d990b9066879ac70e3a97341a7bc12192e3bef71e230d0a: Status 404 returned error can't find the container with id cc39999008ad38fa0d990b9066879ac70e3a97341a7bc12192e3bef71e230d0a
May 26 11:25:04.625310 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:25:04.625292    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd6dc0d_0732_49fe_ad88_7a6d8550514d.slice/crio-edadd694d0ed7a1393e695a58092a3e26056edfd0daaab51162255d6776b9aec WatchSource:0}: Error finding container edadd694d0ed7a1393e695a58092a3e26056edfd0daaab51162255d6776b9aec: Status 404 returned error can't find the container with id edadd694d0ed7a1393e695a58092a3e26056edfd0daaab51162255d6776b9aec
May 26 11:25:04.918546 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.918301    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 11:20:02 +0000 UTC" deadline="2028-01-01 22:35:39.074499893 +0000 UTC"
May 26 11:25:04.919027 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.918550    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14051h10m34.155957674s"
May 26 11:25:04.972774 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.972736    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:04.972972 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.972881    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:04.973096 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.973072    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:04.973238 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:04.973205    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:04.980876 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.980834    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng" event={"ID":"20546609-e39a-4863-a12b-747a69bc9204","Type":"ContainerStarted","Data":"6d13140352bf6b1edbb6667dfb81882390443dde8a90d99e6f7821c72be1df57"}
May 26 11:25:04.982695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.982669    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j8xh4" event={"ID":"3cfa31a2-73fa-46cb-841b-bcce051793f2","Type":"ContainerStarted","Data":"da80ca6fed46c36d0a29cfa30ee5a37c6790bb94aa2a1e3d7fbc4b7411f72f16"}
May 26 11:25:04.986240 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.986204    2563 generic.go:358] "Generic (PLEG): container finished" podID="3e84217bd481dcc6454c9b0feead11e9" containerID="e94e78e4512f15daa179d9ee01072356ee0812b559175dc652d680d136f169f7" exitCode=0
May 26 11:25:04.986369 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.986280    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal" event={"ID":"3e84217bd481dcc6454c9b0feead11e9","Type":"ContainerDied","Data":"e94e78e4512f15daa179d9ee01072356ee0812b559175dc652d680d136f169f7"}
May 26 11:25:04.991334 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.991305    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal" event={"ID":"42f8da2d362f9be132a5038f5b173c5f","Type":"ContainerStarted","Data":"f49f645213c1274df9070eba689d7c82e4256c4a276b6776b57dac63abed4b98"}
May 26 11:25:04.994662 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.994638    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wb6hv" event={"ID":"ebd6dc0d-0732-49fe-ad88-7a6d8550514d","Type":"ContainerStarted","Data":"edadd694d0ed7a1393e695a58092a3e26056edfd0daaab51162255d6776b9aec"}
May 26 11:25:04.997367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.997230    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" event={"ID":"e00385cd-25f1-4065-8b1e-f7b4965d9240","Type":"ContainerStarted","Data":"cc39999008ad38fa0d990b9066879ac70e3a97341a7bc12192e3bef71e230d0a"}
May 26 11:25:04.998858 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:04.998835    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ftcxs" event={"ID":"1a680106-cb94-4758-86e4-e293bc9c27a7","Type":"ContainerStarted","Data":"ef4e7279cd34119886da3a0b9a2aa7c78eaf93835679f1535e4136ef760cecae"}
May 26 11:25:05.003524 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:05.003487    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerStarted","Data":"536ef70c3d5ae8fa55c71dd69d50a6edbe52f47fd5d8dca99dfefa1ae0ed6f8c"}
May 26 11:25:05.009660 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:05.009632    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qlg6j" event={"ID":"ab49ede9-db47-4d76-a5b3-a546c6d9baaf","Type":"ContainerStarted","Data":"9389f8c71b086cc3b1f5caf7f7709c65f5512740f95ebbb807f130b5a8e04396"}
May 26 11:25:05.016790 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:05.016763    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5vjn" event={"ID":"ef8ff7da-ffea-4290-a8a4-74b20c234e8a","Type":"ContainerStarted","Data":"a52c10b7d21a1fa375796b357e003c4aac10bb7d1fd3be350adc53f2fb264ff5"}
May 26 11:25:05.019426 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:05.019399    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wrbzx" event={"ID":"606c2274-61c4-4d6a-85eb-5c9f225860ee","Type":"ContainerStarted","Data":"65d9c52cdf73205a8c2eea3b68e3d360e3b076a1c7b9fb770aa6d7a6f5f113d7"}
May 26 11:25:05.500554 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:05.499868    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:05.500554 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:05.500090    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:05.500554 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:05.500156    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs podName:76d1a9f1-5bad-4ab1-93dc-2388810c4796 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:07.50013756 +0000 UTC m=+6.139898309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs") pod "network-metrics-daemon-2lvct" (UID: "76d1a9f1-5bad-4ab1-93dc-2388810c4796") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:05.601272 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:05.600625    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:05.601272 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:05.600832    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 11:25:05.601272 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:05.600850    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 11:25:05.601272 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:05.600863    2563 projected.go:194] Error preparing data for projected volume kube-api-access-s2r2r for pod openshift-network-diagnostics/network-check-target-vbsxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:05.601272 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:05.600927    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r podName:9bdcc9e5-cf02-4970-ab1e-e6e858e52479 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:07.600908185 +0000 UTC m=+6.240668943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2r2r" (UniqueName: "kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r") pod "network-check-target-vbsxn" (UID: "9bdcc9e5-cf02-4970-ab1e-e6e858e52479") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:05.899550 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:05.899195    2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 11:25:06.040179 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:06.039845    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal" event={"ID":"3e84217bd481dcc6454c9b0feead11e9","Type":"ContainerStarted","Data":"39d7b5500639d8fad27746f29061696eec91e9cf709befec88f92520623785f9"}
May 26 11:25:06.058903 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:06.058830    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-251.ec2.internal" podStartSLOduration=3.058808559 podStartE2EDuration="3.058808559s" podCreationTimestamp="2026-05-26 11:25:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:25:06.058517809 +0000 UTC m=+4.698278575" watchObservedRunningTime="2026-05-26 11:25:06.058808559 +0000 UTC m=+4.698569326"
May 26 11:25:06.059449 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:06.059410    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-251.ec2.internal" podStartSLOduration=3.059395816 podStartE2EDuration="3.059395816s" podCreationTimestamp="2026-05-26 11:25:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:25:05.044214612 +0000 UTC m=+3.683975379" watchObservedRunningTime="2026-05-26 11:25:06.059395816 +0000 UTC m=+4.699156599"
May 26 11:25:06.972276 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:06.972242    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:06.972475 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:06.972383    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:06.972847 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:06.972822    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:06.973004 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:06.972948    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:07.516497 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:07.516459    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:07.516992 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:07.516646    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:07.516992 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:07.516716    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs podName:76d1a9f1-5bad-4ab1-93dc-2388810c4796 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:11.516696503 +0000 UTC m=+10.156457250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs") pod "network-metrics-daemon-2lvct" (UID: "76d1a9f1-5bad-4ab1-93dc-2388810c4796") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:07.618208 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:07.617504    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:07.618208 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:07.617721    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 11:25:07.618208 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:07.617742    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 11:25:07.618208 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:07.617755    2563 projected.go:194] Error preparing data for projected volume kube-api-access-s2r2r for pod openshift-network-diagnostics/network-check-target-vbsxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:07.618208 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:07.617816    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r podName:9bdcc9e5-cf02-4970-ab1e-e6e858e52479 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:11.617796909 +0000 UTC m=+10.257557661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2r2r" (UniqueName: "kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r") pod "network-check-target-vbsxn" (UID: "9bdcc9e5-cf02-4970-ab1e-e6e858e52479") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:08.972130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:08.972021    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:08.972570 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:08.972157    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:08.972570 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:08.972023    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:08.972570 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:08.972296    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:10.972225 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:10.972185    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:10.972683 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:10.972312    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:10.972749 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:10.972185    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:10.972851 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:10.972828    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:11.553442 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:11.553402    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:11.553702 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:11.553616    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:11.553702 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:11.553689    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs podName:76d1a9f1-5bad-4ab1-93dc-2388810c4796 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:19.553670117 +0000 UTC m=+18.193430872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs") pod "network-metrics-daemon-2lvct" (UID: "76d1a9f1-5bad-4ab1-93dc-2388810c4796") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:11.654173 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:11.654075    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:11.654362 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:11.654248    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 11:25:11.654362 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:11.654295    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 11:25:11.654362 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:11.654310    2563 projected.go:194] Error preparing data for projected volume kube-api-access-s2r2r for pod openshift-network-diagnostics/network-check-target-vbsxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:11.654513 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:11.654428    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r podName:9bdcc9e5-cf02-4970-ab1e-e6e858e52479 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:19.654408721 +0000 UTC m=+18.294169475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2r2r" (UniqueName: "kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r") pod "network-check-target-vbsxn" (UID: "9bdcc9e5-cf02-4970-ab1e-e6e858e52479") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:12.972030 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:12.971998    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:12.972415 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:12.971998    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:12.972415 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:12.972126    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:12.972415 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:12.972192    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:14.972161 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:14.972066    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:14.972603 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:14.972089    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:14.972603 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:14.972181    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:14.972603 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:14.972279    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:16.972363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:16.972323    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:16.972765 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:16.972323    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:16.972765 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:16.972466    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:16.972765 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:16.972540    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:18.972073 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:18.972040    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:18.972531 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:18.972034    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:18.972531 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:18.972503    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:18.973959 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:18.973414    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:19.611318 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:19.611276    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:19.611511 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:19.611434    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:19.611579 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:19.611512    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs podName:76d1a9f1-5bad-4ab1-93dc-2388810c4796 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:35.611491014 +0000 UTC m=+34.251251758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs") pod "network-metrics-daemon-2lvct" (UID: "76d1a9f1-5bad-4ab1-93dc-2388810c4796") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:19.712343 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:19.712300    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:19.712510 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:19.712477    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 11:25:19.712510 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:19.712500    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 11:25:19.712510 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:19.712511    2563 projected.go:194] Error preparing data for projected volume kube-api-access-s2r2r for pod openshift-network-diagnostics/network-check-target-vbsxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:19.712657 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:19.712568    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r podName:9bdcc9e5-cf02-4970-ab1e-e6e858e52479 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:35.712552284 +0000 UTC m=+34.352313042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2r2r" (UniqueName: "kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r") pod "network-check-target-vbsxn" (UID: "9bdcc9e5-cf02-4970-ab1e-e6e858e52479") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:20.972193 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:20.972156    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:20.972193 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:20.972177    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:20.972701 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:20.972262    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:20.972701 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:20.972411    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:22.972185 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:22.972014    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:22.972753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:22.972014    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:22.972753 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:22.972253    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:22.972753 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:22.972331    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:23.075811 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.075658    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qlg6j" event={"ID":"ab49ede9-db47-4d76-a5b3-a546c6d9baaf","Type":"ContainerStarted","Data":"fdeb51f3772e35bc3388847f88874e541681936a63bb3fc38de83db26d0ee459"}
May 26 11:25:23.077826 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.077781    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wrbzx" event={"ID":"606c2274-61c4-4d6a-85eb-5c9f225860ee","Type":"ContainerStarted","Data":"b8a6a2c71e17f027b7a8546a974ce5ce4022d3e8de4b2776fe1ce796917b3e8f"}
May 26 11:25:23.079722 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.079674    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng" event={"ID":"20546609-e39a-4863-a12b-747a69bc9204","Type":"ContainerStarted","Data":"35770ee78a679fa2c17aa74294d1feb6c55350c161d1c452dec98c6d5363fc7e"}
May 26 11:25:23.082524 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.082499    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j8xh4" event={"ID":"3cfa31a2-73fa-46cb-841b-bcce051793f2","Type":"ContainerStarted","Data":"458e52ef513139d4944ff165fe8ea75596514bbddcba4889351bda843e169b61"}
May 26 11:25:23.084049 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.084013    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wb6hv" event={"ID":"ebd6dc0d-0732-49fe-ad88-7a6d8550514d","Type":"ContainerStarted","Data":"c4fb0d51d552799086c1c85b87a95917eb11d82e82deb555c3b0aae9105fc0fa"}
May 26 11:25:23.085581 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.085550    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" event={"ID":"e00385cd-25f1-4065-8b1e-f7b4965d9240","Type":"ContainerStarted","Data":"97d5a510301f2c5179815e5e77243837f00dd5b075c243f884bb23c9f1c1d30a"}
May 26 11:25:23.086977 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.086901    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ftcxs" event={"ID":"1a680106-cb94-4758-86e4-e293bc9c27a7","Type":"ContainerStarted","Data":"f26e32b2728ff2b8e8312ba4ce3dae01dc08af529f115927fd9c3fae7ed261ba"}
May 26 11:25:23.088389 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.088372    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:25:23.088683 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.088659    2563 generic.go:358] "Generic (PLEG): container finished" podID="bd62691e-bc2b-431c-abe0-71566552c7b0" containerID="ca5fd97c5092ecec2fd89d7704fbe34227dcc5e3cf8dfe7c14ed492fad02452b" exitCode=1
May 26 11:25:23.088762 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.088686    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerDied","Data":"ca5fd97c5092ecec2fd89d7704fbe34227dcc5e3cf8dfe7c14ed492fad02452b"}
May 26 11:25:23.088762 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.088703    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerStarted","Data":"56411fb886900d9af7e3098e7e37fa1d2029a8bb254b6edd1efa0355736cc515"}
May 26 11:25:23.091311 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.091272    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qlg6j" podStartSLOduration=3.055252171 podStartE2EDuration="21.09126051s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:25:04.628738385 +0000 UTC m=+3.268499142" lastFinishedPulling="2026-05-26 11:25:22.664746726 +0000 UTC m=+21.304507481" observedRunningTime="2026-05-26 11:25:23.090650117 +0000 UTC m=+21.730410881" watchObservedRunningTime="2026-05-26 11:25:23.09126051 +0000 UTC m=+21.731021274"
May 26 11:25:23.126481 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.126439    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wrbzx" podStartSLOduration=11.200428526 podStartE2EDuration="21.12642557s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:25:04.627582185 +0000 UTC m=+3.267342942" lastFinishedPulling="2026-05-26 11:25:14.553579229 +0000 UTC m=+13.193339986" observedRunningTime="2026-05-26 11:25:23.125987214 +0000 UTC m=+21.765747979" watchObservedRunningTime="2026-05-26 11:25:23.12642557 +0000 UTC m=+21.766186336"
May 26 11:25:23.142407 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.142356    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j8xh4" podStartSLOduration=3.094970076 podStartE2EDuration="21.142342235s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:25:04.618854763 +0000 UTC m=+3.258615505" lastFinishedPulling="2026-05-26 11:25:22.666226915 +0000 UTC m=+21.305987664" observedRunningTime="2026-05-26 11:25:23.141517278 +0000 UTC m=+21.781278043" watchObservedRunningTime="2026-05-26 11:25:23.142342235 +0000 UTC m=+21.782102999"
May 26 11:25:23.164768 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.164706    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-ftcxs" podStartSLOduration=3.084713373 podStartE2EDuration="21.164687009s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:25:04.627082745 +0000 UTC m=+3.266843488" lastFinishedPulling="2026-05-26 11:25:22.70705638 +0000 UTC m=+21.346817124" observedRunningTime="2026-05-26 11:25:23.163703416 +0000 UTC m=+21.803464193" watchObservedRunningTime="2026-05-26 11:25:23.164687009 +0000 UTC m=+21.804447774"
May 26 11:25:23.177358 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.177315    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wb6hv" podStartSLOduration=3.141666279 podStartE2EDuration="21.177300555s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:25:04.629118655 +0000 UTC m=+3.268879398" lastFinishedPulling="2026-05-26 11:25:22.664752912 +0000 UTC m=+21.304513674" observedRunningTime="2026-05-26 11:25:23.177048832 +0000 UTC m=+21.816809602" watchObservedRunningTime="2026-05-26 11:25:23.177300555 +0000 UTC m=+21.817061320"
May 26 11:25:23.922817 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.922787    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 11:25:23.933808 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.933709    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T11:25:23.922810734Z","UUID":"ef24ff88-4e94-4857-9aa0-2a87ebb1d429","Handler":null,"Name":"","Endpoint":""}
May 26 11:25:23.935415 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.935394    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 11:25:23.935508 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:23.935424    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 11:25:24.092532 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.092441    2563 generic.go:358] "Generic (PLEG): container finished" podID="e00385cd-25f1-4065-8b1e-f7b4965d9240" containerID="97d5a510301f2c5179815e5e77243837f00dd5b075c243f884bb23c9f1c1d30a" exitCode=0
May 26 11:25:24.093102 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.092518    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" event={"ID":"e00385cd-25f1-4065-8b1e-f7b4965d9240","Type":"ContainerDied","Data":"97d5a510301f2c5179815e5e77243837f00dd5b075c243f884bb23c9f1c1d30a"}
May 26 11:25:24.095522 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.095497    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:25:24.095988 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.095959    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerStarted","Data":"6f832ecc774f3028a8155ae6f0ff7b0011a225124c8fc9536bbf280e370b9860"}
May 26 11:25:24.096103 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.095996    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerStarted","Data":"9a4c9a1555b681a9f27a95ef447fe1af0d97cc5e5f308f81fb71f848df6738c2"}
May 26 11:25:24.096103 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.096010    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerStarted","Data":"d81cc6fcf6d21a40b6aa24e9ab6fcd012e38b75aec8eb300335772742f25871a"}
May 26 11:25:24.096103 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.096022    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerStarted","Data":"8a64fdae8639be37bdcfea2a4a452645de28220bc9a87be3468e3c544f28e8f9"}
May 26 11:25:24.097719 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.097687    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng" event={"ID":"20546609-e39a-4863-a12b-747a69bc9204","Type":"ContainerStarted","Data":"38d982e9bb420a9a966dee6053030b5a9627e2a2ad2d7bddc306527b9b2f9885"}
May 26 11:25:24.315130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.315098    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:24.315861 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.315837    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:24.972398 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.972320    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:24.972398 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:24.972320    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:24.972600 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:24.972488    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:24.972600 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:24.972522    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:25.101381 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:25.101345    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5vjn" event={"ID":"ef8ff7da-ffea-4290-a8a4-74b20c234e8a","Type":"ContainerStarted","Data":"a1375381ecf65ac73838118235cfcd94d7e7abc0edb0d238cda0a8d0b8d2fa18"}
May 26 11:25:25.103429 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:25.103403    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng" event={"ID":"20546609-e39a-4863-a12b-747a69bc9204","Type":"ContainerStarted","Data":"16b0899a40fd8d4c6f240489d7f2b6a52b5df2f3e76aafb2f519433ae8aa553f"}
May 26 11:25:25.103711 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:25.103684    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:25.104100 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:25.104082    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wrbzx"
May 26 11:25:25.134737 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:25.134682    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h5vjn" podStartSLOduration=5.098310263 podStartE2EDuration="23.134667113s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:25:04.62843316 +0000 UTC m=+3.268193909" lastFinishedPulling="2026-05-26 11:25:22.664790002 +0000 UTC m=+21.304550759" observedRunningTime="2026-05-26 11:25:25.119762793 +0000 UTC m=+23.759523560" watchObservedRunningTime="2026-05-26 11:25:25.134667113 +0000 UTC m=+23.774427871"
May 26 11:25:25.160671 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:25.160437    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmqng" podStartSLOduration=3.110508149 podStartE2EDuration="23.160423664s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:25:04.627291225 +0000 UTC m=+3.267051982" lastFinishedPulling="2026-05-26 11:25:24.677206745 +0000 UTC m=+23.316967497" observedRunningTime="2026-05-26 11:25:25.159356298 +0000 UTC m=+23.799117064" watchObservedRunningTime="2026-05-26 11:25:25.160423664 +0000 UTC m=+23.800184473"
May 26 11:25:26.108844 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:26.108811    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:25:26.109324 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:26.109257    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerStarted","Data":"827c2f71ba3de961d1ac28fb5ea1988801c3e949064dd2511aac9d0f0cb57fc7"}
May 26 11:25:26.972294 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:26.972252    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:26.972543 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:26.972256    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:26.972543 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:26.972397    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:26.972543 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:26.972491    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:28.114766 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.114570    2563 generic.go:358] "Generic (PLEG): container finished" podID="e00385cd-25f1-4065-8b1e-f7b4965d9240" containerID="027cfce18c900557be929162be6d920bd49b46558917e444c76cbea45c998150" exitCode=0
May 26 11:25:28.115578 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.114656    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" event={"ID":"e00385cd-25f1-4065-8b1e-f7b4965d9240","Type":"ContainerDied","Data":"027cfce18c900557be929162be6d920bd49b46558917e444c76cbea45c998150"}
May 26 11:25:28.118035 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.118018    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:25:28.118410 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.118383    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerStarted","Data":"8c009f9ef8eba5366a8f763c16d9e77c4ed6feb54c6b237b863100fd36c57e70"}
May 26 11:25:28.118696 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.118679    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:28.118777 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.118706    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:28.118864 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.118849    2563 scope.go:117] "RemoveContainer" containerID="ca5fd97c5092ecec2fd89d7704fbe34227dcc5e3cf8dfe7c14ed492fad02452b"
May 26 11:25:28.137025 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.137000    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:28.972380 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.972347    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:28.972380 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:28.972369    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:28.972577 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:28.972460    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:28.972611 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:28.972569    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:29.122370 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:29.122345    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:25:29.122726 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:29.122651    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" event={"ID":"bd62691e-bc2b-431c-abe0-71566552c7b0","Type":"ContainerStarted","Data":"547ee7ceb5f35830e293a7b95bb6bb6088b47e40b1fc57663a17dee972795f3c"}
May 26 11:25:29.122922 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:29.122906    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:29.138615 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:29.138586    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:25:29.150883 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:29.150837    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45" podStartSLOduration=9.070480493 podStartE2EDuration="27.150822035s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:25:04.618817058 +0000 UTC m=+3.258577801" lastFinishedPulling="2026-05-26 11:25:22.699158595 +0000 UTC m=+21.338919343" observedRunningTime="2026-05-26 11:25:29.150594941 +0000 UTC m=+27.790355720" watchObservedRunningTime="2026-05-26 11:25:29.150822035 +0000 UTC m=+27.790582817"
May 26 11:25:29.857092 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:29.856876    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vbsxn"]
May 26 11:25:29.857266 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:29.857215    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:29.857353 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:29.857330    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:29.858503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:29.858481    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lvct"]
May 26 11:25:29.858593 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:29.858577    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:29.858674 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:29.858655    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:30.126541 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:30.126510    2563 generic.go:358] "Generic (PLEG): container finished" podID="e00385cd-25f1-4065-8b1e-f7b4965d9240" containerID="b8e20116208602c59ec488aecb0203bee2c386921091418ca3d68060dbac617e" exitCode=0
May 26 11:25:30.126926 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:30.126610    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" event={"ID":"e00385cd-25f1-4065-8b1e-f7b4965d9240","Type":"ContainerDied","Data":"b8e20116208602c59ec488aecb0203bee2c386921091418ca3d68060dbac617e"}
May 26 11:25:30.971962 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:30.971915    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:30.972105 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:30.972043    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:31.972708 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:31.972631    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:31.973062 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:31.972721    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:32.143381 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:32.143344    2563 generic.go:358] "Generic (PLEG): container finished" podID="e00385cd-25f1-4065-8b1e-f7b4965d9240" containerID="c1d8735cdace02e9b057557104f817e1b5edcc3ed2da6f7f7378186bdac1d635" exitCode=0
May 26 11:25:32.143507 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:32.143404    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" event={"ID":"e00385cd-25f1-4065-8b1e-f7b4965d9240","Type":"ContainerDied","Data":"c1d8735cdace02e9b057557104f817e1b5edcc3ed2da6f7f7378186bdac1d635"}
May 26 11:25:32.972710 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:32.972675    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:32.973469 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:32.972825    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:33.972560 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:33.972526    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:33.972756 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:33.972657    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:34.971770 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:34.971737    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:34.972057 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:34.971878    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:25:35.627882 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:35.627824    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:35.628379 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:35.628018    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:35.628379 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:35.628123    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs podName:76d1a9f1-5bad-4ab1-93dc-2388810c4796 nodeName:}" failed. No retries permitted until 2026-05-26 11:26:07.628100461 +0000 UTC m=+66.267861209 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs") pod "network-metrics-daemon-2lvct" (UID: "76d1a9f1-5bad-4ab1-93dc-2388810c4796") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 11:25:35.729026 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:35.728988    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:35.729202 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:35.729158    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 11:25:35.729202 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:35.729181    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 11:25:35.729202 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:35.729195    2563 projected.go:194] Error preparing data for projected volume kube-api-access-s2r2r for pod openshift-network-diagnostics/network-check-target-vbsxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:35.729317 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:35.729252    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r podName:9bdcc9e5-cf02-4970-ab1e-e6e858e52479 nodeName:}" failed. No retries permitted until 2026-05-26 11:26:07.729235175 +0000 UTC m=+66.368995918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2r2r" (UniqueName: "kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r") pod "network-check-target-vbsxn" (UID: "9bdcc9e5-cf02-4970-ab1e-e6e858e52479") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 11:25:35.972705 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:35.972621    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:35.972876 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:35.972754    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbsxn" podUID="9bdcc9e5-cf02-4970-ab1e-e6e858e52479"
May 26 11:25:36.630226 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.630143    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-251.ec2.internal" event="NodeReady"
May 26 11:25:36.630642 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.630307    2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 11:25:36.699617 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.699591    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9s2r9"]
May 26 11:25:36.726540 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.726505    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7w8lh"]
May 26 11:25:36.726709 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.726695    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.735023 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.734969    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r9pgx\""
May 26 11:25:36.735230 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.735063    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 11:25:36.735287 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.735275    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 11:25:36.741211 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.741191    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7w8lh"]
May 26 11:25:36.741323 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.741216    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9s2r9"]
May 26 11:25:36.741323 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.741317    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:36.745416 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.745394    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zx2q6\""
May 26 11:25:36.745667 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.745649    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 11:25:36.745836 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.745817    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 11:25:36.746408 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.746389    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 11:25:36.835326 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.835292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-tmp-dir\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.835326 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.835339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4pv4\" (UniqueName: \"kubernetes.io/projected/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-kube-api-access-n4pv4\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:36.835553 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.835387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.835553 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.835454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-config-volume\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.835553 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.835479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8xmg\" (UniqueName: \"kubernetes.io/projected/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-kube-api-access-n8xmg\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.835553 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.835514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:36.936557 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.936478    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8xmg\" (UniqueName: \"kubernetes.io/projected/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-kube-api-access-n8xmg\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.936557 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.936521    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:36.936853 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.936636    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-tmp-dir\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.936853 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.936665    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4pv4\" (UniqueName: \"kubernetes.io/projected/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-kube-api-access-n4pv4\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:36.936853 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.936686    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.936853 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:36.936715    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 11:25:36.936853 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:36.936763    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 11:25:36.936853 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:36.936778    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert podName:87e1e63c-e46a-4f6f-92e6-309b1fc52b8e nodeName:}" failed. No retries permitted until 2026-05-26 11:25:37.436759512 +0000 UTC m=+36.076520262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert") pod "ingress-canary-7w8lh" (UID: "87e1e63c-e46a-4f6f-92e6-309b1fc52b8e") : secret "canary-serving-cert" not found
May 26 11:25:36.936853 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:36.936813    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls podName:d2c43847-0196-4cc1-a21f-c26e7d7e7b27 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:37.436796997 +0000 UTC m=+36.076557741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls") pod "dns-default-9s2r9" (UID: "d2c43847-0196-4cc1-a21f-c26e7d7e7b27") : secret "dns-default-metrics-tls" not found
May 26 11:25:36.937215 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.936925    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-config-volume\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.937215 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.936993    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-tmp-dir\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.937428 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.937405    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-config-volume\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.963773 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.963744    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4pv4\" (UniqueName: \"kubernetes.io/projected/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-kube-api-access-n4pv4\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:36.963945 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.963754    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8xmg\" (UniqueName: \"kubernetes.io/projected/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-kube-api-access-n8xmg\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:36.972557 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.972533    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:25:36.977566 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.977536    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 11:25:36.977699 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:36.977607    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-75s55\""
May 26 11:25:37.442190 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:37.442155    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:37.442378 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:37.442206    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:37.442378 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:37.442324    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 11:25:37.442378 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:37.442327    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 11:25:37.442530 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:37.442385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert podName:87e1e63c-e46a-4f6f-92e6-309b1fc52b8e nodeName:}" failed. No retries permitted until 2026-05-26 11:25:38.44236717 +0000 UTC m=+37.082127918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert") pod "ingress-canary-7w8lh" (UID: "87e1e63c-e46a-4f6f-92e6-309b1fc52b8e") : secret "canary-serving-cert" not found
May 26 11:25:37.442530 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:37.442401    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls podName:d2c43847-0196-4cc1-a21f-c26e7d7e7b27 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:38.442393333 +0000 UTC m=+37.082154075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls") pod "dns-default-9s2r9" (UID: "d2c43847-0196-4cc1-a21f-c26e7d7e7b27") : secret "dns-default-metrics-tls" not found
May 26 11:25:37.972507 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:37.972467    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:25:37.980235 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:37.980213    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 11:25:37.980351 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:37.980261    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 11:25:37.981073 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:37.981059    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l6xzk\""
May 26 11:25:38.450368 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:38.450142    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:38.450538 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:38.450404    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:38.450538 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:38.450288    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 11:25:38.450538 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:38.450495    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 11:25:38.450538 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:38.450506    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls podName:d2c43847-0196-4cc1-a21f-c26e7d7e7b27 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:40.450486323 +0000 UTC m=+39.090247082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls") pod "dns-default-9s2r9" (UID: "d2c43847-0196-4cc1-a21f-c26e7d7e7b27") : secret "dns-default-metrics-tls" not found
May 26 11:25:38.450538 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:38.450529    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert podName:87e1e63c-e46a-4f6f-92e6-309b1fc52b8e nodeName:}" failed. No retries permitted until 2026-05-26 11:25:40.45051914 +0000 UTC m=+39.090279883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert") pod "ingress-canary-7w8lh" (UID: "87e1e63c-e46a-4f6f-92e6-309b1fc52b8e") : secret "canary-serving-cert" not found
May 26 11:25:39.162209 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:39.162176    2563 generic.go:358] "Generic (PLEG): container finished" podID="e00385cd-25f1-4065-8b1e-f7b4965d9240" containerID="dd00a678af2626fadfda23a35d574f1b02a06e15e2ae90f649cf40feb84b3ca4" exitCode=0
May 26 11:25:39.162581 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:39.162235    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" event={"ID":"e00385cd-25f1-4065-8b1e-f7b4965d9240","Type":"ContainerDied","Data":"dd00a678af2626fadfda23a35d574f1b02a06e15e2ae90f649cf40feb84b3ca4"}
May 26 11:25:40.179203 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:40.179165    2563 generic.go:358] "Generic (PLEG): container finished" podID="e00385cd-25f1-4065-8b1e-f7b4965d9240" containerID="90b83c412f8888da042f9fca0abd7dadbd389ac4dda51f9c9fad6f1c89e46e93" exitCode=0
May 26 11:25:40.179583 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:40.179244    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" event={"ID":"e00385cd-25f1-4065-8b1e-f7b4965d9240","Type":"ContainerDied","Data":"90b83c412f8888da042f9fca0abd7dadbd389ac4dda51f9c9fad6f1c89e46e93"}
May 26 11:25:40.464488 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:40.464394    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:40.464488 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:40.464482    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:40.464704 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:40.464523    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 11:25:40.464704 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:40.464584    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert podName:87e1e63c-e46a-4f6f-92e6-309b1fc52b8e nodeName:}" failed. No retries permitted until 2026-05-26 11:25:44.464568622 +0000 UTC m=+43.104329365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert") pod "ingress-canary-7w8lh" (UID: "87e1e63c-e46a-4f6f-92e6-309b1fc52b8e") : secret "canary-serving-cert" not found
May 26 11:25:40.464704 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:40.464591    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 11:25:40.464704 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:40.464639    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls podName:d2c43847-0196-4cc1-a21f-c26e7d7e7b27 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:44.464624695 +0000 UTC m=+43.104385457 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls") pod "dns-default-9s2r9" (UID: "d2c43847-0196-4cc1-a21f-c26e7d7e7b27") : secret "dns-default-metrics-tls" not found
May 26 11:25:41.185250 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:41.185212    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" event={"ID":"e00385cd-25f1-4065-8b1e-f7b4965d9240","Type":"ContainerStarted","Data":"f15fc57b459c05a799cf98872d6a3345fa3c8f16389ac0ac284016bd2970589c"}
May 26 11:25:41.219211 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:41.219154    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gxxgq" podStartSLOduration=5.7419224490000005 podStartE2EDuration="39.219139089s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:25:04.627359238 +0000 UTC m=+3.267119999" lastFinishedPulling="2026-05-26 11:25:38.104575892 +0000 UTC m=+36.744336639" observedRunningTime="2026-05-26 11:25:41.21798005 +0000 UTC m=+39.857740834" watchObservedRunningTime="2026-05-26 11:25:41.219139089 +0000 UTC m=+39.858899854"
May 26 11:25:44.491796 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:44.491743    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:44.492266 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:44.491812    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:44.492266 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:44.491951    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 11:25:44.492266 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:44.491960    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 11:25:44.492266 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:44.492001    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert podName:87e1e63c-e46a-4f6f-92e6-309b1fc52b8e nodeName:}" failed. No retries permitted until 2026-05-26 11:25:52.491987302 +0000 UTC m=+51.131748045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert") pod "ingress-canary-7w8lh" (UID: "87e1e63c-e46a-4f6f-92e6-309b1fc52b8e") : secret "canary-serving-cert" not found
May 26 11:25:44.492266 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:44.492013    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls podName:d2c43847-0196-4cc1-a21f-c26e7d7e7b27 nodeName:}" failed. No retries permitted until 2026-05-26 11:25:52.492007753 +0000 UTC m=+51.131768496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls") pod "dns-default-9s2r9" (UID: "d2c43847-0196-4cc1-a21f-c26e7d7e7b27") : secret "dns-default-metrics-tls" not found
May 26 11:25:52.547902 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:52.547856    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:25:52.548376 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:25:52.547920    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:25:52.548376 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:52.548041    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 11:25:52.548376 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:52.548087    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 11:25:52.548376 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:52.548120    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls podName:d2c43847-0196-4cc1-a21f-c26e7d7e7b27 nodeName:}" failed. No retries permitted until 2026-05-26 11:26:08.548101734 +0000 UTC m=+67.187862488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls") pod "dns-default-9s2r9" (UID: "d2c43847-0196-4cc1-a21f-c26e7d7e7b27") : secret "dns-default-metrics-tls" not found
May 26 11:25:52.548376 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:25:52.548153    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert podName:87e1e63c-e46a-4f6f-92e6-309b1fc52b8e nodeName:}" failed. No retries permitted until 2026-05-26 11:26:08.548139001 +0000 UTC m=+67.187899744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert") pod "ingress-canary-7w8lh" (UID: "87e1e63c-e46a-4f6f-92e6-309b1fc52b8e") : secret "canary-serving-cert" not found
May 26 11:26:01.149249 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:01.149221    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcr45"
May 26 11:26:07.655172 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:07.655125    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:26:07.658049 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:07.658027    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 11:26:07.666297 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:07.666270    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 11:26:07.666427 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:07.666351    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs podName:76d1a9f1-5bad-4ab1-93dc-2388810c4796 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:11.666328177 +0000 UTC m=+130.306088920 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs") pod "network-metrics-daemon-2lvct" (UID: "76d1a9f1-5bad-4ab1-93dc-2388810c4796") : secret "metrics-daemon-secret" not found
May 26 11:26:07.756188 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:07.756140    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:26:07.758818 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:07.758798    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 11:26:07.769245 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:07.769224    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 11:26:07.780625 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:07.780597    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2r2r\" (UniqueName: \"kubernetes.io/projected/9bdcc9e5-cf02-4970-ab1e-e6e858e52479-kube-api-access-s2r2r\") pod \"network-check-target-vbsxn\" (UID: \"9bdcc9e5-cf02-4970-ab1e-e6e858e52479\") " pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:26:07.985226 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:07.985147    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l6xzk\""
May 26 11:26:07.992205 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:07.992176    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:26:08.124298 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:08.124264    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vbsxn"]
May 26 11:26:08.129573 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:26:08.129543    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bdcc9e5_cf02_4970_ab1e_e6e858e52479.slice/crio-ce4b014f7ed1c65984f872a8b86e0727cf53e1e0f8e3ca25b0a93226bedf292d WatchSource:0}: Error finding container ce4b014f7ed1c65984f872a8b86e0727cf53e1e0f8e3ca25b0a93226bedf292d: Status 404 returned error can't find the container with id ce4b014f7ed1c65984f872a8b86e0727cf53e1e0f8e3ca25b0a93226bedf292d
May 26 11:26:08.234717 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:08.234685    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vbsxn" event={"ID":"9bdcc9e5-cf02-4970-ab1e-e6e858e52479","Type":"ContainerStarted","Data":"ce4b014f7ed1c65984f872a8b86e0727cf53e1e0f8e3ca25b0a93226bedf292d"}
May 26 11:26:08.563392 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:08.563333    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:26:08.563597 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:08.563434    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:26:08.563597 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:08.563478    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 11:26:08.563597 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:08.563555    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls podName:d2c43847-0196-4cc1-a21f-c26e7d7e7b27 nodeName:}" failed. No retries permitted until 2026-05-26 11:26:40.563534284 +0000 UTC m=+99.203295039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls") pod "dns-default-9s2r9" (UID: "d2c43847-0196-4cc1-a21f-c26e7d7e7b27") : secret "dns-default-metrics-tls" not found
May 26 11:26:08.563597 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:08.563567    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 11:26:08.563824 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:08.563609    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert podName:87e1e63c-e46a-4f6f-92e6-309b1fc52b8e nodeName:}" failed. No retries permitted until 2026-05-26 11:26:40.563591019 +0000 UTC m=+99.203351767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert") pod "ingress-canary-7w8lh" (UID: "87e1e63c-e46a-4f6f-92e6-309b1fc52b8e") : secret "canary-serving-cert" not found
May 26 11:26:11.242985 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:11.242948    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vbsxn" event={"ID":"9bdcc9e5-cf02-4970-ab1e-e6e858e52479","Type":"ContainerStarted","Data":"1048a03ba20a806e3b594b919ebf54a0c80037062793046f498a55a5766d601a"}
May 26 11:26:11.243353 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:11.243060    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:26:11.262699 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:11.262650    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vbsxn" podStartSLOduration=66.665531586 podStartE2EDuration="1m9.262637944s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:26:08.13157832 +0000 UTC m=+66.771339064" lastFinishedPulling="2026-05-26 11:26:10.728684676 +0000 UTC m=+69.368445422" observedRunningTime="2026-05-26 11:26:11.262416094 +0000 UTC m=+69.902176859" watchObservedRunningTime="2026-05-26 11:26:11.262637944 +0000 UTC m=+69.902398709"
May 26 11:26:40.578759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:40.578716    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:26:40.579337 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:40.578775    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:26:40.579337 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:40.578867    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 11:26:40.579337 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:40.578893    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 11:26:40.579337 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:40.578957    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls podName:d2c43847-0196-4cc1-a21f-c26e7d7e7b27 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:44.578921273 +0000 UTC m=+163.218682016 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls") pod "dns-default-9s2r9" (UID: "d2c43847-0196-4cc1-a21f-c26e7d7e7b27") : secret "dns-default-metrics-tls" not found
May 26 11:26:40.579337 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:26:40.579028    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert podName:87e1e63c-e46a-4f6f-92e6-309b1fc52b8e nodeName:}" failed. No retries permitted until 2026-05-26 11:27:44.579008075 +0000 UTC m=+163.218768821 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert") pod "ingress-canary-7w8lh" (UID: "87e1e63c-e46a-4f6f-92e6-309b1fc52b8e") : secret "canary-serving-cert" not found
May 26 11:26:42.247375 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:26:42.247347    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vbsxn"
May 26 11:27:08.106485 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.106446    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd"]
May 26 11:27:08.110954 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.110908    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd"
May 26 11:27:08.113921 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.113901    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 26 11:27:08.114202 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.114182    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 26 11:27:08.114997 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.114983    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s5xgz\""
May 26 11:27:08.123464 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.123409    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"]
May 26 11:27:08.126558 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.126536    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qtkpp"]
May 26 11:27:08.126727 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.126707    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.129174 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.129149    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"]
May 26 11:27:08.129417 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.129338    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.130189 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.129994    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 26 11:27:08.130189 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.130056    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-twfrt\""
May 26 11:27:08.130189 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.130070    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 26 11:27:08.130189 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.130078    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 26 11:27:08.132421 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.132400    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 26 11:27:08.132642 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.132617    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd"]
May 26 11:27:08.132743 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.132720    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 26 11:27:08.132806 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.132742    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:08.132806 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.132756    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 26 11:27:08.133296 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.133275    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 26 11:27:08.139145 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.138816    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dtrlm\""
May 26 11:27:08.139145 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.139051    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 26 11:27:08.139511 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.139229    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 26 11:27:08.139511 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.139408    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kc97v\""
May 26 11:27:08.140187 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.139839    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 26 11:27:08.140187 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.140006    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 26 11:27:08.148551 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.148533    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 26 11:27:08.151396 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.151373    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"]
May 26 11:27:08.154069 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.153755    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qtkpp"]
May 26 11:27:08.154069 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.153782    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"]
May 26 11:27:08.161988 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.161962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-serving-cert\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.162245 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.162227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-config\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.162394 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.162379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-trusted-ca\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.162604 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.162587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pccqx\" (UniqueName: \"kubernetes.io/projected/814f56f8-4e92-4278-ab25-defce0692562-kube-api-access-pccqx\") pod \"volume-data-source-validator-5cf8c89d64-n2xmd\" (UID: \"814f56f8-4e92-4278-ab25-defce0692562\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd"
May 26 11:27:08.162764 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.162742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpvdx\" (UniqueName: \"kubernetes.io/projected/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-kube-api-access-vpvdx\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:08.162967 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.162915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30102f82-14fe-4be2-8c92-f9a3db30bb60-config\") pod \"service-ca-operator-57b5b68b8-h7fs7\" (UID: \"30102f82-14fe-4be2-8c92-f9a3db30bb60\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.163120 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.163100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm5st\" (UniqueName: \"kubernetes.io/projected/30102f82-14fe-4be2-8c92-f9a3db30bb60-kube-api-access-nm5st\") pod \"service-ca-operator-57b5b68b8-h7fs7\" (UID: \"30102f82-14fe-4be2-8c92-f9a3db30bb60\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.163296 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.163283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:08.163437 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.163424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30102f82-14fe-4be2-8c92-f9a3db30bb60-serving-cert\") pod \"service-ca-operator-57b5b68b8-h7fs7\" (UID: \"30102f82-14fe-4be2-8c92-f9a3db30bb60\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.163586 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.163566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpk4z\" (UniqueName: \"kubernetes.io/projected/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-kube-api-access-bpk4z\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.264192 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264157    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-config\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.264192 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264193    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-trusted-ca\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.264452 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264214    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pccqx\" (UniqueName: \"kubernetes.io/projected/814f56f8-4e92-4278-ab25-defce0692562-kube-api-access-pccqx\") pod \"volume-data-source-validator-5cf8c89d64-n2xmd\" (UID: \"814f56f8-4e92-4278-ab25-defce0692562\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd"
May 26 11:27:08.264452 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264235    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpvdx\" (UniqueName: \"kubernetes.io/projected/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-kube-api-access-vpvdx\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:08.264452 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264258    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30102f82-14fe-4be2-8c92-f9a3db30bb60-config\") pod \"service-ca-operator-57b5b68b8-h7fs7\" (UID: \"30102f82-14fe-4be2-8c92-f9a3db30bb60\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.264452 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264308    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5st\" (UniqueName: \"kubernetes.io/projected/30102f82-14fe-4be2-8c92-f9a3db30bb60-kube-api-access-nm5st\") pod \"service-ca-operator-57b5b68b8-h7fs7\" (UID: \"30102f82-14fe-4be2-8c92-f9a3db30bb60\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.264452 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264383    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:08.264452 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264414    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30102f82-14fe-4be2-8c92-f9a3db30bb60-serving-cert\") pod \"service-ca-operator-57b5b68b8-h7fs7\" (UID: \"30102f82-14fe-4be2-8c92-f9a3db30bb60\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.264749 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264567    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpk4z\" (UniqueName: \"kubernetes.io/projected/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-kube-api-access-bpk4z\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.264749 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:08.264579    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 11:27:08.264749 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264604    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-serving-cert\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.264749 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:08.264646    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls podName:e20888af-51bc-4222-ac80-9f3d7c9fb2d0 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:08.764624337 +0000 UTC m=+127.404385081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls") pod "cluster-samples-operator-697587599-xksrk" (UID: "e20888af-51bc-4222-ac80-9f3d7c9fb2d0") : secret "samples-operator-tls" not found
May 26 11:27:08.264946 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.264824    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30102f82-14fe-4be2-8c92-f9a3db30bb60-config\") pod \"service-ca-operator-57b5b68b8-h7fs7\" (UID: \"30102f82-14fe-4be2-8c92-f9a3db30bb60\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.265076 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.265058    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-config\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.265268 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.265250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-trusted-ca\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.266709 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.266688    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30102f82-14fe-4be2-8c92-f9a3db30bb60-serving-cert\") pod \"service-ca-operator-57b5b68b8-h7fs7\" (UID: \"30102f82-14fe-4be2-8c92-f9a3db30bb60\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.266812 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.266691    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-serving-cert\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.272266 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.272241    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pccqx\" (UniqueName: \"kubernetes.io/projected/814f56f8-4e92-4278-ab25-defce0692562-kube-api-access-pccqx\") pod \"volume-data-source-validator-5cf8c89d64-n2xmd\" (UID: \"814f56f8-4e92-4278-ab25-defce0692562\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd"
May 26 11:27:08.274408 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.274382    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpvdx\" (UniqueName: \"kubernetes.io/projected/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-kube-api-access-vpvdx\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:08.275342 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.275317    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm5st\" (UniqueName: \"kubernetes.io/projected/30102f82-14fe-4be2-8c92-f9a3db30bb60-kube-api-access-nm5st\") pod \"service-ca-operator-57b5b68b8-h7fs7\" (UID: \"30102f82-14fe-4be2-8c92-f9a3db30bb60\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.277182 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.277165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpk4z\" (UniqueName: \"kubernetes.io/projected/f7e161c7-bb2f-4b78-a1a2-88f13bde5950-kube-api-access-bpk4z\") pod \"console-operator-76dff48d59-qtkpp\" (UID: \"f7e161c7-bb2f-4b78-a1a2-88f13bde5950\") " pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.332056 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.332023    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-z974t"]
May 26 11:27:08.336346 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.336330    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.343921 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.343899    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 26 11:27:08.345859 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.345842    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 11:27:08.345980 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.345965    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-htwqk\""
May 26 11:27:08.346116 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.346088    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 11:27:08.353298 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.353284    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 26 11:27:08.365495 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.365431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1db0d595-1523-4b24-92ad-0992fb41348b-tmp\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.365495 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.365472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1db0d595-1523-4b24-92ad-0992fb41348b-serving-cert\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.365625 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.365540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1db0d595-1523-4b24-92ad-0992fb41348b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.365625 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.365565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj5wn\" (UniqueName: \"kubernetes.io/projected/1db0d595-1523-4b24-92ad-0992fb41348b-kube-api-access-jj5wn\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.365625 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.365589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1db0d595-1523-4b24-92ad-0992fb41348b-snapshots\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.365625 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.365623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1db0d595-1523-4b24-92ad-0992fb41348b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.418974 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.418920    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd"
May 26 11:27:08.440658 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.440629    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"
May 26 11:27:08.460958 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.460882    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-z974t"]
May 26 11:27:08.462193 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.462146    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:08.467063 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.466390    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1db0d595-1523-4b24-92ad-0992fb41348b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.467063 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.466461    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jj5wn\" (UniqueName: \"kubernetes.io/projected/1db0d595-1523-4b24-92ad-0992fb41348b-kube-api-access-jj5wn\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.467063 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.466500    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1db0d595-1523-4b24-92ad-0992fb41348b-snapshots\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.467063 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.466607    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1db0d595-1523-4b24-92ad-0992fb41348b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.467063 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.466770    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1db0d595-1523-4b24-92ad-0992fb41348b-tmp\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.467063 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.466951    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1db0d595-1523-4b24-92ad-0992fb41348b-serving-cert\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.469558 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.469483    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1db0d595-1523-4b24-92ad-0992fb41348b-tmp\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.470284 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.470216    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1db0d595-1523-4b24-92ad-0992fb41348b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.470587 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.470531    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1db0d595-1523-4b24-92ad-0992fb41348b-snapshots\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.472921 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.472885    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1db0d595-1523-4b24-92ad-0992fb41348b-serving-cert\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.477235 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.477055    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 26 11:27:08.480746 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.480681    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1db0d595-1523-4b24-92ad-0992fb41348b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.490363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.490312    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj5wn\" (UniqueName: \"kubernetes.io/projected/1db0d595-1523-4b24-92ad-0992fb41348b-kube-api-access-jj5wn\") pod \"insights-operator-78bdfb888c-z974t\" (UID: \"1db0d595-1523-4b24-92ad-0992fb41348b\") " pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.587824 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:08.587795    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814f56f8_4e92_4278_ab25_defce0692562.slice/crio-4c705b0f9397d9af012ba666bf069d00afc298d92b6aebe0bc8c52ba3135b134 WatchSource:0}: Error finding container 4c705b0f9397d9af012ba666bf069d00afc298d92b6aebe0bc8c52ba3135b134: Status 404 returned error can't find the container with id 4c705b0f9397d9af012ba666bf069d00afc298d92b6aebe0bc8c52ba3135b134
May 26 11:27:08.587961 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.587833    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd"]
May 26 11:27:08.612741 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.612708    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7"]
May 26 11:27:08.616013 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:08.615947    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30102f82_14fe_4be2_8c92_f9a3db30bb60.slice/crio-72955033e7f0892442b90cd6f27357236533fa36d62acac4788ea9f273c943a7 WatchSource:0}: Error finding container 72955033e7f0892442b90cd6f27357236533fa36d62acac4788ea9f273c943a7: Status 404 returned error can't find the container with id 72955033e7f0892442b90cd6f27357236533fa36d62acac4788ea9f273c943a7
May 26 11:27:08.621088 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.621065    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qtkpp"]
May 26 11:27:08.623639 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:08.623614    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e161c7_bb2f_4b78_a1a2_88f13bde5950.slice/crio-c572d47763c2b4ab3df7da7d6fcb6e9a77bde243f211daae1dc2aebca95453de WatchSource:0}: Error finding container c572d47763c2b4ab3df7da7d6fcb6e9a77bde243f211daae1dc2aebca95453de: Status 404 returned error can't find the container with id c572d47763c2b4ab3df7da7d6fcb6e9a77bde243f211daae1dc2aebca95453de
May 26 11:27:08.645191 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.645167    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-z974t"
May 26 11:27:08.768409 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.768327    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:08.768602 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:08.768550    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 11:27:08.768670 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:08.768609    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls podName:e20888af-51bc-4222-ac80-9f3d7c9fb2d0 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:09.768595448 +0000 UTC m=+128.408356191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls") pod "cluster-samples-operator-697587599-xksrk" (UID: "e20888af-51bc-4222-ac80-9f3d7c9fb2d0") : secret "samples-operator-tls" not found
May 26 11:27:08.769284 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:08.769241    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-z974t"]
May 26 11:27:08.772836 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:08.772804    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db0d595_1523_4b24_92ad_0992fb41348b.slice/crio-159e3c51dedebf3f69a81714224b601e8a3660a54c3eb2d2e68583181fe1b4cb WatchSource:0}: Error finding container 159e3c51dedebf3f69a81714224b601e8a3660a54c3eb2d2e68583181fe1b4cb: Status 404 returned error can't find the container with id 159e3c51dedebf3f69a81714224b601e8a3660a54c3eb2d2e68583181fe1b4cb
May 26 11:27:09.350891 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:09.350854    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp" event={"ID":"f7e161c7-bb2f-4b78-a1a2-88f13bde5950","Type":"ContainerStarted","Data":"c572d47763c2b4ab3df7da7d6fcb6e9a77bde243f211daae1dc2aebca95453de"}
May 26 11:27:09.352322 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:09.352263    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-z974t" event={"ID":"1db0d595-1523-4b24-92ad-0992fb41348b","Type":"ContainerStarted","Data":"159e3c51dedebf3f69a81714224b601e8a3660a54c3eb2d2e68583181fe1b4cb"}
May 26 11:27:09.353861 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:09.353811    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd" event={"ID":"814f56f8-4e92-4278-ab25-defce0692562","Type":"ContainerStarted","Data":"4c705b0f9397d9af012ba666bf069d00afc298d92b6aebe0bc8c52ba3135b134"}
May 26 11:27:09.355103 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:09.355048    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7" event={"ID":"30102f82-14fe-4be2-8c92-f9a3db30bb60","Type":"ContainerStarted","Data":"72955033e7f0892442b90cd6f27357236533fa36d62acac4788ea9f273c943a7"}
May 26 11:27:09.777534 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:09.777409    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:09.777710 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:09.777590    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 11:27:09.777710 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:09.777656    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls podName:e20888af-51bc-4222-ac80-9f3d7c9fb2d0 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:11.777635958 +0000 UTC m=+130.417396707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls") pod "cluster-samples-operator-697587599-xksrk" (UID: "e20888af-51bc-4222-ac80-9f3d7c9fb2d0") : secret "samples-operator-tls" not found
May 26 11:27:11.693060 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:11.693012    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:27:11.693523 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:11.693136    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 11:27:11.693523 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:11.693219    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs podName:76d1a9f1-5bad-4ab1-93dc-2388810c4796 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:13.693196447 +0000 UTC m=+252.332957242 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs") pod "network-metrics-daemon-2lvct" (UID: "76d1a9f1-5bad-4ab1-93dc-2388810c4796") : secret "metrics-daemon-secret" not found
May 26 11:27:11.794115 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:11.794077    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:11.794274 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:11.794252    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 11:27:11.794346 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:11.794335    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls podName:e20888af-51bc-4222-ac80-9f3d7c9fb2d0 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:15.794312526 +0000 UTC m=+134.434073276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls") pod "cluster-samples-operator-697587599-xksrk" (UID: "e20888af-51bc-4222-ac80-9f3d7c9fb2d0") : secret "samples-operator-tls" not found
May 26 11:27:12.233658 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.233569    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x"]
May 26 11:27:12.236778 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.236762    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x"
May 26 11:27:12.239814 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.239783    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2pvbf\""
May 26 11:27:12.250597 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.250573    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x"]
May 26 11:27:12.297877 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.297831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qsv2\" (UniqueName: \"kubernetes.io/projected/316ea89e-3cf5-4da7-a1ce-f5831bb0bde2-kube-api-access-4qsv2\") pod \"network-check-source-7f44b6dd87-zfr9x\" (UID: \"316ea89e-3cf5-4da7-a1ce-f5831bb0bde2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x"
May 26 11:27:12.363396 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.363357    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7" event={"ID":"30102f82-14fe-4be2-8c92-f9a3db30bb60","Type":"ContainerStarted","Data":"ebe4a7a9d1c1dd6b2f438a40707e7cc424df3fc192abe78dfa945dab7423f91c"}
May 26 11:27:12.364811 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.364791    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/0.log"
May 26 11:27:12.364920 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.364828    2563 generic.go:358] "Generic (PLEG): container finished" podID="f7e161c7-bb2f-4b78-a1a2-88f13bde5950" containerID="2f8686da50543cbdd63e87d96c0120ca3e5aace7ad82ba47832e2755750ec755" exitCode=255
May 26 11:27:12.364920 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.364895    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp" event={"ID":"f7e161c7-bb2f-4b78-a1a2-88f13bde5950","Type":"ContainerDied","Data":"2f8686da50543cbdd63e87d96c0120ca3e5aace7ad82ba47832e2755750ec755"}
May 26 11:27:12.365170 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.365150    2563 scope.go:117] "RemoveContainer" containerID="2f8686da50543cbdd63e87d96c0120ca3e5aace7ad82ba47832e2755750ec755"
May 26 11:27:12.366203 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.366166    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-z974t" event={"ID":"1db0d595-1523-4b24-92ad-0992fb41348b","Type":"ContainerStarted","Data":"931b2e097e24d146f72f0602aeb5346c232aec677a5ce8e5ac013c7cdbef7f82"}
May 26 11:27:12.367570 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.367550    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd" event={"ID":"814f56f8-4e92-4278-ab25-defce0692562","Type":"ContainerStarted","Data":"27aa492a01bce611b776cb083e27cd79cc57cad16681905658ebeb08d79098dc"}
May 26 11:27:12.382409 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.382264    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7" podStartSLOduration=1.174551441 podStartE2EDuration="4.382247794s" podCreationTimestamp="2026-05-26 11:27:08 +0000 UTC" firstStartedPulling="2026-05-26 11:27:08.617709774 +0000 UTC m=+127.257470517" lastFinishedPulling="2026-05-26 11:27:11.825406112 +0000 UTC m=+130.465166870" observedRunningTime="2026-05-26 11:27:12.381578673 +0000 UTC m=+131.021339439" watchObservedRunningTime="2026-05-26 11:27:12.382247794 +0000 UTC m=+131.022008560"
May 26 11:27:12.398722 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.398332    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qsv2\" (UniqueName: \"kubernetes.io/projected/316ea89e-3cf5-4da7-a1ce-f5831bb0bde2-kube-api-access-4qsv2\") pod \"network-check-source-7f44b6dd87-zfr9x\" (UID: \"316ea89e-3cf5-4da7-a1ce-f5831bb0bde2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x"
May 26 11:27:12.410293 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.410259    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qsv2\" (UniqueName: \"kubernetes.io/projected/316ea89e-3cf5-4da7-a1ce-f5831bb0bde2-kube-api-access-4qsv2\") pod \"network-check-source-7f44b6dd87-zfr9x\" (UID: \"316ea89e-3cf5-4da7-a1ce-f5831bb0bde2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x"
May 26 11:27:12.416032 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.415978    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-z974t" podStartSLOduration=1.360644256 podStartE2EDuration="4.415952267s" podCreationTimestamp="2026-05-26 11:27:08 +0000 UTC" firstStartedPulling="2026-05-26 11:27:08.77460873 +0000 UTC m=+127.414369476" lastFinishedPulling="2026-05-26 11:27:11.829916743 +0000 UTC m=+130.469677487" observedRunningTime="2026-05-26 11:27:12.415172417 +0000 UTC m=+131.054933184" watchObservedRunningTime="2026-05-26 11:27:12.415952267 +0000 UTC m=+131.055713033"
May 26 11:27:12.430353 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.430308    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n2xmd" podStartSLOduration=1.198066809 podStartE2EDuration="4.430295312s" podCreationTimestamp="2026-05-26 11:27:08 +0000 UTC" firstStartedPulling="2026-05-26 11:27:08.589604719 +0000 UTC m=+127.229365463" lastFinishedPulling="2026-05-26 11:27:11.82183322 +0000 UTC m=+130.461593966" observedRunningTime="2026-05-26 11:27:12.42945519 +0000 UTC m=+131.069215956" watchObservedRunningTime="2026-05-26 11:27:12.430295312 +0000 UTC m=+131.070056076"
May 26 11:27:12.545700 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.545664    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x"
May 26 11:27:12.680953 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:12.680898    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x"]
May 26 11:27:12.684232 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:12.684197    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316ea89e_3cf5_4da7_a1ce_f5831bb0bde2.slice/crio-e9454551fce70ee4e93cefe8a07c4d0f5d034f71c3f9d154cb8143f7edf10816 WatchSource:0}: Error finding container e9454551fce70ee4e93cefe8a07c4d0f5d034f71c3f9d154cb8143f7edf10816: Status 404 returned error can't find the container with id e9454551fce70ee4e93cefe8a07c4d0f5d034f71c3f9d154cb8143f7edf10816
May 26 11:27:13.373031 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:13.373002    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:27:13.373493 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:13.373471    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/0.log"
May 26 11:27:13.373562 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:13.373522    2563 generic.go:358] "Generic (PLEG): container finished" podID="f7e161c7-bb2f-4b78-a1a2-88f13bde5950" containerID="919c8105aecf5eee40df7b4da0f4792e6fb392f97060620f2cd91bcca33c6d69" exitCode=255
May 26 11:27:13.373615 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:13.373585    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp" event={"ID":"f7e161c7-bb2f-4b78-a1a2-88f13bde5950","Type":"ContainerDied","Data":"919c8105aecf5eee40df7b4da0f4792e6fb392f97060620f2cd91bcca33c6d69"}
May 26 11:27:13.373674 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:13.373637    2563 scope.go:117] "RemoveContainer" containerID="2f8686da50543cbdd63e87d96c0120ca3e5aace7ad82ba47832e2755750ec755"
May 26 11:27:13.374051 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:13.373891    2563 scope.go:117] "RemoveContainer" containerID="919c8105aecf5eee40df7b4da0f4792e6fb392f97060620f2cd91bcca33c6d69"
May 26 11:27:13.374173 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:13.374146    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qtkpp_openshift-console-operator(f7e161c7-bb2f-4b78-a1a2-88f13bde5950)\"" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp" podUID="f7e161c7-bb2f-4b78-a1a2-88f13bde5950"
May 26 11:27:13.375199 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:13.375114    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x" event={"ID":"316ea89e-3cf5-4da7-a1ce-f5831bb0bde2","Type":"ContainerStarted","Data":"a6331d7159f3132935e0a3a4f8204815e22d49d21a333a623e7cb00d59c5c68f"}
May 26 11:27:13.375199 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:13.375143    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x" event={"ID":"316ea89e-3cf5-4da7-a1ce-f5831bb0bde2","Type":"ContainerStarted","Data":"e9454551fce70ee4e93cefe8a07c4d0f5d034f71c3f9d154cb8143f7edf10816"}
May 26 11:27:13.422066 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:13.421997    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zfr9x" podStartSLOduration=1.421978612 podStartE2EDuration="1.421978612s" podCreationTimestamp="2026-05-26 11:27:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:27:13.420724117 +0000 UTC m=+132.060484884" watchObservedRunningTime="2026-05-26 11:27:13.421978612 +0000 UTC m=+132.061739381"
May 26 11:27:14.379459 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:14.379429    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:27:14.379915 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:14.379875    2563 scope.go:117] "RemoveContainer" containerID="919c8105aecf5eee40df7b4da0f4792e6fb392f97060620f2cd91bcca33c6d69"
May 26 11:27:14.380133 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:14.380111    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qtkpp_openshift-console-operator(f7e161c7-bb2f-4b78-a1a2-88f13bde5950)\"" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp" podUID="f7e161c7-bb2f-4b78-a1a2-88f13bde5950"
May 26 11:27:15.626918 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.626891    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qlg6j_ab49ede9-db47-4d76-a5b3-a546c6d9baaf/dns-node-resolver/0.log"
May 26 11:27:15.694108 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.694075    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-v9csd"]
May 26 11:27:15.698486 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.698463    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:15.701293 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.701266    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mmslv\""
May 26 11:27:15.701409 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.701266    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 26 11:27:15.702229 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.702208    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 26 11:27:15.702229 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.702222    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 26 11:27:15.702377 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.702209    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 26 11:27:15.704492 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.704470    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-v9csd"]
May 26 11:27:15.824784 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.824751    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:15.824784 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.824796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwl2j\" (UniqueName: \"kubernetes.io/projected/b52cf6a0-d10b-485c-b5fd-fc175eac03d9-kube-api-access-nwl2j\") pod \"service-ca-67d667c7d-v9csd\" (UID: \"b52cf6a0-d10b-485c-b5fd-fc175eac03d9\") " pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:15.825030 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.824841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b52cf6a0-d10b-485c-b5fd-fc175eac03d9-signing-key\") pod \"service-ca-67d667c7d-v9csd\" (UID: \"b52cf6a0-d10b-485c-b5fd-fc175eac03d9\") " pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:15.825030 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.824865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b52cf6a0-d10b-485c-b5fd-fc175eac03d9-signing-cabundle\") pod \"service-ca-67d667c7d-v9csd\" (UID: \"b52cf6a0-d10b-485c-b5fd-fc175eac03d9\") " pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:15.825030 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:15.824913    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 11:27:15.825030 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:15.825002    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls podName:e20888af-51bc-4222-ac80-9f3d7c9fb2d0 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:23.824984445 +0000 UTC m=+142.464745187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls") pod "cluster-samples-operator-697587599-xksrk" (UID: "e20888af-51bc-4222-ac80-9f3d7c9fb2d0") : secret "samples-operator-tls" not found
May 26 11:27:15.925899 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.925810    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b52cf6a0-d10b-485c-b5fd-fc175eac03d9-signing-key\") pod \"service-ca-67d667c7d-v9csd\" (UID: \"b52cf6a0-d10b-485c-b5fd-fc175eac03d9\") " pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:15.925899 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.925854    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b52cf6a0-d10b-485c-b5fd-fc175eac03d9-signing-cabundle\") pod \"service-ca-67d667c7d-v9csd\" (UID: \"b52cf6a0-d10b-485c-b5fd-fc175eac03d9\") " pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:15.926109 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.925917    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwl2j\" (UniqueName: \"kubernetes.io/projected/b52cf6a0-d10b-485c-b5fd-fc175eac03d9-kube-api-access-nwl2j\") pod \"service-ca-67d667c7d-v9csd\" (UID: \"b52cf6a0-d10b-485c-b5fd-fc175eac03d9\") " pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:15.926550 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.926526    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b52cf6a0-d10b-485c-b5fd-fc175eac03d9-signing-cabundle\") pod \"service-ca-67d667c7d-v9csd\" (UID: \"b52cf6a0-d10b-485c-b5fd-fc175eac03d9\") " pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:15.928259 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.928240    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b52cf6a0-d10b-485c-b5fd-fc175eac03d9-signing-key\") pod \"service-ca-67d667c7d-v9csd\" (UID: \"b52cf6a0-d10b-485c-b5fd-fc175eac03d9\") " pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:15.933959 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:15.933918    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwl2j\" (UniqueName: \"kubernetes.io/projected/b52cf6a0-d10b-485c-b5fd-fc175eac03d9-kube-api-access-nwl2j\") pod \"service-ca-67d667c7d-v9csd\" (UID: \"b52cf6a0-d10b-485c-b5fd-fc175eac03d9\") " pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:16.008105 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:16.008065    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-v9csd"
May 26 11:27:16.138976 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:16.138927    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-v9csd"]
May 26 11:27:16.142869 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:16.142836    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52cf6a0_d10b_485c_b5fd_fc175eac03d9.slice/crio-56073383da3397c30343eeeed2acfc4d0b1a2ef0cef5018c2cea91aff424277d WatchSource:0}: Error finding container 56073383da3397c30343eeeed2acfc4d0b1a2ef0cef5018c2cea91aff424277d: Status 404 returned error can't find the container with id 56073383da3397c30343eeeed2acfc4d0b1a2ef0cef5018c2cea91aff424277d
May 26 11:27:16.387195 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:16.387165    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-v9csd" event={"ID":"b52cf6a0-d10b-485c-b5fd-fc175eac03d9","Type":"ContainerStarted","Data":"f717ae9591f703004e0af6687ff6bb7c3dd9222458d5751f35bcbeeb52a89d38"}
May 26 11:27:16.387195 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:16.387201    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-v9csd" event={"ID":"b52cf6a0-d10b-485c-b5fd-fc175eac03d9","Type":"ContainerStarted","Data":"56073383da3397c30343eeeed2acfc4d0b1a2ef0cef5018c2cea91aff424277d"}
May 26 11:27:16.433960 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:16.433865    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wb6hv_ebd6dc0d-0732-49fe-ad88-7a6d8550514d/node-ca/0.log"
May 26 11:27:18.462755 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:18.462712    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:18.462755 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:18.462763    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:18.463297 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:18.463230    2563 scope.go:117] "RemoveContainer" containerID="919c8105aecf5eee40df7b4da0f4792e6fb392f97060620f2cd91bcca33c6d69"
May 26 11:27:18.463459 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:18.463437    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qtkpp_openshift-console-operator(f7e161c7-bb2f-4b78-a1a2-88f13bde5950)\"" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp" podUID="f7e161c7-bb2f-4b78-a1a2-88f13bde5950"
May 26 11:27:23.892717 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:23.892669    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:23.895181 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:23.895151    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e20888af-51bc-4222-ac80-9f3d7c9fb2d0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-xksrk\" (UID: \"e20888af-51bc-4222-ac80-9f3d7c9fb2d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:24.072779 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:24.072711    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"
May 26 11:27:24.201854 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:24.201801    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-v9csd" podStartSLOduration=9.201783062 podStartE2EDuration="9.201783062s" podCreationTimestamp="2026-05-26 11:27:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:27:16.418763152 +0000 UTC m=+135.058523918" watchObservedRunningTime="2026-05-26 11:27:24.201783062 +0000 UTC m=+142.841543873"
May 26 11:27:24.202030 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:24.201958    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk"]
May 26 11:27:24.408731 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:24.408640    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk" event={"ID":"e20888af-51bc-4222-ac80-9f3d7c9fb2d0","Type":"ContainerStarted","Data":"64331fd36d0083f2346644828f65991d010509b577dea895a11eae8d1949cc5f"}
May 26 11:27:26.414616 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:26.414583    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk" event={"ID":"e20888af-51bc-4222-ac80-9f3d7c9fb2d0","Type":"ContainerStarted","Data":"ea635b0eb3fe7d2362bda357aa5c2ff5f574bba6d669cea6e847dcb9eb76b3e8"}
May 26 11:27:26.414616 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:26.414621    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk" event={"ID":"e20888af-51bc-4222-ac80-9f3d7c9fb2d0","Type":"ContainerStarted","Data":"d969a89fb2e0f33ab6edccd6fc4724b543410e8fc87dd469459738670e92055d"}
May 26 11:27:26.441519 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:26.441463    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-xksrk" podStartSLOduration=16.486203098 podStartE2EDuration="18.441449713s" podCreationTimestamp="2026-05-26 11:27:08 +0000 UTC" firstStartedPulling="2026-05-26 11:27:24.247470933 +0000 UTC m=+142.887231676" lastFinishedPulling="2026-05-26 11:27:26.202717538 +0000 UTC m=+144.842478291" observedRunningTime="2026-05-26 11:27:26.44038083 +0000 UTC m=+145.080141595" watchObservedRunningTime="2026-05-26 11:27:26.441449713 +0000 UTC m=+145.081210477"
May 26 11:27:33.972459 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:33.972424    2563 scope.go:117] "RemoveContainer" containerID="919c8105aecf5eee40df7b4da0f4792e6fb392f97060620f2cd91bcca33c6d69"
May 26 11:27:34.439539 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:34.439509    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:27:34.439708 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:34.439582    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp" event={"ID":"f7e161c7-bb2f-4b78-a1a2-88f13bde5950","Type":"ContainerStarted","Data":"ddbd92c8db2456598850c2bb29257166eb2efc1b63505e4e1b43fbc80a6530bf"}
May 26 11:27:34.439881 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:34.439853    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:34.444447 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:34.444415    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp"
May 26 11:27:34.462301 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:34.462249    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-qtkpp" podStartSLOduration=23.265087831 podStartE2EDuration="26.462210966s" podCreationTimestamp="2026-05-26 11:27:08 +0000 UTC" firstStartedPulling="2026-05-26 11:27:08.62534544 +0000 UTC m=+127.265106183" lastFinishedPulling="2026-05-26 11:27:11.822468576 +0000 UTC m=+130.462229318" observedRunningTime="2026-05-26 11:27:34.462178435 +0000 UTC m=+153.101939199" watchObservedRunningTime="2026-05-26 11:27:34.462210966 +0000 UTC m=+153.101971732"
May 26 11:27:36.763860 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.763824    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hqdt5"]
May 26 11:27:36.767138 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.767110    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.771712 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.771685    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2xxs\""
May 26 11:27:36.771712 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.771686    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 11:27:36.771884 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.771709    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 11:27:36.774124 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.774096    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cb758cdfd-dgns7"]
May 26 11:27:36.777133 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.777116    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.779733 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.779714    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 11:27:36.779844 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.779761    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 11:27:36.779844 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.779764    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rrl2s\""
May 26 11:27:36.779949 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.779873    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 11:27:36.782444 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.782423    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hqdt5"]
May 26 11:27:36.785220 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.785200    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 11:27:36.794234 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.794204    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb758cdfd-dgns7"]
May 26 11:27:36.895183 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-installation-pull-secrets\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.895359 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc88b325-2c21-4157-9d56-88d38a1342f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.895359 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-ca-trust-extracted\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.895359 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-trusted-ca\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.895464 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-registry-tls\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.895464 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-bound-sa-token\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.895464 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66xp8\" (UniqueName: \"kubernetes.io/projected/fc88b325-2c21-4157-9d56-88d38a1342f4-kube-api-access-66xp8\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.895561 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc88b325-2c21-4157-9d56-88d38a1342f4-crio-socket\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.895561 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc88b325-2c21-4157-9d56-88d38a1342f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.895561 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h48qf\" (UniqueName: \"kubernetes.io/projected/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-kube-api-access-h48qf\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.895649 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc88b325-2c21-4157-9d56-88d38a1342f4-data-volume\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.895649 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-registry-certificates\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.895649 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.895612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-image-registry-private-configuration\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.996014 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.995967    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-registry-tls\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.996014 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996013    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-bound-sa-token\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.996263 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996036    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66xp8\" (UniqueName: \"kubernetes.io/projected/fc88b325-2c21-4157-9d56-88d38a1342f4-kube-api-access-66xp8\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.996263 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996070    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc88b325-2c21-4157-9d56-88d38a1342f4-crio-socket\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.996263 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996086    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc88b325-2c21-4157-9d56-88d38a1342f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.996263 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996169    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc88b325-2c21-4157-9d56-88d38a1342f4-crio-socket\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.996263 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996227    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h48qf\" (UniqueName: \"kubernetes.io/projected/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-kube-api-access-h48qf\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.996545 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996278    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc88b325-2c21-4157-9d56-88d38a1342f4-data-volume\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.996545 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996311    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-registry-certificates\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.996545 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996348    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-image-registry-private-configuration\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.996545 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996396    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-installation-pull-secrets\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.996545 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996437    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc88b325-2c21-4157-9d56-88d38a1342f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.996545 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996479    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-ca-trust-extracted\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.996843 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996593    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc88b325-2c21-4157-9d56-88d38a1342f4-data-volume\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.996843 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996708    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-trusted-ca\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.996964 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.996874    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-ca-trust-extracted\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.997056 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.997037    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc88b325-2c21-4157-9d56-88d38a1342f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.997301 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.997276    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-registry-certificates\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.997862 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.997840    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-trusted-ca\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.998825 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.998803    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc88b325-2c21-4157-9d56-88d38a1342f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:36.998926 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.998910    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-installation-pull-secrets\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.999471 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.999455    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-image-registry-private-configuration\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:36.999707 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:36.999687    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-registry-tls\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:37.022351 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.022280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-bound-sa-token\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:37.023544 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.023508    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h48qf\" (UniqueName: \"kubernetes.io/projected/b6be70ab-45d7-4a13-858d-4b8d97bf63ff-kube-api-access-h48qf\") pod \"image-registry-5cb758cdfd-dgns7\" (UID: \"b6be70ab-45d7-4a13-858d-4b8d97bf63ff\") " pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:37.027525 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.027493    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66xp8\" (UniqueName: \"kubernetes.io/projected/fc88b325-2c21-4157-9d56-88d38a1342f4-kube-api-access-66xp8\") pod \"insights-runtime-extractor-hqdt5\" (UID: \"fc88b325-2c21-4157-9d56-88d38a1342f4\") " pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:37.077253 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.077217    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hqdt5"
May 26 11:27:37.087073 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.087048    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:37.218300 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.218264    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hqdt5"]
May 26 11:27:37.222737 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:37.222705    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc88b325_2c21_4157_9d56_88d38a1342f4.slice/crio-5a2f0d14f99646be78869e195d48763c4de1e97111abfbf237496d3aedab496b WatchSource:0}: Error finding container 5a2f0d14f99646be78869e195d48763c4de1e97111abfbf237496d3aedab496b: Status 404 returned error can't find the container with id 5a2f0d14f99646be78869e195d48763c4de1e97111abfbf237496d3aedab496b
May 26 11:27:37.236222 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.236196    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb758cdfd-dgns7"]
May 26 11:27:37.239516 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:37.239489    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6be70ab_45d7_4a13_858d_4b8d97bf63ff.slice/crio-2fdf4de792e5947e595bd6b3c49febb88e0fc5a16f5d308beb89b5402177bbf0 WatchSource:0}: Error finding container 2fdf4de792e5947e595bd6b3c49febb88e0fc5a16f5d308beb89b5402177bbf0: Status 404 returned error can't find the container with id 2fdf4de792e5947e595bd6b3c49febb88e0fc5a16f5d308beb89b5402177bbf0
May 26 11:27:37.453323 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.453289    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7" event={"ID":"b6be70ab-45d7-4a13-858d-4b8d97bf63ff","Type":"ContainerStarted","Data":"e0e0622d6c44654842cee512da8f0bf97120442e1dbd109d16791c11d7902251"}
May 26 11:27:37.453323 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.453330    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7" event={"ID":"b6be70ab-45d7-4a13-858d-4b8d97bf63ff","Type":"ContainerStarted","Data":"2fdf4de792e5947e595bd6b3c49febb88e0fc5a16f5d308beb89b5402177bbf0"}
May 26 11:27:37.453557 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.453401    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:37.454564 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.454541    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hqdt5" event={"ID":"fc88b325-2c21-4157-9d56-88d38a1342f4","Type":"ContainerStarted","Data":"99f95a681dd09246ea7ca7e204511eafacb46626cb5ff676a1712b51b7a30ff1"}
May 26 11:27:37.454689 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.454570    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hqdt5" event={"ID":"fc88b325-2c21-4157-9d56-88d38a1342f4","Type":"ContainerStarted","Data":"5a2f0d14f99646be78869e195d48763c4de1e97111abfbf237496d3aedab496b"}
May 26 11:27:37.474340 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:37.474290    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7" podStartSLOduration=1.474274328 podStartE2EDuration="1.474274328s" podCreationTimestamp="2026-05-26 11:27:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:27:37.473147688 +0000 UTC m=+156.112908453" watchObservedRunningTime="2026-05-26 11:27:37.474274328 +0000 UTC m=+156.114035092"
May 26 11:27:38.459145 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:38.459110    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hqdt5" event={"ID":"fc88b325-2c21-4157-9d56-88d38a1342f4","Type":"ContainerStarted","Data":"5bde74260e9fce3ff0226dd7a2d56565d403d08ff48d78680fa70caaa62b0266"}
May 26 11:27:39.739104 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:39.739010    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9s2r9" podUID="d2c43847-0196-4cc1-a21f-c26e7d7e7b27"
May 26 11:27:39.752176 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:39.752132    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7w8lh" podUID="87e1e63c-e46a-4f6f-92e6-309b1fc52b8e"
May 26 11:27:39.984013 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:39.983962    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2lvct" podUID="76d1a9f1-5bad-4ab1-93dc-2388810c4796"
May 26 11:27:40.465281 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:40.465253    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9s2r9"
May 26 11:27:40.465281 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:40.465256    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hqdt5" event={"ID":"fc88b325-2c21-4157-9d56-88d38a1342f4","Type":"ContainerStarted","Data":"d6857a712b70d5b17bb68d10c424bb887cebc2189bcc61a44791d5fc3ff08aa8"}
May 26 11:27:40.488898 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:40.488845    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hqdt5" podStartSLOduration=2.344361973 podStartE2EDuration="4.488830285s" podCreationTimestamp="2026-05-26 11:27:36 +0000 UTC" firstStartedPulling="2026-05-26 11:27:37.287904815 +0000 UTC m=+155.927665562" lastFinishedPulling="2026-05-26 11:27:39.432373126 +0000 UTC m=+158.072133874" observedRunningTime="2026-05-26 11:27:40.487813962 +0000 UTC m=+159.127574726" watchObservedRunningTime="2026-05-26 11:27:40.488830285 +0000 UTC m=+159.128591050"
May 26 11:27:43.099585 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:43.099552    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"]
May 26 11:27:43.104213 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:43.104191    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"
May 26 11:27:43.107188 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:43.107164    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xs768\""
May 26 11:27:43.107321 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:43.107191    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 26 11:27:43.116906 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:43.116885    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"]
May 26 11:27:43.248619 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:43.248584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f55860c3-c0b7-4642-a32e-ef302af6c1e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-56rg7\" (UID: \"f55860c3-c0b7-4642-a32e-ef302af6c1e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"
May 26 11:27:43.349233 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:43.349192    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f55860c3-c0b7-4642-a32e-ef302af6c1e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-56rg7\" (UID: \"f55860c3-c0b7-4642-a32e-ef302af6c1e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"
May 26 11:27:43.349400 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:43.349350    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 26 11:27:43.349457 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:43.349446    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f55860c3-c0b7-4642-a32e-ef302af6c1e3-tls-certificates podName:f55860c3-c0b7-4642-a32e-ef302af6c1e3 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:43.849428617 +0000 UTC m=+162.489189364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f55860c3-c0b7-4642-a32e-ef302af6c1e3-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-56rg7" (UID: "f55860c3-c0b7-4642-a32e-ef302af6c1e3") : secret "prometheus-operator-admission-webhook-tls" not found
May 26 11:27:43.854717 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:43.854670    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f55860c3-c0b7-4642-a32e-ef302af6c1e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-56rg7\" (UID: \"f55860c3-c0b7-4642-a32e-ef302af6c1e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"
May 26 11:27:43.857173 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:43.857146    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f55860c3-c0b7-4642-a32e-ef302af6c1e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-56rg7\" (UID: \"f55860c3-c0b7-4642-a32e-ef302af6c1e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"
May 26 11:27:44.013452 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.013417    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"
May 26 11:27:44.138332 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.138237    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"]
May 26 11:27:44.141681 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:44.141646    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55860c3_c0b7_4642_a32e_ef302af6c1e3.slice/crio-6fad4a9979b0fc5b75e572ff3d4ea57c0cf4485fd5f68dce498c72db50a4f85f WatchSource:0}: Error finding container 6fad4a9979b0fc5b75e572ff3d4ea57c0cf4485fd5f68dce498c72db50a4f85f: Status 404 returned error can't find the container with id 6fad4a9979b0fc5b75e572ff3d4ea57c0cf4485fd5f68dce498c72db50a4f85f
May 26 11:27:44.469832 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.469753    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-684997958-sstkd"]
May 26 11:27:44.474643 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.474624    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.478620 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.478594    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7" event={"ID":"f55860c3-c0b7-4642-a32e-ef302af6c1e3","Type":"ContainerStarted","Data":"6fad4a9979b0fc5b75e572ff3d4ea57c0cf4485fd5f68dce498c72db50a4f85f"}
May 26 11:27:44.479282 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.479266    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 11:27:44.479362 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.479345    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 11:27:44.480267 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.480243    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 11:27:44.480267 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.480255    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-874ww\""
May 26 11:27:44.480471 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.480286    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 11:27:44.480471 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.480244    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 11:27:44.480471 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.480244    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 11:27:44.480471 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.480243    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 11:27:44.489356 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.488599    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684997958-sstkd"]
May 26 11:27:44.662311 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.662267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-oauth-serving-cert\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.662552 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.662334    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:27:44.662552 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.662382    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:27:44.662552 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.662408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-config\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.662552 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.662435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-serving-cert\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.662552 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.662467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-oauth-config\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.662552 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.662533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-service-ca\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.662776 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.662573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm9vd\" (UniqueName: \"kubernetes.io/projected/de55b9d8-5aaa-48e2-9741-633b188b4e2b-kube-api-access-zm9vd\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.664826 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.664801    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c43847-0196-4cc1-a21f-c26e7d7e7b27-metrics-tls\") pod \"dns-default-9s2r9\" (UID: \"d2c43847-0196-4cc1-a21f-c26e7d7e7b27\") " pod="openshift-dns/dns-default-9s2r9"
May 26 11:27:44.664892 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.664858    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87e1e63c-e46a-4f6f-92e6-309b1fc52b8e-cert\") pod \"ingress-canary-7w8lh\" (UID: \"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e\") " pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:27:44.669899 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.669877    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r9pgx\""
May 26 11:27:44.676549 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.676529    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9s2r9"
May 26 11:27:44.763617 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.763585    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-oauth-serving-cert\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.763824 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.763669    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-config\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.763824 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.763704    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-serving-cert\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.763824 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.763732    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-oauth-config\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.763824 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.763760    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-service-ca\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.763824 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.763784    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zm9vd\" (UniqueName: \"kubernetes.io/projected/de55b9d8-5aaa-48e2-9741-633b188b4e2b-kube-api-access-zm9vd\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.764974 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.764949    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-service-ca\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.765363 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.765339    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-config\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.765453 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.765357    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-oauth-serving-cert\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.767702 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.767655    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-serving-cert\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.767880 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.767859    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-oauth-config\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.798873 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.798842    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm9vd\" (UniqueName: \"kubernetes.io/projected/de55b9d8-5aaa-48e2-9741-633b188b4e2b-kube-api-access-zm9vd\") pod \"console-684997958-sstkd\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") " pod="openshift-console/console-684997958-sstkd"
May 26 11:27:44.847242 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:44.847207    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9s2r9"]
May 26 11:27:44.850561 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:44.850533    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c43847_0196_4cc1_a21f_c26e7d7e7b27.slice/crio-698cec14050f4f0836bc559bdf8f02587a1f4b2768f89e837132d29d66575436 WatchSource:0}: Error finding container 698cec14050f4f0836bc559bdf8f02587a1f4b2768f89e837132d29d66575436: Status 404 returned error can't find the container with id 698cec14050f4f0836bc559bdf8f02587a1f4b2768f89e837132d29d66575436
May 26 11:27:45.084672 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:45.084632    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684997958-sstkd"
May 26 11:27:45.393750 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:45.393718    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684997958-sstkd"]
May 26 11:27:45.396576 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:45.396546    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde55b9d8_5aaa_48e2_9741_633b188b4e2b.slice/crio-04e82d8fc20596872f50e8af422acfb18a386e032b1d4ee8cea4bc338340f454 WatchSource:0}: Error finding container 04e82d8fc20596872f50e8af422acfb18a386e032b1d4ee8cea4bc338340f454: Status 404 returned error can't find the container with id 04e82d8fc20596872f50e8af422acfb18a386e032b1d4ee8cea4bc338340f454
May 26 11:27:45.482009 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:45.481965    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684997958-sstkd" event={"ID":"de55b9d8-5aaa-48e2-9741-633b188b4e2b","Type":"ContainerStarted","Data":"04e82d8fc20596872f50e8af422acfb18a386e032b1d4ee8cea4bc338340f454"}
May 26 11:27:45.482904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:45.482883    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9s2r9" event={"ID":"d2c43847-0196-4cc1-a21f-c26e7d7e7b27","Type":"ContainerStarted","Data":"698cec14050f4f0836bc559bdf8f02587a1f4b2768f89e837132d29d66575436"}
May 26 11:27:46.487717 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:46.487675    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7" event={"ID":"f55860c3-c0b7-4642-a32e-ef302af6c1e3","Type":"ContainerStarted","Data":"bc28ce07f982117e3a0773914b3f55380eeb3c2eb28b2cb685030bd16a3506d9"}
May 26 11:27:46.488242 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:46.487845    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"
May 26 11:27:46.494535 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:46.494506    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7"
May 26 11:27:46.507614 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:46.507552    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-56rg7" podStartSLOduration=2.032496066 podStartE2EDuration="3.507534456s" podCreationTimestamp="2026-05-26 11:27:43 +0000 UTC" firstStartedPulling="2026-05-26 11:27:44.144057753 +0000 UTC m=+162.783818496" lastFinishedPulling="2026-05-26 11:27:45.619096139 +0000 UTC m=+164.258856886" observedRunningTime="2026-05-26 11:27:46.506119846 +0000 UTC m=+165.145880613" watchObservedRunningTime="2026-05-26 11:27:46.507534456 +0000 UTC m=+165.147295223"
May 26 11:27:47.494560 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:47.494518    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9s2r9" event={"ID":"d2c43847-0196-4cc1-a21f-c26e7d7e7b27","Type":"ContainerStarted","Data":"34d3084e78e27f883b50c229032aeee2ba3e89bdb26ee06a4abd4dfc320a7043"}
May 26 11:27:47.494560 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:47.494568    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9s2r9" event={"ID":"d2c43847-0196-4cc1-a21f-c26e7d7e7b27","Type":"ContainerStarted","Data":"0b6872750755badcd27b1f8bc7a8b8e405ca38352a745bde46c558994afec46c"}
May 26 11:27:47.495119 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:47.494791    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9s2r9"
May 26 11:27:47.514453 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:47.514403    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-9s2r9" podStartSLOduration=129.693693063 podStartE2EDuration="2m11.514385449s" podCreationTimestamp="2026-05-26 11:25:36 +0000 UTC" firstStartedPulling="2026-05-26 11:27:44.853030174 +0000 UTC m=+163.492790920" lastFinishedPulling="2026-05-26 11:27:46.673722556 +0000 UTC m=+165.313483306" observedRunningTime="2026-05-26 11:27:47.513229546 +0000 UTC m=+166.152990314" watchObservedRunningTime="2026-05-26 11:27:47.514385449 +0000 UTC m=+166.154146215"
May 26 11:27:49.501766 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:49.501729    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684997958-sstkd" event={"ID":"de55b9d8-5aaa-48e2-9741-633b188b4e2b","Type":"ContainerStarted","Data":"b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02"}
May 26 11:27:49.522862 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:49.522809    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-684997958-sstkd" podStartSLOduration=2.475778376 podStartE2EDuration="5.522793892s" podCreationTimestamp="2026-05-26 11:27:44 +0000 UTC" firstStartedPulling="2026-05-26 11:27:45.398501404 +0000 UTC m=+164.038262148" lastFinishedPulling="2026-05-26 11:27:48.445516918 +0000 UTC m=+167.085277664" observedRunningTime="2026-05-26 11:27:49.521517178 +0000 UTC m=+168.161277966" watchObservedRunningTime="2026-05-26 11:27:49.522793892 +0000 UTC m=+168.162554658"
May 26 11:27:52.972324 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:52.972289    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:27:52.972691 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:52.972289    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:27:52.975168 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:52.975148    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zx2q6\""
May 26 11:27:52.983288 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:52.983264    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7w8lh"
May 26 11:27:53.121638 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.121608    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7w8lh"]
May 26 11:27:53.124645 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:53.124613    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e1e63c_e46a_4f6f_92e6_309b1fc52b8e.slice/crio-0d3824e34c026c52df5db8fa9785b1cb4ed91d40a9dab940b3c27f9d21ae13b7 WatchSource:0}: Error finding container 0d3824e34c026c52df5db8fa9785b1cb4ed91d40a9dab940b3c27f9d21ae13b7: Status 404 returned error can't find the container with id 0d3824e34c026c52df5db8fa9785b1cb4ed91d40a9dab940b3c27f9d21ae13b7
May 26 11:27:53.516821 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.516779    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7w8lh" event={"ID":"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e","Type":"ContainerStarted","Data":"0d3824e34c026c52df5db8fa9785b1cb4ed91d40a9dab940b3c27f9d21ae13b7"}
May 26 11:27:53.658760 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.658727    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-89896694b-hfn69"]
May 26 11:27:53.661006 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.660986    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.668524 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.668500    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 11:27:53.675800 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.675777    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89896694b-hfn69"]
May 26 11:27:53.739734 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.739699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-trusted-ca-bundle\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.739734 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.739740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-service-ca\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.740011 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.739816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-config\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.740011 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.739859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-oauth-serving-cert\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.740011 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.739952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-oauth-config\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.740011 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.739980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pn4r\" (UniqueName: \"kubernetes.io/projected/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-kube-api-access-5pn4r\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.740178 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.740021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-serving-cert\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.840748 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.840712    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-service-ca\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.840979 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.840771    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-config\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.840979 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.840796    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-oauth-serving-cert\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.840979 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.840850    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-oauth-config\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.840979 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.840876    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pn4r\" (UniqueName: \"kubernetes.io/projected/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-kube-api-access-5pn4r\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.840979 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.840909    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-serving-cert\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.840979 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.840971    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-trusted-ca-bundle\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.841607 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.841558    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-service-ca\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.841607 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.841584    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-config\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.841811 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.841607    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-oauth-serving-cert\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.842302 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.842277    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-trusted-ca-bundle\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.843896 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.843875    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-serving-cert\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.844023 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.843909    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-oauth-config\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.854367 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.854333    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pn4r\" (UniqueName: \"kubernetes.io/projected/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-kube-api-access-5pn4r\") pod \"console-89896694b-hfn69\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") " pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:53.970704 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:53.970666    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89896694b-hfn69"
May 26 11:27:54.143555 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:54.143473    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89896694b-hfn69"]
May 26 11:27:54.146752 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:54.146719    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06ba202_fd4a_49cd_ab0f_5cc526990a1a.slice/crio-cf77ab589b2a3fe04d08cf5e82cdf760a1880f6ad4eddb6cade243b928a3effd WatchSource:0}: Error finding container cf77ab589b2a3fe04d08cf5e82cdf760a1880f6ad4eddb6cade243b928a3effd: Status 404 returned error can't find the container with id cf77ab589b2a3fe04d08cf5e82cdf760a1880f6ad4eddb6cade243b928a3effd
May 26 11:27:54.521918 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:54.521829    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89896694b-hfn69" event={"ID":"b06ba202-fd4a-49cd-ab0f-5cc526990a1a","Type":"ContainerStarted","Data":"3e76c412d5aab27cd6dbaf809ca40404a9ae5eb97ac6c35bfac88c0b68a6591b"}
May 26 11:27:54.521918 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:54.521871    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89896694b-hfn69" event={"ID":"b06ba202-fd4a-49cd-ab0f-5cc526990a1a","Type":"ContainerStarted","Data":"cf77ab589b2a3fe04d08cf5e82cdf760a1880f6ad4eddb6cade243b928a3effd"}
May 26 11:27:54.550905 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:54.550848    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-89896694b-hfn69" podStartSLOduration=1.550829947 podStartE2EDuration="1.550829947s" podCreationTimestamp="2026-05-26 11:27:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:27:54.549334045 +0000 UTC m=+173.189094811" watchObservedRunningTime="2026-05-26 11:27:54.550829947 +0000 UTC m=+173.190590712"
May 26 11:27:55.085028 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:55.085000    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684997958-sstkd"
May 26 11:27:55.085028 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:55.085035    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-684997958-sstkd"
May 26 11:27:55.089746 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:55.089720    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-684997958-sstkd"
May 26 11:27:55.525717 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:55.525675    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7w8lh" event={"ID":"87e1e63c-e46a-4f6f-92e6-309b1fc52b8e","Type":"ContainerStarted","Data":"9e8f2b7da7efe70cf9341fd2813415c6acee49b3fe37a7777ff73a6ad702fc71"}
May 26 11:27:55.529684 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:55.529649    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-684997958-sstkd"
May 26 11:27:55.547430 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:55.547380    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7w8lh" podStartSLOduration=137.812201341 podStartE2EDuration="2m19.547360548s" podCreationTimestamp="2026-05-26 11:25:36 +0000 UTC" firstStartedPulling="2026-05-26 11:27:53.12641825 +0000 UTC m=+171.766178993" lastFinishedPulling="2026-05-26 11:27:54.861577445 +0000 UTC m=+173.501338200" observedRunningTime="2026-05-26 11:27:55.54672757 +0000 UTC m=+174.186488335" watchObservedRunningTime="2026-05-26 11:27:55.547360548 +0000 UTC m=+174.187121314"
May 26 11:27:57.501398 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.501368    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9s2r9"
May 26 11:27:57.615350 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.615314    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"]
May 26 11:27:57.622527 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.622502    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.626668 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.626643    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 11:27:57.626925 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.626905    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 26 11:27:57.627126 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.627067    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j4qcx\""
May 26 11:27:57.627428 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.627028    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 26 11:27:57.627820 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.627633    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 26 11:27:57.628947 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.628912    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 11:27:57.629262 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.629248    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 11:27:57.639142 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.639113    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"]
May 26 11:27:57.646297 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.646243    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-297lh"]
May 26 11:27:57.650815 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.650795    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.656577 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.656557    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 11:27:57.657484 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.657099    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 11:27:57.657484 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.657155    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 11:27:57.657484 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.657357    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gxzss\""
May 26 11:27:57.676322 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.676293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.676582 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.676564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.676695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.676681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90814779-67af-4b7d-a50e-56471bd7894e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.676793 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.676779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.676897 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.676886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-sys\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.677018 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.677005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-tls\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.677116 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.677104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-metrics-client-ca\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.677216 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.677204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vw2m\" (UniqueName: \"kubernetes.io/projected/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-kube-api-access-4vw2m\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.677338 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.677326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-root\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.677473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.677443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h2jw\" (UniqueName: \"kubernetes.io/projected/90814779-67af-4b7d-a50e-56471bd7894e-kube-api-access-4h2jw\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.677606 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.677594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/90814779-67af-4b7d-a50e-56471bd7894e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.677702 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.677690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.677791 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.677779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-accelerators-collector-config\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.677899 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.677876    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-textfile\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.678018 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.678006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-wtmp\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.779457 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779368    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4h2jw\" (UniqueName: \"kubernetes.io/projected/90814779-67af-4b7d-a50e-56471bd7894e-kube-api-access-4h2jw\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.779457 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779447    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/90814779-67af-4b7d-a50e-56471bd7894e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.779695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779481    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.779695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779509    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-accelerators-collector-config\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.779695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779537    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-textfile\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.779695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779577    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-wtmp\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.779695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779607    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.779695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779639    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.779695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779673    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90814779-67af-4b7d-a50e-56471bd7894e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779699    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779737    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-sys\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:57.779746    2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779766    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-tls\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779788    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-metrics-client-ca\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:27:57.779822    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-tls podName:90814779-67af-4b7d-a50e-56471bd7894e nodeName:}" failed. No retries permitted until 2026-05-26 11:27:58.279801016 +0000 UTC m=+176.919561774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-vn55j" (UID: "90814779-67af-4b7d-a50e-56471bd7894e") : secret "kube-state-metrics-tls" not found
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779843    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-wtmp\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779858    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vw2m\" (UniqueName: \"kubernetes.io/projected/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-kube-api-access-4vw2m\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779926    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/90814779-67af-4b7d-a50e-56471bd7894e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779928    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-root\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.779957    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-textfile\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780075 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.780037    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-root\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780664 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.780087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-sys\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780664 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.780392    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-accelerators-collector-config\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.780664 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.780655    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.780848 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.780783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90814779-67af-4b7d-a50e-56471bd7894e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.780962 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.780919    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-metrics-client-ca\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.782722 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.782698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.783077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.783056    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.783177 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.783059    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-node-exporter-tls\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.796801 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.796741    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vw2m\" (UniqueName: \"kubernetes.io/projected/962cb5ad-2cac-4cd5-98dc-c40de0fdff00-kube-api-access-4vw2m\") pod \"node-exporter-297lh\" (UID: \"962cb5ad-2cac-4cd5-98dc-c40de0fdff00\") " pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.797077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.797055    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h2jw\" (UniqueName: \"kubernetes.io/projected/90814779-67af-4b7d-a50e-56471bd7894e-kube-api-access-4h2jw\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:57.965446 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:57.965234    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-297lh"
May 26 11:27:57.983430 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:57.983392    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962cb5ad_2cac_4cd5_98dc_c40de0fdff00.slice/crio-176c773be3e2ab29329c078ddb422e717dbe0cfbea009013e72e8aebd380aba6 WatchSource:0}: Error finding container 176c773be3e2ab29329c078ddb422e717dbe0cfbea009013e72e8aebd380aba6: Status 404 returned error can't find the container with id 176c773be3e2ab29329c078ddb422e717dbe0cfbea009013e72e8aebd380aba6
May 26 11:27:58.285141 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.285102    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:58.287487 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.287464    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90814779-67af-4b7d-a50e-56471bd7894e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vn55j\" (UID: \"90814779-67af-4b7d-a50e-56471bd7894e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:58.463630 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.463601    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cb758cdfd-dgns7"
May 26 11:27:58.536690 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.536611    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"
May 26 11:27:58.539161 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.539131    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-297lh" event={"ID":"962cb5ad-2cac-4cd5-98dc-c40de0fdff00","Type":"ContainerStarted","Data":"176c773be3e2ab29329c078ddb422e717dbe0cfbea009013e72e8aebd380aba6"}
May 26 11:27:58.660561 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.660170    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 11:27:58.668023 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.666793    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.672068 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.671891    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 11:27:58.672889 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.672753    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 11:27:58.672889 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.672758    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z8gkm\""
May 26 11:27:58.674309 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.673982    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 11:27:58.674309 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.674133    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 11:27:58.674309 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.674201    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 11:27:58.674309 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.674231    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 11:27:58.674309 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.674236    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 11:27:58.674662 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.674415    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 11:27:58.674662 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.674468    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 11:27:58.685594 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.685562    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 11:27:58.722422 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.722379    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j"]
May 26 11:27:58.726189 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:58.726157    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90814779_67af_4b7d_a50e_56471bd7894e.slice/crio-e86dc7c0156dc2104c753caa04fe996a7a7b0f0608d50cf47751d3e4eb513b8f WatchSource:0}: Error finding container e86dc7c0156dc2104c753caa04fe996a7a7b0f0608d50cf47751d3e4eb513b8f: Status 404 returned error can't find the container with id e86dc7c0156dc2104c753caa04fe996a7a7b0f0608d50cf47751d3e4eb513b8f
May 26 11:27:58.790274 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790245    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-web-config\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790463 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790463 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxnq\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-kube-api-access-jzxnq\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790463 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790463 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790463 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-volume\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790463 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790777 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-out\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790777 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790777 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790777 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790777 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.790777 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.790642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.891950 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.891908    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892140 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.891975    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-volume\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892140 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892005    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892140 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892037    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-out\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892140 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892066    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892140 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892109    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892417 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892155    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892417 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892191    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892417 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892219    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892417 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892293    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-web-config\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892417 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892322    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892417 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892344    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxnq\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-kube-api-access-jzxnq\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.892417 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.892376    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.893086 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.893055    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.893216 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.893196    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.893922 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.893891    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.894976 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.894903    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-out\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.895118 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.895084    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.895990 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.895918    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-volume\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.896262 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.896242    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.896402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.896372    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.896898 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.896854    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.897202 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.897176    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.897375 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.897357    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.897920 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.897900    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-web-config\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.906618 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.906594    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxnq\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-kube-api-access-jzxnq\") pod \"alertmanager-main-0\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:58.979538 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:58.979504    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 11:27:59.184865 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:59.184832    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 11:27:59.187498 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:27:59.187466    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaee2bcf_42c7_4434_a1ed_b8c828e73fae.slice/crio-183fa8d9b99c1dcb4792204f62b133a6c86661e1748d182ededb8d5f4d1aa500 WatchSource:0}: Error finding container 183fa8d9b99c1dcb4792204f62b133a6c86661e1748d182ededb8d5f4d1aa500: Status 404 returned error can't find the container with id 183fa8d9b99c1dcb4792204f62b133a6c86661e1748d182ededb8d5f4d1aa500
May 26 11:27:59.546434 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:59.546396    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j" event={"ID":"90814779-67af-4b7d-a50e-56471bd7894e","Type":"ContainerStarted","Data":"e86dc7c0156dc2104c753caa04fe996a7a7b0f0608d50cf47751d3e4eb513b8f"}
May 26 11:27:59.547661 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:59.547634    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerStarted","Data":"183fa8d9b99c1dcb4792204f62b133a6c86661e1748d182ededb8d5f4d1aa500"}
May 26 11:27:59.549130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:59.549106    2563 generic.go:358] "Generic (PLEG): container finished" podID="962cb5ad-2cac-4cd5-98dc-c40de0fdff00" containerID="ebdf467010b154e76521dc9bf1cab90ebdf686371100e17963d49ac2a0415ac2" exitCode=0
May 26 11:27:59.549210 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:27:59.549145    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-297lh" event={"ID":"962cb5ad-2cac-4cd5-98dc-c40de0fdff00","Type":"ContainerDied","Data":"ebdf467010b154e76521dc9bf1cab90ebdf686371100e17963d49ac2a0415ac2"}
May 26 11:28:00.555088 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:00.555035    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j" event={"ID":"90814779-67af-4b7d-a50e-56471bd7894e","Type":"ContainerStarted","Data":"dc51c2e0bf618c0f70e775424b128ab781fc3c2862dc64652e5d7a0c8259f8ee"}
May 26 11:28:00.556766 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:00.556734    2563 generic.go:358] "Generic (PLEG): container finished" podID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerID="53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd" exitCode=0
May 26 11:28:00.556861 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:00.556823    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerDied","Data":"53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd"}
May 26 11:28:00.564243 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:00.562840    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-297lh" event={"ID":"962cb5ad-2cac-4cd5-98dc-c40de0fdff00","Type":"ContainerStarted","Data":"a94ab08142a6b0628720a90b6eff778391e4f32458694a269e97d0d3da155472"}
May 26 11:28:00.564243 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:00.562869    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-297lh" event={"ID":"962cb5ad-2cac-4cd5-98dc-c40de0fdff00","Type":"ContainerStarted","Data":"ca5374626a5522625f879498103099d617018868ed6a3ecaf8b3e1a2c1ffb37c"}
May 26 11:28:00.621816 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:00.621765    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-297lh" podStartSLOduration=2.523017388 podStartE2EDuration="3.621748614s" podCreationTimestamp="2026-05-26 11:27:57 +0000 UTC" firstStartedPulling="2026-05-26 11:27:57.985314123 +0000 UTC m=+176.625074879" lastFinishedPulling="2026-05-26 11:27:59.084045362 +0000 UTC m=+177.723806105" observedRunningTime="2026-05-26 11:28:00.620473204 +0000 UTC m=+179.260233969" watchObservedRunningTime="2026-05-26 11:28:00.621748614 +0000 UTC m=+179.261509400"
May 26 11:28:01.569465 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:01.569418    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j" event={"ID":"90814779-67af-4b7d-a50e-56471bd7894e","Type":"ContainerStarted","Data":"bde7764cee7d72cc76b806b7b08707fb947b7615e697f19ef5346f3cefe7ecc5"}
May 26 11:28:01.569465 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:01.569468    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j" event={"ID":"90814779-67af-4b7d-a50e-56471bd7894e","Type":"ContainerStarted","Data":"8462b73a627ce56e6468e69a0735dbe2a7bed117332411c5777ad463158f2605"}
May 26 11:28:01.598417 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:01.598357    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vn55j" podStartSLOduration=2.993446264 podStartE2EDuration="4.598340159s" podCreationTimestamp="2026-05-26 11:27:57 +0000 UTC" firstStartedPulling="2026-05-26 11:27:58.728287698 +0000 UTC m=+177.368048445" lastFinishedPulling="2026-05-26 11:28:00.333181593 +0000 UTC m=+178.972942340" observedRunningTime="2026-05-26 11:28:01.596883588 +0000 UTC m=+180.236644352" watchObservedRunningTime="2026-05-26 11:28:01.598340159 +0000 UTC m=+180.238100923"
May 26 11:28:02.574925 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:02.574887    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerStarted","Data":"e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9"}
May 26 11:28:02.575295 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:02.574953    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerStarted","Data":"8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1"}
May 26 11:28:02.575295 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:02.574968    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerStarted","Data":"dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38"}
May 26 11:28:02.575295 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:02.574977    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerStarted","Data":"ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8"}
May 26 11:28:02.575295 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:02.574985    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerStarted","Data":"2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859"}
May 26 11:28:03.465746 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.465649    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-89896694b-hfn69"]
May 26 11:28:03.504244 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.503828    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-849dcfbbfb-bshtg"]
May 26 11:28:03.507485 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.507458    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.520777 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.520745    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849dcfbbfb-bshtg"]
May 26 11:28:03.583675 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.583641    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerStarted","Data":"105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c"}
May 26 11:28:03.610879 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.610824    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.73947929 podStartE2EDuration="5.610809497s" podCreationTimestamp="2026-05-26 11:27:58 +0000 UTC" firstStartedPulling="2026-05-26 11:27:59.189749291 +0000 UTC m=+177.829510037" lastFinishedPulling="2026-05-26 11:28:03.061079497 +0000 UTC m=+181.700840244" observedRunningTime="2026-05-26 11:28:03.610605308 +0000 UTC m=+182.250366108" watchObservedRunningTime="2026-05-26 11:28:03.610809497 +0000 UTC m=+182.250570320"
May 26 11:28:03.639275 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.639243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srf5k\" (UniqueName: \"kubernetes.io/projected/e37e2867-f67f-42e1-8d48-2483f587c482-kube-api-access-srf5k\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.639457 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.639383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-trusted-ca-bundle\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.639569 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.639545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-serving-cert\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.639681 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.639663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-oauth-config\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.639812 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.639797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-console-config\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.639882 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.639840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-service-ca\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.639956 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.639901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-oauth-serving-cert\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.741483 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.741384    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srf5k\" (UniqueName: \"kubernetes.io/projected/e37e2867-f67f-42e1-8d48-2483f587c482-kube-api-access-srf5k\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.741483 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.741461    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-trusted-ca-bundle\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.741483 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.741483    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-serving-cert\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.741759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.741504    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-oauth-config\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.741759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.741526    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-console-config\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.741759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.741548    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-service-ca\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.741759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.741748    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-oauth-serving-cert\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.742297 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.742262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-console-config\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.742445 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.742354    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-service-ca\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.742554 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.742528    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-oauth-serving-cert\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.742634 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.742612    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-trusted-ca-bundle\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.744104 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.744082    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-serving-cert\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.744187 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.744128    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-oauth-config\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.750195 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.750164    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srf5k\" (UniqueName: \"kubernetes.io/projected/e37e2867-f67f-42e1-8d48-2483f587c482-kube-api-access-srf5k\") pod \"console-849dcfbbfb-bshtg\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") " pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.822116 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.822073    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:03.971582 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.971542    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-89896694b-hfn69"
May 26 11:28:03.977092 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:28:03.977064    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37e2867_f67f_42e1_8d48_2483f587c482.slice/crio-45504cda2f699cfbc161df2d7168e1667af3439ab96d2b78b9182b0d143a03f9 WatchSource:0}: Error finding container 45504cda2f699cfbc161df2d7168e1667af3439ab96d2b78b9182b0d143a03f9: Status 404 returned error can't find the container with id 45504cda2f699cfbc161df2d7168e1667af3439ab96d2b78b9182b0d143a03f9
May 26 11:28:03.977872 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:03.977848    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849dcfbbfb-bshtg"]
May 26 11:28:04.589110 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:04.589071    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849dcfbbfb-bshtg" event={"ID":"e37e2867-f67f-42e1-8d48-2483f587c482","Type":"ContainerStarted","Data":"487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7"}
May 26 11:28:04.589110 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:04.589111    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849dcfbbfb-bshtg" event={"ID":"e37e2867-f67f-42e1-8d48-2483f587c482","Type":"ContainerStarted","Data":"45504cda2f699cfbc161df2d7168e1667af3439ab96d2b78b9182b0d143a03f9"}
May 26 11:28:04.611569 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:04.611490    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-849dcfbbfb-bshtg" podStartSLOduration=1.611472875 podStartE2EDuration="1.611472875s" podCreationTimestamp="2026-05-26 11:28:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:28:04.610427223 +0000 UTC m=+183.250187999" watchObservedRunningTime="2026-05-26 11:28:04.611472875 +0000 UTC m=+183.251233640"
May 26 11:28:10.102526 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.102495    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-849dcfbbfb-bshtg"]
May 26 11:28:10.154648 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.154612    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b74bf48fd-sct8b"]
May 26 11:28:10.157880 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.157861    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.170095 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.170071    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b74bf48fd-sct8b"]
May 26 11:28:10.300610 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.300563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-oauth-serving-cert\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.300610 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.300614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-trusted-ca-bundle\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.300834 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.300752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-config\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.300834 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.300791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpfzs\" (UniqueName: \"kubernetes.io/projected/448ee4f6-ac38-4463-b38f-aacdd2995fa9-kube-api-access-dpfzs\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.300834 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.300812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-service-ca\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.300996 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.300838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-serving-cert\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.300996 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.300857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-oauth-config\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.401691 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.401601    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpfzs\" (UniqueName: \"kubernetes.io/projected/448ee4f6-ac38-4463-b38f-aacdd2995fa9-kube-api-access-dpfzs\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.401691 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.401640    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-service-ca\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.401691 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.401665    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-serving-cert\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.401691 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.401691    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-oauth-config\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.402033 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.401723    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-oauth-serving-cert\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.402033 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.401753    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-trusted-ca-bundle\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.402033 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.401865    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-config\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.402556 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.402530    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-service-ca\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.402680 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.402583    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-oauth-serving-cert\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.402745 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.402614    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-config\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.403012 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.402992    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-trusted-ca-bundle\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.404374 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.404344    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-serving-cert\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.404484 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.404344    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-oauth-config\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.411608 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.411587    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpfzs\" (UniqueName: \"kubernetes.io/projected/448ee4f6-ac38-4463-b38f-aacdd2995fa9-kube-api-access-dpfzs\") pod \"console-6b74bf48fd-sct8b\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") " pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.466689 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.466653    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:10.603593 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:10.603567    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b74bf48fd-sct8b"]
May 26 11:28:10.606032 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:28:10.605997    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448ee4f6_ac38_4463_b38f_aacdd2995fa9.slice/crio-5eb38358e1cd4616c2e5450129814f673b382891d71af5548e569ea035f57846 WatchSource:0}: Error finding container 5eb38358e1cd4616c2e5450129814f673b382891d71af5548e569ea035f57846: Status 404 returned error can't find the container with id 5eb38358e1cd4616c2e5450129814f673b382891d71af5548e569ea035f57846
May 26 11:28:11.610035 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:11.609987    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b74bf48fd-sct8b" event={"ID":"448ee4f6-ac38-4463-b38f-aacdd2995fa9","Type":"ContainerStarted","Data":"8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe"}
May 26 11:28:11.610492 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:11.610043    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b74bf48fd-sct8b" event={"ID":"448ee4f6-ac38-4463-b38f-aacdd2995fa9","Type":"ContainerStarted","Data":"5eb38358e1cd4616c2e5450129814f673b382891d71af5548e569ea035f57846"}
May 26 11:28:11.632528 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:11.632453    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b74bf48fd-sct8b" podStartSLOduration=1.632437307 podStartE2EDuration="1.632437307s" podCreationTimestamp="2026-05-26 11:28:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:28:11.631908006 +0000 UTC m=+190.271668770" watchObservedRunningTime="2026-05-26 11:28:11.632437307 +0000 UTC m=+190.272198073"
May 26 11:28:13.822948 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:13.822890    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:20.467025 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:20.466976    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:20.467466 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:20.467036    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:20.472047 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:20.472008    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:20.640407 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:20.640381    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:28:20.686508 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:20.686473    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684997958-sstkd"]
May 26 11:28:23.646878 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:23.646839    2563 generic.go:358] "Generic (PLEG): container finished" podID="1db0d595-1523-4b24-92ad-0992fb41348b" containerID="931b2e097e24d146f72f0602aeb5346c232aec677a5ce8e5ac013c7cdbef7f82" exitCode=0
May 26 11:28:23.647274 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:23.646890    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-z974t" event={"ID":"1db0d595-1523-4b24-92ad-0992fb41348b","Type":"ContainerDied","Data":"931b2e097e24d146f72f0602aeb5346c232aec677a5ce8e5ac013c7cdbef7f82"}
May 26 11:28:23.647274 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:23.647226    2563 scope.go:117] "RemoveContainer" containerID="931b2e097e24d146f72f0602aeb5346c232aec677a5ce8e5ac013c7cdbef7f82"
May 26 11:28:24.419297 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:24.419268    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7w8lh_87e1e63c-e46a-4f6f-92e6-309b1fc52b8e/serve-healthcheck-canary/0.log"
May 26 11:28:24.651041 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:24.651007    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-z974t" event={"ID":"1db0d595-1523-4b24-92ad-0992fb41348b","Type":"ContainerStarted","Data":"7f8f0bddbd3d0f247c9f5e69ce4f026a63967c74402759acd9ef7f7cc9de20aa"}
May 26 11:28:28.485659 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.485597    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-89896694b-hfn69" podUID="b06ba202-fd4a-49cd-ab0f-5cc526990a1a" containerName="console" containerID="cri-o://3e76c412d5aab27cd6dbaf809ca40404a9ae5eb97ac6c35bfac88c0b68a6591b" gracePeriod=15
May 26 11:28:28.664098 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.664072    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-89896694b-hfn69_b06ba202-fd4a-49cd-ab0f-5cc526990a1a/console/0.log"
May 26 11:28:28.664254 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.664113    2563 generic.go:358] "Generic (PLEG): container finished" podID="b06ba202-fd4a-49cd-ab0f-5cc526990a1a" containerID="3e76c412d5aab27cd6dbaf809ca40404a9ae5eb97ac6c35bfac88c0b68a6591b" exitCode=2
May 26 11:28:28.664254 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.664196    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89896694b-hfn69" event={"ID":"b06ba202-fd4a-49cd-ab0f-5cc526990a1a","Type":"ContainerDied","Data":"3e76c412d5aab27cd6dbaf809ca40404a9ae5eb97ac6c35bfac88c0b68a6591b"}
May 26 11:28:28.666277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.666250    2563 generic.go:358] "Generic (PLEG): container finished" podID="30102f82-14fe-4be2-8c92-f9a3db30bb60" containerID="ebe4a7a9d1c1dd6b2f438a40707e7cc424df3fc192abe78dfa945dab7423f91c" exitCode=0
May 26 11:28:28.666435 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.666314    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7" event={"ID":"30102f82-14fe-4be2-8c92-f9a3db30bb60","Type":"ContainerDied","Data":"ebe4a7a9d1c1dd6b2f438a40707e7cc424df3fc192abe78dfa945dab7423f91c"}
May 26 11:28:28.666691 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.666672    2563 scope.go:117] "RemoveContainer" containerID="ebe4a7a9d1c1dd6b2f438a40707e7cc424df3fc192abe78dfa945dab7423f91c"
May 26 11:28:28.740054 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.740034    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-89896694b-hfn69_b06ba202-fd4a-49cd-ab0f-5cc526990a1a/console/0.log"
May 26 11:28:28.740151 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.740104    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89896694b-hfn69"
May 26 11:28:28.867257 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867222    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-oauth-serving-cert\") pod \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") "
May 26 11:28:28.867257 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867274    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-config\") pod \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") "
May 26 11:28:28.867514 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867296    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-oauth-config\") pod \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") "
May 26 11:28:28.867514 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867350    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-service-ca\") pod \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") "
May 26 11:28:28.867514 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867386    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pn4r\" (UniqueName: \"kubernetes.io/projected/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-kube-api-access-5pn4r\") pod \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") "
May 26 11:28:28.867514 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867430    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-trusted-ca-bundle\") pod \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") "
May 26 11:28:28.867514 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867478    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-serving-cert\") pod \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\" (UID: \"b06ba202-fd4a-49cd-ab0f-5cc526990a1a\") "
May 26 11:28:28.867759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867667    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b06ba202-fd4a-49cd-ab0f-5cc526990a1a" (UID: "b06ba202-fd4a-49cd-ab0f-5cc526990a1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:28.867759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867732    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "b06ba202-fd4a-49cd-ab0f-5cc526990a1a" (UID: "b06ba202-fd4a-49cd-ab0f-5cc526990a1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:28.867928 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867876    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-service-ca\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:28.867928 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867899    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-oauth-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:28.867928 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867875    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b06ba202-fd4a-49cd-ab0f-5cc526990a1a" (UID: "b06ba202-fd4a-49cd-ab0f-5cc526990a1a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:28.868161 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.867984    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-config" (OuterVolumeSpecName: "console-config") pod "b06ba202-fd4a-49cd-ab0f-5cc526990a1a" (UID: "b06ba202-fd4a-49cd-ab0f-5cc526990a1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:28.870184 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.870158    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-kube-api-access-5pn4r" (OuterVolumeSpecName: "kube-api-access-5pn4r") pod "b06ba202-fd4a-49cd-ab0f-5cc526990a1a" (UID: "b06ba202-fd4a-49cd-ab0f-5cc526990a1a"). InnerVolumeSpecName "kube-api-access-5pn4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 11:28:28.870282 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.870258    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b06ba202-fd4a-49cd-ab0f-5cc526990a1a" (UID: "b06ba202-fd4a-49cd-ab0f-5cc526990a1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:28:28.870341 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.870276    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b06ba202-fd4a-49cd-ab0f-5cc526990a1a" (UID: "b06ba202-fd4a-49cd-ab0f-5cc526990a1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:28:28.968761 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.968730    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:28.968761 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.968760    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:28.968761 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.968769    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-console-oauth-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:28.969013 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.968780    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pn4r\" (UniqueName: \"kubernetes.io/projected/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-kube-api-access-5pn4r\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:28.969013 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:28.968790    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06ba202-fd4a-49cd-ab0f-5cc526990a1a-trusted-ca-bundle\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:29.671009 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:29.670982    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-89896694b-hfn69_b06ba202-fd4a-49cd-ab0f-5cc526990a1a/console/0.log"
May 26 11:28:29.671451 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:29.671091    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89896694b-hfn69" event={"ID":"b06ba202-fd4a-49cd-ab0f-5cc526990a1a","Type":"ContainerDied","Data":"cf77ab589b2a3fe04d08cf5e82cdf760a1880f6ad4eddb6cade243b928a3effd"}
May 26 11:28:29.671451 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:29.671101    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89896694b-hfn69"
May 26 11:28:29.671451 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:29.671133    2563 scope.go:117] "RemoveContainer" containerID="3e76c412d5aab27cd6dbaf809ca40404a9ae5eb97ac6c35bfac88c0b68a6591b"
May 26 11:28:29.672881 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:29.672850    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-h7fs7" event={"ID":"30102f82-14fe-4be2-8c92-f9a3db30bb60","Type":"ContainerStarted","Data":"81f69bf47540c262a55a854e0407932e85d131893d124b3907dc3e1a18ae9290"}
May 26 11:28:29.707654 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:29.707621    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-89896694b-hfn69"]
May 26 11:28:29.713840 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:29.713810    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-89896694b-hfn69"]
May 26 11:28:29.976669 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:29.976571    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b06ba202-fd4a-49cd-ab0f-5cc526990a1a" path="/var/lib/kubelet/pods/b06ba202-fd4a-49cd-ab0f-5cc526990a1a/volumes"
May 26 11:28:35.121628 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.121561    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-849dcfbbfb-bshtg" podUID="e37e2867-f67f-42e1-8d48-2483f587c482" containerName="console" containerID="cri-o://487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7" gracePeriod=15
May 26 11:28:35.375570 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.375488    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-849dcfbbfb-bshtg_e37e2867-f67f-42e1-8d48-2483f587c482/console/0.log"
May 26 11:28:35.375570 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.375547    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:35.427832 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.427799    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srf5k\" (UniqueName: \"kubernetes.io/projected/e37e2867-f67f-42e1-8d48-2483f587c482-kube-api-access-srf5k\") pod \"e37e2867-f67f-42e1-8d48-2483f587c482\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") "
May 26 11:28:35.428050 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.427847    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-trusted-ca-bundle\") pod \"e37e2867-f67f-42e1-8d48-2483f587c482\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") "
May 26 11:28:35.428050 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.427886    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-oauth-serving-cert\") pod \"e37e2867-f67f-42e1-8d48-2483f587c482\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") "
May 26 11:28:35.428050 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.427923    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-serving-cert\") pod \"e37e2867-f67f-42e1-8d48-2483f587c482\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") "
May 26 11:28:35.428050 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.427996    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-oauth-config\") pod \"e37e2867-f67f-42e1-8d48-2483f587c482\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") "
May 26 11:28:35.428050 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.428019    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-console-config\") pod \"e37e2867-f67f-42e1-8d48-2483f587c482\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") "
May 26 11:28:35.428308 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.428093    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-service-ca\") pod \"e37e2867-f67f-42e1-8d48-2483f587c482\" (UID: \"e37e2867-f67f-42e1-8d48-2483f587c482\") "
May 26 11:28:35.428389 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.428362    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e37e2867-f67f-42e1-8d48-2483f587c482" (UID: "e37e2867-f67f-42e1-8d48-2483f587c482"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:35.428667 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.428643    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-console-config" (OuterVolumeSpecName: "console-config") pod "e37e2867-f67f-42e1-8d48-2483f587c482" (UID: "e37e2867-f67f-42e1-8d48-2483f587c482"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:35.428781 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.428724    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-service-ca" (OuterVolumeSpecName: "service-ca") pod "e37e2867-f67f-42e1-8d48-2483f587c482" (UID: "e37e2867-f67f-42e1-8d48-2483f587c482"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:35.428924 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.428895    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e37e2867-f67f-42e1-8d48-2483f587c482" (UID: "e37e2867-f67f-42e1-8d48-2483f587c482"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:35.430661 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.430627    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e37e2867-f67f-42e1-8d48-2483f587c482" (UID: "e37e2867-f67f-42e1-8d48-2483f587c482"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:28:35.430764 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.430671    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37e2867-f67f-42e1-8d48-2483f587c482-kube-api-access-srf5k" (OuterVolumeSpecName: "kube-api-access-srf5k") pod "e37e2867-f67f-42e1-8d48-2483f587c482" (UID: "e37e2867-f67f-42e1-8d48-2483f587c482"). InnerVolumeSpecName "kube-api-access-srf5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 11:28:35.430764 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.430672    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e37e2867-f67f-42e1-8d48-2483f587c482" (UID: "e37e2867-f67f-42e1-8d48-2483f587c482"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:28:35.529016 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.528981    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-oauth-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:35.529016 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.529017    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-console-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:35.529016 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.529032    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-service-ca\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:35.529309 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.529047    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srf5k\" (UniqueName: \"kubernetes.io/projected/e37e2867-f67f-42e1-8d48-2483f587c482-kube-api-access-srf5k\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:35.529309 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.529062    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-trusted-ca-bundle\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:35.529309 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.529075    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e37e2867-f67f-42e1-8d48-2483f587c482-oauth-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:35.529309 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.529089    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e37e2867-f67f-42e1-8d48-2483f587c482-console-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:35.692151 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.692077    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-849dcfbbfb-bshtg_e37e2867-f67f-42e1-8d48-2483f587c482/console/0.log"
May 26 11:28:35.692151 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.692114    2563 generic.go:358] "Generic (PLEG): container finished" podID="e37e2867-f67f-42e1-8d48-2483f587c482" containerID="487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7" exitCode=2
May 26 11:28:35.692348 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.692177    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849dcfbbfb-bshtg" event={"ID":"e37e2867-f67f-42e1-8d48-2483f587c482","Type":"ContainerDied","Data":"487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7"}
May 26 11:28:35.692348 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.692180    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849dcfbbfb-bshtg"
May 26 11:28:35.692348 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.692203    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849dcfbbfb-bshtg" event={"ID":"e37e2867-f67f-42e1-8d48-2483f587c482","Type":"ContainerDied","Data":"45504cda2f699cfbc161df2d7168e1667af3439ab96d2b78b9182b0d143a03f9"}
May 26 11:28:35.692348 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.692217    2563 scope.go:117] "RemoveContainer" containerID="487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7"
May 26 11:28:35.701680 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.701660    2563 scope.go:117] "RemoveContainer" containerID="487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7"
May 26 11:28:35.701987 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:28:35.701959    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7\": container with ID starting with 487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7 not found: ID does not exist" containerID="487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7"
May 26 11:28:35.702067 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.702001    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7"} err="failed to get container status \"487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7\": rpc error: code = NotFound desc = could not find container \"487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7\": container with ID starting with 487ccbdf3bfbff8a10918eea9fd99b7e3727fefe61f28fe36000dea85f447ce7 not found: ID does not exist"
May 26 11:28:35.715374 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.715348    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-849dcfbbfb-bshtg"]
May 26 11:28:35.720376 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.720352    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-849dcfbbfb-bshtg"]
May 26 11:28:35.976706 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:35.976627    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e37e2867-f67f-42e1-8d48-2483f587c482" path="/var/lib/kubelet/pods/e37e2867-f67f-42e1-8d48-2483f587c482/volumes"
May 26 11:28:45.706718 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:45.706642    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-684997958-sstkd" podUID="de55b9d8-5aaa-48e2-9741-633b188b4e2b" containerName="console" containerID="cri-o://b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02" gracePeriod=15
May 26 11:28:45.957156 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:45.957093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-684997958-sstkd_de55b9d8-5aaa-48e2-9741-633b188b4e2b/console/0.log"
May 26 11:28:45.957156 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:45.957154    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684997958-sstkd"
May 26 11:28:46.014537 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.014497    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm9vd\" (UniqueName: \"kubernetes.io/projected/de55b9d8-5aaa-48e2-9741-633b188b4e2b-kube-api-access-zm9vd\") pod \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") "
May 26 11:28:46.014684 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.014567    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-oauth-config\") pod \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") "
May 26 11:28:46.014684 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.014590    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-service-ca\") pod \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") "
May 26 11:28:46.014684 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.014634    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-serving-cert\") pod \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") "
May 26 11:28:46.014843 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.014696    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-config\") pod \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") "
May 26 11:28:46.014843 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.014724    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-oauth-serving-cert\") pod \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\" (UID: \"de55b9d8-5aaa-48e2-9741-633b188b4e2b\") "
May 26 11:28:46.015072 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.015035    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-service-ca" (OuterVolumeSpecName: "service-ca") pod "de55b9d8-5aaa-48e2-9741-633b188b4e2b" (UID: "de55b9d8-5aaa-48e2-9741-633b188b4e2b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:46.015219 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.015150    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-config" (OuterVolumeSpecName: "console-config") pod "de55b9d8-5aaa-48e2-9741-633b188b4e2b" (UID: "de55b9d8-5aaa-48e2-9741-633b188b4e2b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:46.015291 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.015253    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "de55b9d8-5aaa-48e2-9741-633b188b4e2b" (UID: "de55b9d8-5aaa-48e2-9741-633b188b4e2b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:28:46.016788 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.016762    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "de55b9d8-5aaa-48e2-9741-633b188b4e2b" (UID: "de55b9d8-5aaa-48e2-9741-633b188b4e2b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:28:46.016788 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.016776    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "de55b9d8-5aaa-48e2-9741-633b188b4e2b" (UID: "de55b9d8-5aaa-48e2-9741-633b188b4e2b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:28:46.016916 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.016796    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de55b9d8-5aaa-48e2-9741-633b188b4e2b-kube-api-access-zm9vd" (OuterVolumeSpecName: "kube-api-access-zm9vd") pod "de55b9d8-5aaa-48e2-9741-633b188b4e2b" (UID: "de55b9d8-5aaa-48e2-9741-633b188b4e2b"). InnerVolumeSpecName "kube-api-access-zm9vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 11:28:46.115736 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.115694    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm9vd\" (UniqueName: \"kubernetes.io/projected/de55b9d8-5aaa-48e2-9741-633b188b4e2b-kube-api-access-zm9vd\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:46.115736 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.115731    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-oauth-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:46.115736 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.115741    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-service-ca\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:46.115999 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.115750    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:46.115999 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.115763    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-console-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:46.115999 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.115771    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de55b9d8-5aaa-48e2-9741-633b188b4e2b-oauth-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:28:46.729503 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.729476    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-684997958-sstkd_de55b9d8-5aaa-48e2-9741-633b188b4e2b/console/0.log"
May 26 11:28:46.729892 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.729514    2563 generic.go:358] "Generic (PLEG): container finished" podID="de55b9d8-5aaa-48e2-9741-633b188b4e2b" containerID="b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02" exitCode=2
May 26 11:28:46.729892 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.729586    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684997958-sstkd" event={"ID":"de55b9d8-5aaa-48e2-9741-633b188b4e2b","Type":"ContainerDied","Data":"b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02"}
May 26 11:28:46.729892 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.729608    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684997958-sstkd" event={"ID":"de55b9d8-5aaa-48e2-9741-633b188b4e2b","Type":"ContainerDied","Data":"04e82d8fc20596872f50e8af422acfb18a386e032b1d4ee8cea4bc338340f454"}
May 26 11:28:46.729892 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.729625    2563 scope.go:117] "RemoveContainer" containerID="b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02"
May 26 11:28:46.729892 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.729586    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684997958-sstkd"
May 26 11:28:46.737693 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.737673    2563 scope.go:117] "RemoveContainer" containerID="b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02"
May 26 11:28:46.737982 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:28:46.737957    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02\": container with ID starting with b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02 not found: ID does not exist" containerID="b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02"
May 26 11:28:46.738069 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.737990    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02"} err="failed to get container status \"b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02\": rpc error: code = NotFound desc = could not find container \"b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02\": container with ID starting with b94b1c3bef6428239a68595a0966b2b62fbda3221ebe37fb551aa4d2edcfcb02 not found: ID does not exist"
May 26 11:28:46.751973 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.751945    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684997958-sstkd"]
May 26 11:28:46.755046 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:46.755022    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-684997958-sstkd"]
May 26 11:28:47.976576 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:28:47.976542    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de55b9d8-5aaa-48e2-9741-633b188b4e2b" path="/var/lib/kubelet/pods/de55b9d8-5aaa-48e2-9741-633b188b4e2b/volumes"
May 26 11:29:13.753729 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:13.753622    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:29:13.755954 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:13.755918    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76d1a9f1-5bad-4ab1-93dc-2388810c4796-metrics-certs\") pod \"network-metrics-daemon-2lvct\" (UID: \"76d1a9f1-5bad-4ab1-93dc-2388810c4796\") " pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:29:13.975800 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:13.975774    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-75s55\""
May 26 11:29:13.983988 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:13.983967    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lvct"
May 26 11:29:14.112146 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.112114    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lvct"]
May 26 11:29:14.116114 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:29:14.116082    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d1a9f1_5bad_4ab1_93dc_2388810c4796.slice/crio-4666b8d7c0b9ff5cea7d5e90efaa8d437f0caea62ffdf43d8aa8fcecfd4e2bd0 WatchSource:0}: Error finding container 4666b8d7c0b9ff5cea7d5e90efaa8d437f0caea62ffdf43d8aa8fcecfd4e2bd0: Status 404 returned error can't find the container with id 4666b8d7c0b9ff5cea7d5e90efaa8d437f0caea62ffdf43d8aa8fcecfd4e2bd0
May 26 11:29:14.813547 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.813504    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lvct" event={"ID":"76d1a9f1-5bad-4ab1-93dc-2388810c4796","Type":"ContainerStarted","Data":"4666b8d7c0b9ff5cea7d5e90efaa8d437f0caea62ffdf43d8aa8fcecfd4e2bd0"}
May 26 11:29:14.861918 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.861871    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-547897d6c-nlm5s"]
May 26 11:29:14.863572 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.862310    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37e2867-f67f-42e1-8d48-2483f587c482" containerName="console"
May 26 11:29:14.863572 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.862335    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37e2867-f67f-42e1-8d48-2483f587c482" containerName="console"
May 26 11:29:14.863572 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.862361    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de55b9d8-5aaa-48e2-9741-633b188b4e2b" containerName="console"
May 26 11:29:14.863572 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.862369    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="de55b9d8-5aaa-48e2-9741-633b188b4e2b" containerName="console"
May 26 11:29:14.863572 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.862383    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06ba202-fd4a-49cd-ab0f-5cc526990a1a" containerName="console"
May 26 11:29:14.863572 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.862392    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06ba202-fd4a-49cd-ab0f-5cc526990a1a" containerName="console"
May 26 11:29:14.863572 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.862468    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="de55b9d8-5aaa-48e2-9741-633b188b4e2b" containerName="console"
May 26 11:29:14.863572 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.862483    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b06ba202-fd4a-49cd-ab0f-5cc526990a1a" containerName="console"
May 26 11:29:14.863572 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.862494    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="e37e2867-f67f-42e1-8d48-2483f587c482" containerName="console"
May 26 11:29:14.866203 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.866178    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:14.877197 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.877157    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-547897d6c-nlm5s"]
May 26 11:29:14.964277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.964240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-config\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:14.964277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.964283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-trusted-ca-bundle\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:14.964474 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.964410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t75z4\" (UniqueName: \"kubernetes.io/projected/81feaac0-7cba-41d5-9e1f-e9566083e16c-kube-api-access-t75z4\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:14.964509 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.964480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-serving-cert\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:14.964542 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.964527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-oauth-config\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:14.964604 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.964586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-oauth-serving-cert\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:14.964648 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:14.964630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-service-ca\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.066155 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.066066    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t75z4\" (UniqueName: \"kubernetes.io/projected/81feaac0-7cba-41d5-9e1f-e9566083e16c-kube-api-access-t75z4\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.066155 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.066115    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-serving-cert\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.066155 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.066153    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-oauth-config\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.066437 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.066199    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-oauth-serving-cert\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.066437 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.066225    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-service-ca\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.066437 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.066283    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-config\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.066437 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.066319    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-trusted-ca-bundle\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.067274 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.067244    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-service-ca\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.067454 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.067422    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-config\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.067527 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.067468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-oauth-serving-cert\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.067785 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.067728    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-trusted-ca-bundle\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.069328 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.069280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-oauth-config\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.069328 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.069286    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-serving-cert\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.074467 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.074446    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t75z4\" (UniqueName: \"kubernetes.io/projected/81feaac0-7cba-41d5-9e1f-e9566083e16c-kube-api-access-t75z4\") pod \"console-547897d6c-nlm5s\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") " pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.179481 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.179438    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:15.343152 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.343119    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-547897d6c-nlm5s"]
May 26 11:29:15.345240 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:29:15.345211    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81feaac0_7cba_41d5_9e1f_e9566083e16c.slice/crio-50646e5dcd8168d64431dbdef0a855f257813b9a03c3dfb31f0f0982d3de2730 WatchSource:0}: Error finding container 50646e5dcd8168d64431dbdef0a855f257813b9a03c3dfb31f0f0982d3de2730: Status 404 returned error can't find the container with id 50646e5dcd8168d64431dbdef0a855f257813b9a03c3dfb31f0f0982d3de2730
May 26 11:29:15.817578 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.817539    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lvct" event={"ID":"76d1a9f1-5bad-4ab1-93dc-2388810c4796","Type":"ContainerStarted","Data":"5111e39d0050df993d998f83c6b14ee6b56f778e70f66a2c2c5f5733fb9ecc0f"}
May 26 11:29:15.817578 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.817580    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lvct" event={"ID":"76d1a9f1-5bad-4ab1-93dc-2388810c4796","Type":"ContainerStarted","Data":"bb0b6428768055af98433dc6df7790975beafd000e8db8202cf22c4a9002e570"}
May 26 11:29:15.819002 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.818973    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547897d6c-nlm5s" event={"ID":"81feaac0-7cba-41d5-9e1f-e9566083e16c","Type":"ContainerStarted","Data":"e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1"}
May 26 11:29:15.819002 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.819004    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547897d6c-nlm5s" event={"ID":"81feaac0-7cba-41d5-9e1f-e9566083e16c","Type":"ContainerStarted","Data":"50646e5dcd8168d64431dbdef0a855f257813b9a03c3dfb31f0f0982d3de2730"}
May 26 11:29:15.849404 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.849351    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2lvct" podStartSLOduration=252.710535503 podStartE2EDuration="4m13.849335153s" podCreationTimestamp="2026-05-26 11:25:02 +0000 UTC" firstStartedPulling="2026-05-26 11:29:14.117861025 +0000 UTC m=+252.757621772" lastFinishedPulling="2026-05-26 11:29:15.256660664 +0000 UTC m=+253.896421422" observedRunningTime="2026-05-26 11:29:15.848414347 +0000 UTC m=+254.488175111" watchObservedRunningTime="2026-05-26 11:29:15.849335153 +0000 UTC m=+254.489095974"
May 26 11:29:15.877064 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:15.877017    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-547897d6c-nlm5s" podStartSLOduration=1.876999115 podStartE2EDuration="1.876999115s" podCreationTimestamp="2026-05-26 11:29:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:29:15.875465022 +0000 UTC m=+254.515225778" watchObservedRunningTime="2026-05-26 11:29:15.876999115 +0000 UTC m=+254.516759882"
May 26 11:29:18.048715 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.048678    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 11:29:18.049157 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.049120    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="alertmanager" containerID="cri-o://2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859" gracePeriod=120
May 26 11:29:18.049157 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.049149    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="prom-label-proxy" containerID="cri-o://105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c" gracePeriod=120
May 26 11:29:18.049379 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.049155    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy" containerID="cri-o://8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1" gracePeriod=120
May 26 11:29:18.049379 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.049210    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy-metric" containerID="cri-o://e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9" gracePeriod=120
May 26 11:29:18.049379 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.049186    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="config-reloader" containerID="cri-o://ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8" gracePeriod=120
May 26 11:29:18.049379 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.049187    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy-web" containerID="cri-o://dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38" gracePeriod=120
May 26 11:29:18.833846 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.833814    2563 generic.go:358] "Generic (PLEG): container finished" podID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerID="105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c" exitCode=0
May 26 11:29:18.833846 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.833839    2563 generic.go:358] "Generic (PLEG): container finished" podID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerID="8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1" exitCode=0
May 26 11:29:18.833846 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.833848    2563 generic.go:358] "Generic (PLEG): container finished" podID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerID="ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8" exitCode=0
May 26 11:29:18.833846 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.833854    2563 generic.go:358] "Generic (PLEG): container finished" podID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerID="2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859" exitCode=0
May 26 11:29:18.834133 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.833888    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerDied","Data":"105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c"}
May 26 11:29:18.834133 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.833922    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerDied","Data":"8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1"}
May 26 11:29:18.834133 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.833955    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerDied","Data":"ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8"}
May 26 11:29:18.834133 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:18.833965    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerDied","Data":"2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859"}
May 26 11:29:19.308416 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.308395    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.401759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.401661    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-trusted-ca-bundle\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.401759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.401712    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-volume\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.401759 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.401740    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-metrics-client-ca\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.401831    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.401873    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-tls-assets\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.401928    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-main-db\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.401991    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.402016    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-out\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.402047    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzxnq\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-kube-api-access-jzxnq\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.402075    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-web-config\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402485 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.402109    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-web\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402485 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.402144    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-main-tls\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.402485 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.402201    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-cluster-tls-config\") pod \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\" (UID: \"daee2bcf-42c7-4434-a1ed-b8c828e73fae\") "
May 26 11:29:19.403007 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.402138    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:29:19.403132 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.402149    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:29:19.403132 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.402478    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 11:29:19.404600 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.404571    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-volume" (OuterVolumeSpecName: "config-volume") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:29:19.404707 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.404668    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:29:19.404773 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.404748    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:29:19.405346 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.405312    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-out" (OuterVolumeSpecName: "config-out") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 11:29:19.405747 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.405722    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 11:29:19.405747 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.405732    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:29:19.405869 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.405763    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:29:19.406330 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.406297    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-kube-api-access-jzxnq" (OuterVolumeSpecName: "kube-api-access-jzxnq") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "kube-api-access-jzxnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 11:29:19.409416 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.409220    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:29:19.415719 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.415696    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-web-config" (OuterVolumeSpecName: "web-config") pod "daee2bcf-42c7-4434-a1ed-b8c828e73fae" (UID: "daee2bcf-42c7-4434-a1ed-b8c828e73fae"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:29:19.503280 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503242    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-tls-assets\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503280 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503275    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-main-db\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503280 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503287    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503298    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-out\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503307    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzxnq\" (UniqueName: \"kubernetes.io/projected/daee2bcf-42c7-4434-a1ed-b8c828e73fae-kube-api-access-jzxnq\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503316    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-web-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503325    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503334    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-main-tls\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503343    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-cluster-tls-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503353    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503361    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-config-volume\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503370    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daee2bcf-42c7-4434-a1ed-b8c828e73fae-metrics-client-ca\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.503473 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.503380    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daee2bcf-42c7-4434-a1ed-b8c828e73fae-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:19.839577 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.839539    2563 generic.go:358] "Generic (PLEG): container finished" podID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerID="e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9" exitCode=0
May 26 11:29:19.839577 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.839570    2563 generic.go:358] "Generic (PLEG): container finished" podID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerID="dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38" exitCode=0
May 26 11:29:19.839798 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.839626    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerDied","Data":"e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9"}
May 26 11:29:19.839798 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.839650    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.839798 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.839667    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerDied","Data":"dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38"}
May 26 11:29:19.839798 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.839682    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daee2bcf-42c7-4434-a1ed-b8c828e73fae","Type":"ContainerDied","Data":"183fa8d9b99c1dcb4792204f62b133a6c86661e1748d182ededb8d5f4d1aa500"}
May 26 11:29:19.839798 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.839697    2563 scope.go:117] "RemoveContainer" containerID="105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c"
May 26 11:29:19.848284 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.848133    2563 scope.go:117] "RemoveContainer" containerID="e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9"
May 26 11:29:19.855164 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.855146    2563 scope.go:117] "RemoveContainer" containerID="8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1"
May 26 11:29:19.861599 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.861578    2563 scope.go:117] "RemoveContainer" containerID="dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38"
May 26 11:29:19.865213 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.865189    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 11:29:19.874011 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.873990    2563 scope.go:117] "RemoveContainer" containerID="ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8"
May 26 11:29:19.874869 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.874838    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 11:29:19.880904 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.880881    2563 scope.go:117] "RemoveContainer" containerID="2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859"
May 26 11:29:19.887875 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.887841    2563 scope.go:117] "RemoveContainer" containerID="53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd"
May 26 11:29:19.894456 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.894438    2563 scope.go:117] "RemoveContainer" containerID="105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c"
May 26 11:29:19.894698 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:29:19.894680    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c\": container with ID starting with 105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c not found: ID does not exist" containerID="105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c"
May 26 11:29:19.894746 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.894709    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c"} err="failed to get container status \"105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c\": rpc error: code = NotFound desc = could not find container \"105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c\": container with ID starting with 105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c not found: ID does not exist"
May 26 11:29:19.894746 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.894729    2563 scope.go:117] "RemoveContainer" containerID="e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9"
May 26 11:29:19.894950 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:29:19.894916    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9\": container with ID starting with e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9 not found: ID does not exist" containerID="e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9"
May 26 11:29:19.894993 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.894962    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9"} err="failed to get container status \"e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9\": rpc error: code = NotFound desc = could not find container \"e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9\": container with ID starting with e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9 not found: ID does not exist"
May 26 11:29:19.894993 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.894985    2563 scope.go:117] "RemoveContainer" containerID="8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1"
May 26 11:29:19.895361 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:29:19.895337    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1\": container with ID starting with 8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1 not found: ID does not exist" containerID="8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1"
May 26 11:29:19.895458 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.895369    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1"} err="failed to get container status \"8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1\": rpc error: code = NotFound desc = could not find container \"8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1\": container with ID starting with 8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1 not found: ID does not exist"
May 26 11:29:19.895458 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.895385    2563 scope.go:117] "RemoveContainer" containerID="dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38"
May 26 11:29:19.895706 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:29:19.895682    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38\": container with ID starting with dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38 not found: ID does not exist" containerID="dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38"
May 26 11:29:19.895817 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.895713    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38"} err="failed to get container status \"dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38\": rpc error: code = NotFound desc = could not find container \"dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38\": container with ID starting with dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38 not found: ID does not exist"
May 26 11:29:19.895817 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.895735    2563 scope.go:117] "RemoveContainer" containerID="ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8"
May 26 11:29:19.896097 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:29:19.896066    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8\": container with ID starting with ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8 not found: ID does not exist" containerID="ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8"
May 26 11:29:19.896176 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.896096    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8"} err="failed to get container status \"ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8\": rpc error: code = NotFound desc = could not find container \"ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8\": container with ID starting with ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8 not found: ID does not exist"
May 26 11:29:19.896176 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.896120    2563 scope.go:117] "RemoveContainer" containerID="2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859"
May 26 11:29:19.896545 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:29:19.896483    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859\": container with ID starting with 2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859 not found: ID does not exist" containerID="2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859"
May 26 11:29:19.896545 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.896513    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859"} err="failed to get container status \"2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859\": rpc error: code = NotFound desc = could not find container \"2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859\": container with ID starting with 2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859 not found: ID does not exist"
May 26 11:29:19.896545 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.896533    2563 scope.go:117] "RemoveContainer" containerID="53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd"
May 26 11:29:19.896857 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:29:19.896838    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd\": container with ID starting with 53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd not found: ID does not exist" containerID="53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd"
May 26 11:29:19.896945 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.896865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd"} err="failed to get container status \"53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd\": rpc error: code = NotFound desc = could not find container \"53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd\": container with ID starting with 53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd not found: ID does not exist"
May 26 11:29:19.896945 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.896885    2563 scope.go:117] "RemoveContainer" containerID="105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c"
May 26 11:29:19.897175 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.897155    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c"} err="failed to get container status \"105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c\": rpc error: code = NotFound desc = could not find container \"105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c\": container with ID starting with 105a83c4ff01c4350fd41a4a03a3496f94fcf7f2e5c2564224b089c1482eea6c not found: ID does not exist"
May 26 11:29:19.897230 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.897175    2563 scope.go:117] "RemoveContainer" containerID="e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9"
May 26 11:29:19.897426 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.897395    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9"} err="failed to get container status \"e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9\": rpc error: code = NotFound desc = could not find container \"e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9\": container with ID starting with e73bd4ffa1714bc5ff4657c4bfa0fdcdb8e21fdc29a55365b95dc3fd5ba940a9 not found: ID does not exist"
May 26 11:29:19.897523 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.897428    2563 scope.go:117] "RemoveContainer" containerID="8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1"
May 26 11:29:19.897663 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.897643    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1"} err="failed to get container status \"8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1\": rpc error: code = NotFound desc = could not find container \"8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1\": container with ID starting with 8267bd3b224b5398753ebfaecfd0ee9b57d14fb60400abe0a48d4ab21a50a0e1 not found: ID does not exist"
May 26 11:29:19.897708 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.897665    2563 scope.go:117] "RemoveContainer" containerID="dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38"
May 26 11:29:19.897761 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.897734    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 11:29:19.897890 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.897870    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38"} err="failed to get container status \"dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38\": rpc error: code = NotFound desc = could not find container \"dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38\": container with ID starting with dbcfc455a6da76c0f393d3eef51b6c844261e9cc005d3dbf1b56991265a81d38 not found: ID does not exist"
May 26 11:29:19.897971 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.897892    2563 scope.go:117] "RemoveContainer" containerID="ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8"
May 26 11:29:19.898138 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898117    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8"} err="failed to get container status \"ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8\": rpc error: code = NotFound desc = could not find container \"ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8\": container with ID starting with ec5e4d12997fd657492a081d26144cb782a956d911fb7d17af59baa9d3be6fd8 not found: ID does not exist"
May 26 11:29:19.898225 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898141    2563 scope.go:117] "RemoveContainer" containerID="2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859"
May 26 11:29:19.898225 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898175    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="init-config-reloader"
May 26 11:29:19.898225 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898195    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="init-config-reloader"
May 26 11:29:19.898225 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898209    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="alertmanager"
May 26 11:29:19.898225 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898218    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="alertmanager"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898236    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="config-reloader"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898244    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="config-reloader"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898250    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy-metric"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898257    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy-metric"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898273    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy-web"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898278    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy-web"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898286    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="prom-label-proxy"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898291    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="prom-label-proxy"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898298    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898303    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898354    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy-metric"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898364    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898371    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859"} err="failed to get container status \"2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859\": rpc error: code = NotFound desc = could not find container \"2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859\": container with ID starting with 2d48edef6767e054514e4bd93446e4f5c1ae1cc6726a239b051204ca31b11859 not found: ID does not exist"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898386    2563 scope.go:117] "RemoveContainer" containerID="53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd"
May 26 11:29:19.898402 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898402    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="config-reloader"
May 26 11:29:19.898847 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898411    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="kube-rbac-proxy-web"
May 26 11:29:19.898847 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898425    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="prom-label-proxy"
May 26 11:29:19.898847 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898432    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" containerName="alertmanager"
May 26 11:29:19.898847 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.898585    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd"} err="failed to get container status \"53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd\": rpc error: code = NotFound desc = could not find container \"53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd\": container with ID starting with 53bd7cc98773c588ba851c718be80e58976731a0ca5c2c19037bb7102a1108bd not found: ID does not exist"
May 26 11:29:19.903352 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.903336    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.906018 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.905996    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z8gkm\""
May 26 11:29:19.906131 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906096    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 11:29:19.906319 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906303    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 11:29:19.906404 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906360    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 11:29:19.906404 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906362    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 11:29:19.906509 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906403    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 11:29:19.906509 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906442    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 11:29:19.906869 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20c2239-518d-4fd6-8125-901bafb474e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.906966 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906879    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 11:29:19.906966 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c20c2239-518d-4fd6-8125-901bafb474e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.906966 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907122 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.906984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907122 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-web-config\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907122 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72jl6\" (UniqueName: \"kubernetes.io/projected/c20c2239-518d-4fd6-8125-901bafb474e5-kube-api-access-72jl6\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907122 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907316 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907123    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 11:29:19.907316 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907316 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907316 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907316 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c20c2239-518d-4fd6-8125-901bafb474e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907316 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c20c2239-518d-4fd6-8125-901bafb474e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.907588 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.907336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c20c2239-518d-4fd6-8125-901bafb474e5-config-out\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:19.912458 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.912439    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 11:29:19.916026 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.916006    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 11:29:19.976608 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:19.976566    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daee2bcf-42c7-4434-a1ed-b8c828e73fae" path="/var/lib/kubelet/pods/daee2bcf-42c7-4434-a1ed-b8c828e73fae/volumes"
May 26 11:29:20.007980 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.007912    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c20c2239-518d-4fd6-8125-901bafb474e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008179 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008075    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008179 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008126    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008299 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008241    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-web-config\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008299 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008277    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72jl6\" (UniqueName: \"kubernetes.io/projected/c20c2239-518d-4fd6-8125-901bafb474e5-kube-api-access-72jl6\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008395 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008313    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008395 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008385    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008507 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008420    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008507 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008456    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008507 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008487    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c20c2239-518d-4fd6-8125-901bafb474e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008657 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008527    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c20c2239-518d-4fd6-8125-901bafb474e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008657 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008566    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c20c2239-518d-4fd6-8125-901bafb474e5-config-out\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.008657 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.008612    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20c2239-518d-4fd6-8125-901bafb474e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.010744 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.009566    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20c2239-518d-4fd6-8125-901bafb474e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.011249 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.010988    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c20c2239-518d-4fd6-8125-901bafb474e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.011249 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.011062    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c20c2239-518d-4fd6-8125-901bafb474e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.011249 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.011131    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c20c2239-518d-4fd6-8125-901bafb474e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.011249 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.011187    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.011597 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.011339    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.011597 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.011389    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.011754 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.011733    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-web-config\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.011841 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.011823    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.012132 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.012114    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.012422 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.012408    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c20c2239-518d-4fd6-8125-901bafb474e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.012803 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.012778    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c20c2239-518d-4fd6-8125-901bafb474e5-config-out\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.016383 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.016357    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72jl6\" (UniqueName: \"kubernetes.io/projected/c20c2239-518d-4fd6-8125-901bafb474e5-kube-api-access-72jl6\") pod \"alertmanager-main-0\" (UID: \"c20c2239-518d-4fd6-8125-901bafb474e5\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.212558 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.212515    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 11:29:20.373086 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.373058    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 11:29:20.375515 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:29:20.375485    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20c2239_518d_4fd6_8125_901bafb474e5.slice/crio-5f55182aa8cffbbcbb99021396a9f8b19916a02fe12b05ca0de8ae93cb165fa4 WatchSource:0}: Error finding container 5f55182aa8cffbbcbb99021396a9f8b19916a02fe12b05ca0de8ae93cb165fa4: Status 404 returned error can't find the container with id 5f55182aa8cffbbcbb99021396a9f8b19916a02fe12b05ca0de8ae93cb165fa4
May 26 11:29:20.844025 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.843993    2563 generic.go:358] "Generic (PLEG): container finished" podID="c20c2239-518d-4fd6-8125-901bafb474e5" containerID="a479d0c3c571bed5047ab64e89868311e8dcb20e73754ca3db85f9be85db026f" exitCode=0
May 26 11:29:20.844201 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.844076    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c20c2239-518d-4fd6-8125-901bafb474e5","Type":"ContainerDied","Data":"a479d0c3c571bed5047ab64e89868311e8dcb20e73754ca3db85f9be85db026f"}
May 26 11:29:20.844201 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:20.844120    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c20c2239-518d-4fd6-8125-901bafb474e5","Type":"ContainerStarted","Data":"5f55182aa8cffbbcbb99021396a9f8b19916a02fe12b05ca0de8ae93cb165fa4"}
May 26 11:29:21.849907 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:21.849870    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c20c2239-518d-4fd6-8125-901bafb474e5","Type":"ContainerStarted","Data":"bbf3b1dde0ff8f7bcb5e3f8811cfe100fa6aebdc1a7972c23441416148998986"}
May 26 11:29:21.850303 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:21.849914    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c20c2239-518d-4fd6-8125-901bafb474e5","Type":"ContainerStarted","Data":"23a259cc1044d017d376d82287e0c3c47bc142b7372aca3a51647580189c7401"}
May 26 11:29:21.850303 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:21.849944    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c20c2239-518d-4fd6-8125-901bafb474e5","Type":"ContainerStarted","Data":"77b57b0fe18436477c7560629410f26293bd34769b2e14eeea909ff2d9d84cd4"}
May 26 11:29:21.850303 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:21.849958    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c20c2239-518d-4fd6-8125-901bafb474e5","Type":"ContainerStarted","Data":"6ed3d3f095ca31c9b95e2b4d2c842c6a70891f6eb3b297b3e427a2b6609bf322"}
May 26 11:29:21.850303 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:21.849970    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c20c2239-518d-4fd6-8125-901bafb474e5","Type":"ContainerStarted","Data":"1e88a98f96e3292b75baf3969d29eaa642bd31522c64d184ce28b6e20a51cd4a"}
May 26 11:29:21.850303 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:21.849982    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c20c2239-518d-4fd6-8125-901bafb474e5","Type":"ContainerStarted","Data":"8ba9d46263e5fc4fc5994b1f61730bb41bd9a8b499feeced2ee1708badaf86c5"}
May 26 11:29:21.879162 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:21.879115    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.879099179 podStartE2EDuration="2.879099179s" podCreationTimestamp="2026-05-26 11:29:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:29:21.877611207 +0000 UTC m=+260.517371986" watchObservedRunningTime="2026-05-26 11:29:21.879099179 +0000 UTC m=+260.518859944"
May 26 11:29:25.180597 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:25.180537    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:25.180597 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:25.180610    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:25.185255 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:25.185231    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:25.865435 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:25.865398    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:29:25.919637 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:25.919602    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b74bf48fd-sct8b"]
May 26 11:29:50.940138 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:50.940102    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b74bf48fd-sct8b" podUID="448ee4f6-ac38-4463-b38f-aacdd2995fa9" containerName="console" containerID="cri-o://8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe" gracePeriod=15
May 26 11:29:51.179928 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.179904    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b74bf48fd-sct8b_448ee4f6-ac38-4463-b38f-aacdd2995fa9/console/0.log"
May 26 11:29:51.180072 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.179989    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:29:51.273569 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.273499    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-trusted-ca-bundle\") pod \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") "
May 26 11:29:51.273569 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.273544    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpfzs\" (UniqueName: \"kubernetes.io/projected/448ee4f6-ac38-4463-b38f-aacdd2995fa9-kube-api-access-dpfzs\") pod \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") "
May 26 11:29:51.273771 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.273593    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-service-ca\") pod \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") "
May 26 11:29:51.273771 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.273619    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-oauth-serving-cert\") pod \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") "
May 26 11:29:51.273771 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.273640    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-config\") pod \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") "
May 26 11:29:51.273771 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.273663    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-oauth-config\") pod \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") "
May 26 11:29:51.273771 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.273712    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-serving-cert\") pod \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\" (UID: \"448ee4f6-ac38-4463-b38f-aacdd2995fa9\") "
May 26 11:29:51.274047 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.274020    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "448ee4f6-ac38-4463-b38f-aacdd2995fa9" (UID: "448ee4f6-ac38-4463-b38f-aacdd2995fa9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:29:51.274105 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.274067    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-service-ca" (OuterVolumeSpecName: "service-ca") pod "448ee4f6-ac38-4463-b38f-aacdd2995fa9" (UID: "448ee4f6-ac38-4463-b38f-aacdd2995fa9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:29:51.274105 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.274088    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-config" (OuterVolumeSpecName: "console-config") pod "448ee4f6-ac38-4463-b38f-aacdd2995fa9" (UID: "448ee4f6-ac38-4463-b38f-aacdd2995fa9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:29:51.274180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.274128    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "448ee4f6-ac38-4463-b38f-aacdd2995fa9" (UID: "448ee4f6-ac38-4463-b38f-aacdd2995fa9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:29:51.275797 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.275771    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/448ee4f6-ac38-4463-b38f-aacdd2995fa9-kube-api-access-dpfzs" (OuterVolumeSpecName: "kube-api-access-dpfzs") pod "448ee4f6-ac38-4463-b38f-aacdd2995fa9" (UID: "448ee4f6-ac38-4463-b38f-aacdd2995fa9"). InnerVolumeSpecName "kube-api-access-dpfzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 11:29:51.275797 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.275786    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "448ee4f6-ac38-4463-b38f-aacdd2995fa9" (UID: "448ee4f6-ac38-4463-b38f-aacdd2995fa9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:29:51.276001 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.275820    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "448ee4f6-ac38-4463-b38f-aacdd2995fa9" (UID: "448ee4f6-ac38-4463-b38f-aacdd2995fa9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:29:51.375171 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.375143    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-service-ca\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:51.375171 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.375168    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-oauth-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:51.375311 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.375178    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:51.375311 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.375187    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-oauth-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:51.375311 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.375196    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/448ee4f6-ac38-4463-b38f-aacdd2995fa9-console-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:51.375311 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.375204    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/448ee4f6-ac38-4463-b38f-aacdd2995fa9-trusted-ca-bundle\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:51.375311 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.375215    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpfzs\" (UniqueName: \"kubernetes.io/projected/448ee4f6-ac38-4463-b38f-aacdd2995fa9-kube-api-access-dpfzs\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:29:51.936598 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.936570    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b74bf48fd-sct8b_448ee4f6-ac38-4463-b38f-aacdd2995fa9/console/0.log"
May 26 11:29:51.936741 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.936613    2563 generic.go:358] "Generic (PLEG): container finished" podID="448ee4f6-ac38-4463-b38f-aacdd2995fa9" containerID="8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe" exitCode=2
May 26 11:29:51.936741 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.936644    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b74bf48fd-sct8b" event={"ID":"448ee4f6-ac38-4463-b38f-aacdd2995fa9","Type":"ContainerDied","Data":"8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe"}
May 26 11:29:51.936741 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.936682    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b74bf48fd-sct8b" event={"ID":"448ee4f6-ac38-4463-b38f-aacdd2995fa9","Type":"ContainerDied","Data":"5eb38358e1cd4616c2e5450129814f673b382891d71af5548e569ea035f57846"}
May 26 11:29:51.936741 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.936697    2563 scope.go:117] "RemoveContainer" containerID="8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe"
May 26 11:29:51.936741 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.936707    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b74bf48fd-sct8b"
May 26 11:29:51.945685 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.945511    2563 scope.go:117] "RemoveContainer" containerID="8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe"
May 26 11:29:51.945893 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:29:51.945768    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe\": container with ID starting with 8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe not found: ID does not exist" containerID="8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe"
May 26 11:29:51.945893 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.945794    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe"} err="failed to get container status \"8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe\": rpc error: code = NotFound desc = could not find container \"8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe\": container with ID starting with 8dbf67381863af2a87a807fc4942a17e285e7c2d9389a55658a22642b9805ffe not found: ID does not exist"
May 26 11:29:51.958582 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.958558    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b74bf48fd-sct8b"]
May 26 11:29:51.965491 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.965472    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b74bf48fd-sct8b"]
May 26 11:29:51.975687 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:51.975666    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="448ee4f6-ac38-4463-b38f-aacdd2995fa9" path="/var/lib/kubelet/pods/448ee4f6-ac38-4463-b38f-aacdd2995fa9/volumes"
May 26 11:29:58.882159 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:58.882125    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qqstg"]
May 26 11:29:58.882525 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:58.882408    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="448ee4f6-ac38-4463-b38f-aacdd2995fa9" containerName="console"
May 26 11:29:58.882525 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:58.882419    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="448ee4f6-ac38-4463-b38f-aacdd2995fa9" containerName="console"
May 26 11:29:58.882525 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:58.882465    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="448ee4f6-ac38-4463-b38f-aacdd2995fa9" containerName="console"
May 26 11:29:58.886707 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:58.886688    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:58.889166 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:58.889148    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 11:29:58.894073 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:58.894049    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qqstg"]
May 26 11:29:59.031244 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.031212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b0153f3-c46f-4eb4-a378-752e6f61736e-kubelet-config\") pod \"global-pull-secret-syncer-qqstg\" (UID: \"8b0153f3-c46f-4eb4-a378-752e6f61736e\") " pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.031244 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.031243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b0153f3-c46f-4eb4-a378-752e6f61736e-original-pull-secret\") pod \"global-pull-secret-syncer-qqstg\" (UID: \"8b0153f3-c46f-4eb4-a378-752e6f61736e\") " pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.031434 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.031266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b0153f3-c46f-4eb4-a378-752e6f61736e-dbus\") pod \"global-pull-secret-syncer-qqstg\" (UID: \"8b0153f3-c46f-4eb4-a378-752e6f61736e\") " pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.132281 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.132194    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b0153f3-c46f-4eb4-a378-752e6f61736e-dbus\") pod \"global-pull-secret-syncer-qqstg\" (UID: \"8b0153f3-c46f-4eb4-a378-752e6f61736e\") " pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.132428 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.132317    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b0153f3-c46f-4eb4-a378-752e6f61736e-kubelet-config\") pod \"global-pull-secret-syncer-qqstg\" (UID: \"8b0153f3-c46f-4eb4-a378-752e6f61736e\") " pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.132428 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.132346    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b0153f3-c46f-4eb4-a378-752e6f61736e-original-pull-secret\") pod \"global-pull-secret-syncer-qqstg\" (UID: \"8b0153f3-c46f-4eb4-a378-752e6f61736e\") " pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.132428 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.132398    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b0153f3-c46f-4eb4-a378-752e6f61736e-dbus\") pod \"global-pull-secret-syncer-qqstg\" (UID: \"8b0153f3-c46f-4eb4-a378-752e6f61736e\") " pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.132544 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.132425    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b0153f3-c46f-4eb4-a378-752e6f61736e-kubelet-config\") pod \"global-pull-secret-syncer-qqstg\" (UID: \"8b0153f3-c46f-4eb4-a378-752e6f61736e\") " pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.134492 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.134463    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b0153f3-c46f-4eb4-a378-752e6f61736e-original-pull-secret\") pod \"global-pull-secret-syncer-qqstg\" (UID: \"8b0153f3-c46f-4eb4-a378-752e6f61736e\") " pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.195498 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.195476    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qqstg"
May 26 11:29:59.315253 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.315222    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qqstg"]
May 26 11:29:59.318072 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:29:59.318045    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0153f3_c46f_4eb4_a378_752e6f61736e.slice/crio-90f2167dca0985cfe7712623d63dda499a405ab170350d65daefc58967cf7694 WatchSource:0}: Error finding container 90f2167dca0985cfe7712623d63dda499a405ab170350d65daefc58967cf7694: Status 404 returned error can't find the container with id 90f2167dca0985cfe7712623d63dda499a405ab170350d65daefc58967cf7694
May 26 11:29:59.961043 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:29:59.960994    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qqstg" event={"ID":"8b0153f3-c46f-4eb4-a378-752e6f61736e","Type":"ContainerStarted","Data":"90f2167dca0985cfe7712623d63dda499a405ab170350d65daefc58967cf7694"}
May 26 11:30:03.133178 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:30:03.133155    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:30:03.133547 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:30:03.133325    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:30:03.139004 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:30:03.138988    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:30:03.139391 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:30:03.139374    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:30:03.142003 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:30:03.141989    2563 kubelet.go:1628] "Image garbage collection succeeded"
May 26 11:30:03.975272 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:30:03.975240    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qqstg" event={"ID":"8b0153f3-c46f-4eb4-a378-752e6f61736e","Type":"ContainerStarted","Data":"2dc4965f48d75277cae9b70630f158255d5506ff862732cf123f83fc1b8c621e"}
May 26 11:30:03.991541 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:30:03.991493    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qqstg" podStartSLOduration=2.139456613 podStartE2EDuration="5.991480255s" podCreationTimestamp="2026-05-26 11:29:58 +0000 UTC" firstStartedPulling="2026-05-26 11:29:59.319661479 +0000 UTC m=+297.959422222" lastFinishedPulling="2026-05-26 11:30:03.171685118 +0000 UTC m=+301.811445864" observedRunningTime="2026-05-26 11:30:03.990341431 +0000 UTC m=+302.630102196" watchObservedRunningTime="2026-05-26 11:30:03.991480255 +0000 UTC m=+302.631241020"
May 26 11:31:49.332438 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.332397    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"]
May 26 11:31:49.334760 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.334744    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.337130 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.337110    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 26 11:31:49.337985 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.337966    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 26 11:31:49.338079 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.338031    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w4nbg\""
May 26 11:31:49.344433 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.344410    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"]
May 26 11:31:49.495206 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.495176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.495348 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.495224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.495348 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.495287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvwmx\" (UniqueName: \"kubernetes.io/projected/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-kube-api-access-mvwmx\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.596454 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.596379    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.596454 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.596423    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwmx\" (UniqueName: \"kubernetes.io/projected/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-kube-api-access-mvwmx\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.596593 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.596474    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.596766 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.596747    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.596823 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.596804    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.604854 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.604829    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvwmx\" (UniqueName: \"kubernetes.io/projected/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-kube-api-access-mvwmx\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.644642 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.644622    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:31:49.769916 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.769895    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"]
May 26 11:31:49.771896 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:31:49.771867    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03deca8_eab5_4cde_8e75_c44e1f2ecf59.slice/crio-b6ab62fd65a0a8200d0a7a5c78745b4edc6f9c61723424253b59c4a6b06fff58 WatchSource:0}: Error finding container b6ab62fd65a0a8200d0a7a5c78745b4edc6f9c61723424253b59c4a6b06fff58: Status 404 returned error can't find the container with id b6ab62fd65a0a8200d0a7a5c78745b4edc6f9c61723424253b59c4a6b06fff58
May 26 11:31:49.773767 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:49.773749    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 11:31:50.262726 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:50.262697    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj" event={"ID":"f03deca8-eab5-4cde-8e75-c44e1f2ecf59","Type":"ContainerStarted","Data":"b6ab62fd65a0a8200d0a7a5c78745b4edc6f9c61723424253b59c4a6b06fff58"}
May 26 11:31:55.278456 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:55.278421    2563 generic.go:358] "Generic (PLEG): container finished" podID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerID="aa74de2c6637945e9951b4a1be15a2ca1cc7d95ae6e94684783bc8776fa8b7af" exitCode=0
May 26 11:31:55.278828 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:55.278473    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj" event={"ID":"f03deca8-eab5-4cde-8e75-c44e1f2ecf59","Type":"ContainerDied","Data":"aa74de2c6637945e9951b4a1be15a2ca1cc7d95ae6e94684783bc8776fa8b7af"}
May 26 11:31:58.288630 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:58.288598    2563 generic.go:358] "Generic (PLEG): container finished" podID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerID="31a6e367e7ca9bcbe0d12b52ac32a83558fa5cf7c260260547a888c3f2fec4fd" exitCode=0
May 26 11:31:58.288987 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:31:58.288676    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj" event={"ID":"f03deca8-eab5-4cde-8e75-c44e1f2ecf59","Type":"ContainerDied","Data":"31a6e367e7ca9bcbe0d12b52ac32a83558fa5cf7c260260547a888c3f2fec4fd"}
May 26 11:32:04.308271 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:04.308234    2563 generic.go:358] "Generic (PLEG): container finished" podID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerID="747dba1ae3631db267a4be6d1fd7e0a3408a8db5a917d03b7e7c453231ec2df0" exitCode=0
May 26 11:32:04.308683 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:04.308289    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj" event={"ID":"f03deca8-eab5-4cde-8e75-c44e1f2ecf59","Type":"ContainerDied","Data":"747dba1ae3631db267a4be6d1fd7e0a3408a8db5a917d03b7e7c453231ec2df0"}
May 26 11:32:05.434431 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.434409    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:32:05.540660 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.540634    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-util\") pod \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") "
May 26 11:32:05.540780 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.540723    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvwmx\" (UniqueName: \"kubernetes.io/projected/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-kube-api-access-mvwmx\") pod \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") "
May 26 11:32:05.540780 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.540774    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-bundle\") pod \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\" (UID: \"f03deca8-eab5-4cde-8e75-c44e1f2ecf59\") "
May 26 11:32:05.541352 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.541324    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-bundle" (OuterVolumeSpecName: "bundle") pod "f03deca8-eab5-4cde-8e75-c44e1f2ecf59" (UID: "f03deca8-eab5-4cde-8e75-c44e1f2ecf59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 11:32:05.542798 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.542772    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-kube-api-access-mvwmx" (OuterVolumeSpecName: "kube-api-access-mvwmx") pod "f03deca8-eab5-4cde-8e75-c44e1f2ecf59" (UID: "f03deca8-eab5-4cde-8e75-c44e1f2ecf59"). InnerVolumeSpecName "kube-api-access-mvwmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 11:32:05.547069 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.547045    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-util" (OuterVolumeSpecName: "util") pod "f03deca8-eab5-4cde-8e75-c44e1f2ecf59" (UID: "f03deca8-eab5-4cde-8e75-c44e1f2ecf59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 11:32:05.641761 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.641699    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-util\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:32:05.641761 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.641731    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvwmx\" (UniqueName: \"kubernetes.io/projected/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-kube-api-access-mvwmx\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:32:05.641761 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:05.641740    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f03deca8-eab5-4cde-8e75-c44e1f2ecf59-bundle\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:32:06.316208 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:06.316171    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj" event={"ID":"f03deca8-eab5-4cde-8e75-c44e1f2ecf59","Type":"ContainerDied","Data":"b6ab62fd65a0a8200d0a7a5c78745b4edc6f9c61723424253b59c4a6b06fff58"}
May 26 11:32:06.316208 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:06.316211    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6ab62fd65a0a8200d0a7a5c78745b4edc6f9c61723424253b59c4a6b06fff58"
May 26 11:32:06.316429 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:06.316220    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29ct7cxj"
May 26 11:32:11.365851 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.365773    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"]
May 26 11:32:11.366256 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.366127    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerName="pull"
May 26 11:32:11.366256 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.366140    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerName="pull"
May 26 11:32:11.366256 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.366152    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerName="util"
May 26 11:32:11.366256 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.366158    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerName="util"
May 26 11:32:11.366256 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.366169    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerName="extract"
May 26 11:32:11.366256 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.366174    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerName="extract"
May 26 11:32:11.366256 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.366217    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f03deca8-eab5-4cde-8e75-c44e1f2ecf59" containerName="extract"
May 26 11:32:11.368154 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.368138    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:11.370532 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.370503    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
May 26 11:32:11.370652 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.370533    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
May 26 11:32:11.370652 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.370599    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
May 26 11:32:11.370770 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.370601    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-w5bgh\""
May 26 11:32:11.380125 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.380099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxpgr\" (UniqueName: \"kubernetes.io/projected/8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a-kube-api-access-rxpgr\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw\" (UID: \"8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:11.380254 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.380224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw\" (UID: \"8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:11.381550 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.381528    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"]
May 26 11:32:11.481496 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.481468    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxpgr\" (UniqueName: \"kubernetes.io/projected/8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a-kube-api-access-rxpgr\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw\" (UID: \"8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:11.481610 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.481533    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw\" (UID: \"8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:11.483744 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.483727    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw\" (UID: \"8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:11.489731 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.489713    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxpgr\" (UniqueName: \"kubernetes.io/projected/8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a-kube-api-access-rxpgr\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw\" (UID: \"8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:11.678213 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.678139    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:11.807494 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:11.807469    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"]
May 26 11:32:11.810187 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:32:11.810158    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5ba27b_9dc7_47a1_a92d_4a5f01c2067a.slice/crio-555dc68314ae171b5798952354979fd92885a4991f9ad06bc0f6fb4e774f76b6 WatchSource:0}: Error finding container 555dc68314ae171b5798952354979fd92885a4991f9ad06bc0f6fb4e774f76b6: Status 404 returned error can't find the container with id 555dc68314ae171b5798952354979fd92885a4991f9ad06bc0f6fb4e774f76b6
May 26 11:32:12.335976 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:12.335900    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw" event={"ID":"8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a","Type":"ContainerStarted","Data":"555dc68314ae171b5798952354979fd92885a4991f9ad06bc0f6fb4e774f76b6"}
May 26 11:32:18.138973 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.138941    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-5d9wh"]
May 26 11:32:18.141165 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.141144    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.143671 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.143648    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
May 26 11:32:18.144282 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.144266    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
May 26 11:32:18.144835 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.144821    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-bjdjj\""
May 26 11:32:18.154765 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.154745    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-5d9wh"]
May 26 11:32:18.232884 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.232851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cw6g\" (UniqueName: \"kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-kube-api-access-8cw6g\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.232884 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.232891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.232884 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.232919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/ea0b2342-e58b-4d6e-80ec-db8afa183077-cabundle0\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.333921 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.333884    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cw6g\" (UniqueName: \"kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-kube-api-access-8cw6g\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.334112 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.333959    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.334112 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.333987    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/ea0b2342-e58b-4d6e-80ec-db8afa183077-cabundle0\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.334218 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.334111    2563 projected.go:264] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
May 26 11:32:18.334218 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.334139    2563 secret.go:281] references non-existent secret key: ca.crt
May 26 11:32:18.334218 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.334148    2563 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 26 11:32:18.334218 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.334164    2563 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-5d9wh: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
May 26 11:32:18.334418 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.334255    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates podName:ea0b2342-e58b-4d6e-80ec-db8afa183077 nodeName:}" failed. No retries permitted until 2026-05-26 11:32:18.834235862 +0000 UTC m=+437.473996612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates") pod "keda-operator-ffbb595cb-5d9wh" (UID: "ea0b2342-e58b-4d6e-80ec-db8afa183077") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
May 26 11:32:18.334781 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.334761    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/ea0b2342-e58b-4d6e-80ec-db8afa183077-cabundle0\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.342588 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.342564    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cw6g\" (UniqueName: \"kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-kube-api-access-8cw6g\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.358879 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.358850    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw" event={"ID":"8e5ba27b-9dc7-47a1-a92d-4a5f01c2067a","Type":"ContainerStarted","Data":"4521942ba42c613e5f9a71ba51370451d1f8db9740fa910e280e32c5e6bd81f4"}
May 26 11:32:18.359013 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.358952    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:18.385131 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.385061    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw" podStartSLOduration=1.606650796 podStartE2EDuration="7.385042519s" podCreationTimestamp="2026-05-26 11:32:11 +0000 UTC" firstStartedPulling="2026-05-26 11:32:11.811849754 +0000 UTC m=+430.451610498" lastFinishedPulling="2026-05-26 11:32:17.590241477 +0000 UTC m=+436.230002221" observedRunningTime="2026-05-26 11:32:18.38187974 +0000 UTC m=+437.021640498" watchObservedRunningTime="2026-05-26 11:32:18.385042519 +0000 UTC m=+437.024803285"
May 26 11:32:18.480672 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.480585    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"]
May 26 11:32:18.482888 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.482866    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:18.485313 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.485285    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
May 26 11:32:18.493041 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.493016    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"]
May 26 11:32:18.535646 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.535615    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch2m2\" (UniqueName: \"kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-kube-api-access-ch2m2\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:18.535756 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.535659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/bcee8441-ba29-4aaf-a51e-44e9ef333996-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:18.535806 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.535783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:18.636852 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.636814    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ch2m2\" (UniqueName: \"kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-kube-api-access-ch2m2\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:18.636852 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.636854    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/bcee8441-ba29-4aaf-a51e-44e9ef333996-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:18.637064 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.636904    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:18.637064 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.637039    2563 secret.go:281] references non-existent secret key: tls.crt
May 26 11:32:18.637064 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.637054    2563 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 26 11:32:18.637179 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.637071    2563 projected.go:264] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
May 26 11:32:18.637179 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.637089    2563 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
May 26 11:32:18.637179 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.637161    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates podName:bcee8441-ba29-4aaf-a51e-44e9ef333996 nodeName:}" failed. No retries permitted until 2026-05-26 11:32:19.137142893 +0000 UTC m=+437.776903638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates") pod "keda-metrics-apiserver-7c9f485588-xs27s" (UID: "bcee8441-ba29-4aaf-a51e-44e9ef333996") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
May 26 11:32:18.637359 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.637339    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/bcee8441-ba29-4aaf-a51e-44e9ef333996-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:18.650749 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.650720    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch2m2\" (UniqueName: \"kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-kube-api-access-ch2m2\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:18.809334 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.809301    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-9fr2w"]
May 26 11:32:18.811701 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.811655    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:18.814058 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.814035    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
May 26 11:32:18.820776 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.820752    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-9fr2w"]
May 26 11:32:18.838332 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.838291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25kq\" (UniqueName: \"kubernetes.io/projected/dfdc4bd4-d28f-4723-88f8-5cb9f58694cb-kube-api-access-b25kq\") pod \"keda-admission-cf49989db-9fr2w\" (UID: \"dfdc4bd4-d28f-4723-88f8-5cb9f58694cb\") " pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:18.838454 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.838423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dfdc4bd4-d28f-4723-88f8-5cb9f58694cb-certificates\") pod \"keda-admission-cf49989db-9fr2w\" (UID: \"dfdc4bd4-d28f-4723-88f8-5cb9f58694cb\") " pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:18.838526 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.838513    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:18.838651 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.838627    2563 secret.go:281] references non-existent secret key: ca.crt
May 26 11:32:18.838651 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.838650    2563 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 26 11:32:18.838812 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.838661    2563 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-5d9wh: references non-existent secret key: ca.crt
May 26 11:32:18.838812 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:18.838722    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates podName:ea0b2342-e58b-4d6e-80ec-db8afa183077 nodeName:}" failed. No retries permitted until 2026-05-26 11:32:19.838705061 +0000 UTC m=+438.478465807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates") pod "keda-operator-ffbb595cb-5d9wh" (UID: "ea0b2342-e58b-4d6e-80ec-db8afa183077") : references non-existent secret key: ca.crt
May 26 11:32:18.939822 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.939788    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b25kq\" (UniqueName: \"kubernetes.io/projected/dfdc4bd4-d28f-4723-88f8-5cb9f58694cb-kube-api-access-b25kq\") pod \"keda-admission-cf49989db-9fr2w\" (UID: \"dfdc4bd4-d28f-4723-88f8-5cb9f58694cb\") " pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:18.940062 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.939829    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dfdc4bd4-d28f-4723-88f8-5cb9f58694cb-certificates\") pod \"keda-admission-cf49989db-9fr2w\" (UID: \"dfdc4bd4-d28f-4723-88f8-5cb9f58694cb\") " pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:18.942289 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.942268    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dfdc4bd4-d28f-4723-88f8-5cb9f58694cb-certificates\") pod \"keda-admission-cf49989db-9fr2w\" (UID: \"dfdc4bd4-d28f-4723-88f8-5cb9f58694cb\") " pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:18.948042 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:18.948015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25kq\" (UniqueName: \"kubernetes.io/projected/dfdc4bd4-d28f-4723-88f8-5cb9f58694cb-kube-api-access-b25kq\") pod \"keda-admission-cf49989db-9fr2w\" (UID: \"dfdc4bd4-d28f-4723-88f8-5cb9f58694cb\") " pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:19.123071 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:19.122991    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:19.142180 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:19.142147    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:19.142572 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:19.142311    2563 secret.go:281] references non-existent secret key: tls.crt
May 26 11:32:19.142572 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:19.142334    2563 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 26 11:32:19.142572 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:19.142360    2563 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s: references non-existent secret key: tls.crt
May 26 11:32:19.142572 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:19.142429    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates podName:bcee8441-ba29-4aaf-a51e-44e9ef333996 nodeName:}" failed. No retries permitted until 2026-05-26 11:32:20.142406241 +0000 UTC m=+438.782166984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates") pod "keda-metrics-apiserver-7c9f485588-xs27s" (UID: "bcee8441-ba29-4aaf-a51e-44e9ef333996") : references non-existent secret key: tls.crt
May 26 11:32:19.249319 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:19.249289    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-9fr2w"]
May 26 11:32:19.251603 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:32:19.251574    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfdc4bd4_d28f_4723_88f8_5cb9f58694cb.slice/crio-375a747074b3d2712f0c48bb8f13581089d173a27f4aa8bb0f8c3c25940082be WatchSource:0}: Error finding container 375a747074b3d2712f0c48bb8f13581089d173a27f4aa8bb0f8c3c25940082be: Status 404 returned error can't find the container with id 375a747074b3d2712f0c48bb8f13581089d173a27f4aa8bb0f8c3c25940082be
May 26 11:32:19.363478 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:19.363442    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-9fr2w" event={"ID":"dfdc4bd4-d28f-4723-88f8-5cb9f58694cb","Type":"ContainerStarted","Data":"375a747074b3d2712f0c48bb8f13581089d173a27f4aa8bb0f8c3c25940082be"}
May 26 11:32:19.848446 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:19.848417    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:19.848597 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:19.848547    2563 secret.go:281] references non-existent secret key: ca.crt
May 26 11:32:19.848597 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:19.848559    2563 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 26 11:32:19.848597 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:19.848567    2563 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-5d9wh: references non-existent secret key: ca.crt
May 26 11:32:19.848752 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:19.848614    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates podName:ea0b2342-e58b-4d6e-80ec-db8afa183077 nodeName:}" failed. No retries permitted until 2026-05-26 11:32:21.848601279 +0000 UTC m=+440.488362023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates") pod "keda-operator-ffbb595cb-5d9wh" (UID: "ea0b2342-e58b-4d6e-80ec-db8afa183077") : references non-existent secret key: ca.crt
May 26 11:32:20.152179 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:20.152093    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:20.152569 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:20.152231    2563 secret.go:281] references non-existent secret key: tls.crt
May 26 11:32:20.152569 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:20.152250    2563 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 26 11:32:20.152569 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:20.152268    2563 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s: references non-existent secret key: tls.crt
May 26 11:32:20.152569 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:32:20.152327    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates podName:bcee8441-ba29-4aaf-a51e-44e9ef333996 nodeName:}" failed. No retries permitted until 2026-05-26 11:32:22.152311338 +0000 UTC m=+440.792072081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates") pod "keda-metrics-apiserver-7c9f485588-xs27s" (UID: "bcee8441-ba29-4aaf-a51e-44e9ef333996") : references non-existent secret key: tls.crt
May 26 11:32:21.370224 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:21.370185    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-9fr2w" event={"ID":"dfdc4bd4-d28f-4723-88f8-5cb9f58694cb","Type":"ContainerStarted","Data":"03a2d5c8bf88c20af7fbfbbdbd4c089dceccb24ec351357d8a2d3ecb43010d42"}
May 26 11:32:21.370637 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:21.370243    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:21.389687 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:21.389639    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-9fr2w" podStartSLOduration=1.951775623 podStartE2EDuration="3.389624036s" podCreationTimestamp="2026-05-26 11:32:18 +0000 UTC" firstStartedPulling="2026-05-26 11:32:19.252843543 +0000 UTC m=+437.892604286" lastFinishedPulling="2026-05-26 11:32:20.690691953 +0000 UTC m=+439.330452699" observedRunningTime="2026-05-26 11:32:21.387036592 +0000 UTC m=+440.026797357" watchObservedRunningTime="2026-05-26 11:32:21.389624036 +0000 UTC m=+440.029384800"
May 26 11:32:21.869604 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:21.869574    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:21.872094 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:21.872062    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ea0b2342-e58b-4d6e-80ec-db8afa183077-certificates\") pod \"keda-operator-ffbb595cb-5d9wh\" (UID: \"ea0b2342-e58b-4d6e-80ec-db8afa183077\") " pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:22.051455 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:22.051430    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:22.172018 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:22.171882    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:22.173706 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:22.173688    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-5d9wh"]
May 26 11:32:22.174416 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:22.174397    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bcee8441-ba29-4aaf-a51e-44e9ef333996-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xs27s\" (UID: \"bcee8441-ba29-4aaf-a51e-44e9ef333996\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:22.176010 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:32:22.175976    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0b2342_e58b_4d6e_80ec_db8afa183077.slice/crio-0bd42042403489d4c7166fc47f9cdc00e104196383aec77c05c2fd269e2aab0b WatchSource:0}: Error finding container 0bd42042403489d4c7166fc47f9cdc00e104196383aec77c05c2fd269e2aab0b: Status 404 returned error can't find the container with id 0bd42042403489d4c7166fc47f9cdc00e104196383aec77c05c2fd269e2aab0b
May 26 11:32:22.374067 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:22.374037    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-5d9wh" event={"ID":"ea0b2342-e58b-4d6e-80ec-db8afa183077","Type":"ContainerStarted","Data":"0bd42042403489d4c7166fc47f9cdc00e104196383aec77c05c2fd269e2aab0b"}
May 26 11:32:22.393890 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:22.393827    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:22.518061 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:22.518036    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"]
May 26 11:32:22.520471 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:32:22.520444    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcee8441_ba29_4aaf_a51e_44e9ef333996.slice/crio-c5a5934a8f9c6f060635c5d6662956354dfe1a82ec0cd1d7660e1189f3db485e WatchSource:0}: Error finding container c5a5934a8f9c6f060635c5d6662956354dfe1a82ec0cd1d7660e1189f3db485e: Status 404 returned error can't find the container with id c5a5934a8f9c6f060635c5d6662956354dfe1a82ec0cd1d7660e1189f3db485e
May 26 11:32:23.379225 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:23.379171    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s" event={"ID":"bcee8441-ba29-4aaf-a51e-44e9ef333996","Type":"ContainerStarted","Data":"c5a5934a8f9c6f060635c5d6662956354dfe1a82ec0cd1d7660e1189f3db485e"}
May 26 11:32:25.387449 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:25.387363    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s" event={"ID":"bcee8441-ba29-4aaf-a51e-44e9ef333996","Type":"ContainerStarted","Data":"6de9afe3b590f65b8f1a9429699836cbd37cd835e5d05ee5eb68f868eeae07a6"}
May 26 11:32:25.387886 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:25.387542    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:25.404710 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:25.404666    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s" podStartSLOduration=4.820927032 podStartE2EDuration="7.404653456s" podCreationTimestamp="2026-05-26 11:32:18 +0000 UTC" firstStartedPulling="2026-05-26 11:32:22.521829671 +0000 UTC m=+441.161590414" lastFinishedPulling="2026-05-26 11:32:25.105556095 +0000 UTC m=+443.745316838" observedRunningTime="2026-05-26 11:32:25.403683249 +0000 UTC m=+444.043444015" watchObservedRunningTime="2026-05-26 11:32:25.404653456 +0000 UTC m=+444.044414265"
May 26 11:32:27.395875 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:27.395842    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-5d9wh" event={"ID":"ea0b2342-e58b-4d6e-80ec-db8afa183077","Type":"ContainerStarted","Data":"3c75e21580cf394810e7edb395f9a44a8aa0859421f461513e89589b2461cde1"}
May 26 11:32:27.396248 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:27.395903    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:32:27.414300 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:27.414254    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-operator-ffbb595cb-5d9wh" podStartSLOduration=4.423455728 podStartE2EDuration="9.414240672s" podCreationTimestamp="2026-05-26 11:32:18 +0000 UTC" firstStartedPulling="2026-05-26 11:32:22.177302002 +0000 UTC m=+440.817062749" lastFinishedPulling="2026-05-26 11:32:27.168086951 +0000 UTC m=+445.807847693" observedRunningTime="2026-05-26 11:32:27.412308826 +0000 UTC m=+446.052069606" watchObservedRunningTime="2026-05-26 11:32:27.414240672 +0000 UTC m=+446.054001464"
May 26 11:32:36.395454 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:36.395426    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xs27s"
May 26 11:32:39.366021 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:39.365991    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-g8jlw"
May 26 11:32:42.377176 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:42.377140    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-9fr2w"
May 26 11:32:48.401173 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:32:48.401145    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-ffbb595cb-5d9wh"
May 26 11:33:24.633185 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.633155    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"]
May 26 11:33:24.636528 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.636503    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:24.638862 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.638834    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
May 26 11:33:24.638995 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.638876    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 26 11:33:24.638995 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.638963    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-zc68h\""
May 26 11:33:24.639718 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.639702    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 26 11:33:24.647122 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.647103    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"]
May 26 11:33:24.650396 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.650378    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"]
May 26 11:33:24.650510 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.650486    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:33:24.652862 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.652843    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
May 26 11:33:24.653446 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.653405    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-m4kvs\""
May 26 11:33:24.662801 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.662777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbqdc\" (UniqueName: \"kubernetes.io/projected/b21eac62-0551-4fc3-a34d-d10cf2a29f29-kube-api-access-sbqdc\") pod \"llmisvc-controller-manager-6b94ff949c-lmg2q\" (UID: \"b21eac62-0551-4fc3-a34d-d10cf2a29f29\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:33:24.662903 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.662821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b21eac62-0551-4fc3-a34d-d10cf2a29f29-cert\") pod \"llmisvc-controller-manager-6b94ff949c-lmg2q\" (UID: \"b21eac62-0551-4fc3-a34d-d10cf2a29f29\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:33:24.662903 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.662877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-cert\") pod \"kserve-controller-manager-7cd9b78f5d-xdhkl\" (UID: \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:24.663044 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.663008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wjjt\" (UniqueName: \"kubernetes.io/projected/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-kube-api-access-6wjjt\") pod \"kserve-controller-manager-7cd9b78f5d-xdhkl\" (UID: \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:24.664835 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.664817    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"]
May 26 11:33:24.764060 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.764029    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-cert\") pod \"kserve-controller-manager-7cd9b78f5d-xdhkl\" (UID: \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:24.764266 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.764076    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wjjt\" (UniqueName: \"kubernetes.io/projected/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-kube-api-access-6wjjt\") pod \"kserve-controller-manager-7cd9b78f5d-xdhkl\" (UID: \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:24.764266 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.764129    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbqdc\" (UniqueName: \"kubernetes.io/projected/b21eac62-0551-4fc3-a34d-d10cf2a29f29-kube-api-access-sbqdc\") pod \"llmisvc-controller-manager-6b94ff949c-lmg2q\" (UID: \"b21eac62-0551-4fc3-a34d-d10cf2a29f29\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:33:24.764266 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.764151    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b21eac62-0551-4fc3-a34d-d10cf2a29f29-cert\") pod \"llmisvc-controller-manager-6b94ff949c-lmg2q\" (UID: \"b21eac62-0551-4fc3-a34d-d10cf2a29f29\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:33:24.764266 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:33:24.764167    2563 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 26 11:33:24.764266 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:33:24.764242    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-cert podName:b2d24a4a-773c-4c4f-81da-1ff2ccc39c21 nodeName:}" failed. No retries permitted until 2026-05-26 11:33:25.264225187 +0000 UTC m=+503.903985931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-cert") pod "kserve-controller-manager-7cd9b78f5d-xdhkl" (UID: "b2d24a4a-773c-4c4f-81da-1ff2ccc39c21") : secret "kserve-webhook-server-cert" not found
May 26 11:33:24.766530 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.766488    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b21eac62-0551-4fc3-a34d-d10cf2a29f29-cert\") pod \"llmisvc-controller-manager-6b94ff949c-lmg2q\" (UID: \"b21eac62-0551-4fc3-a34d-d10cf2a29f29\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:33:24.779181 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.779154    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbqdc\" (UniqueName: \"kubernetes.io/projected/b21eac62-0551-4fc3-a34d-d10cf2a29f29-kube-api-access-sbqdc\") pod \"llmisvc-controller-manager-6b94ff949c-lmg2q\" (UID: \"b21eac62-0551-4fc3-a34d-d10cf2a29f29\") " pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:33:24.779301 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.779158    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wjjt\" (UniqueName: \"kubernetes.io/projected/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-kube-api-access-6wjjt\") pod \"kserve-controller-manager-7cd9b78f5d-xdhkl\" (UID: \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:24.962637 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:24.962533    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:33:25.085232 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:25.085208    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"]
May 26 11:33:25.087489 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:33:25.087466    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb21eac62_0551_4fc3_a34d_d10cf2a29f29.slice/crio-24d7452ef0448ea97ef2b8c5cfca29e2debc1adf52f41eb3a0fe1ad954a45b55 WatchSource:0}: Error finding container 24d7452ef0448ea97ef2b8c5cfca29e2debc1adf52f41eb3a0fe1ad954a45b55: Status 404 returned error can't find the container with id 24d7452ef0448ea97ef2b8c5cfca29e2debc1adf52f41eb3a0fe1ad954a45b55
May 26 11:33:25.269414 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:25.269308    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-cert\") pod \"kserve-controller-manager-7cd9b78f5d-xdhkl\" (UID: \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:25.271617 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:25.271599    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-cert\") pod \"kserve-controller-manager-7cd9b78f5d-xdhkl\" (UID: \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:25.548200 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:25.548168    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:25.593862 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:25.593825    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q" event={"ID":"b21eac62-0551-4fc3-a34d-d10cf2a29f29","Type":"ContainerStarted","Data":"24d7452ef0448ea97ef2b8c5cfca29e2debc1adf52f41eb3a0fe1ad954a45b55"}
May 26 11:33:25.675718 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:25.675674    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"]
May 26 11:33:25.677667 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:33:25.677641    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d24a4a_773c_4c4f_81da_1ff2ccc39c21.slice/crio-309231b9cefee781bf7a69ae2a2dfa4d3499f286bf62964d9a11d0e92da47952 WatchSource:0}: Error finding container 309231b9cefee781bf7a69ae2a2dfa4d3499f286bf62964d9a11d0e92da47952: Status 404 returned error can't find the container with id 309231b9cefee781bf7a69ae2a2dfa4d3499f286bf62964d9a11d0e92da47952
May 26 11:33:26.599788 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:26.599738    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl" event={"ID":"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21","Type":"ContainerStarted","Data":"309231b9cefee781bf7a69ae2a2dfa4d3499f286bf62964d9a11d0e92da47952"}
May 26 11:33:29.611710 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:29.611671    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl" event={"ID":"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21","Type":"ContainerStarted","Data":"605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1"}
May 26 11:33:29.612231 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:29.611738    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:33:29.618448 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:29.618421    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q" event={"ID":"b21eac62-0551-4fc3-a34d-d10cf2a29f29","Type":"ContainerStarted","Data":"be5168fb5ae31b3d4666910f76077274972831fe5302a59144899e08a2a735a2"}
May 26 11:33:29.618585 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:29.618573    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:33:29.632420 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:29.632377    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl" podStartSLOduration=2.533420976 podStartE2EDuration="5.632366324s" podCreationTimestamp="2026-05-26 11:33:24 +0000 UTC" firstStartedPulling="2026-05-26 11:33:25.678899004 +0000 UTC m=+504.318659748" lastFinishedPulling="2026-05-26 11:33:28.77784435 +0000 UTC m=+507.417605096" observedRunningTime="2026-05-26 11:33:29.630458118 +0000 UTC m=+508.270218912" watchObservedRunningTime="2026-05-26 11:33:29.632366324 +0000 UTC m=+508.272127126"
May 26 11:33:29.651585 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:29.651546    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q" podStartSLOduration=2.009676192 podStartE2EDuration="5.651533301s" podCreationTimestamp="2026-05-26 11:33:24 +0000 UTC" firstStartedPulling="2026-05-26 11:33:25.088763715 +0000 UTC m=+503.728524458" lastFinishedPulling="2026-05-26 11:33:28.730620812 +0000 UTC m=+507.370381567" observedRunningTime="2026-05-26 11:33:29.648987874 +0000 UTC m=+508.288748640" watchObservedRunningTime="2026-05-26 11:33:29.651533301 +0000 UTC m=+508.291294091"
May 26 11:33:35.379806 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.379772    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d77b84c6-bwjz6"]
May 26 11:33:35.383275 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.383258    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.400057 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.400031    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d77b84c6-bwjz6"]
May 26 11:33:35.453824 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.453796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-console-config\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.453984 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.453851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-service-ca\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.453984 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.453893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-oauth-serving-cert\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.453984 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.453960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/409d8430-5b0c-4ba9-9c99-21a0554db548-console-serving-cert\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.454094 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.453987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/409d8430-5b0c-4ba9-9c99-21a0554db548-console-oauth-config\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.454094 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.454021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-trusted-ca-bundle\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.454094 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.454037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8blj9\" (UniqueName: \"kubernetes.io/projected/409d8430-5b0c-4ba9-9c99-21a0554db548-kube-api-access-8blj9\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.554987 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.554950    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-service-ca\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.555141 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.554992    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-oauth-serving-cert\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.555141 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.555020    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/409d8430-5b0c-4ba9-9c99-21a0554db548-console-serving-cert\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.555141 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.555049    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/409d8430-5b0c-4ba9-9c99-21a0554db548-console-oauth-config\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.555141 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.555097    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-trusted-ca-bundle\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.555141 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.555123    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8blj9\" (UniqueName: \"kubernetes.io/projected/409d8430-5b0c-4ba9-9c99-21a0554db548-kube-api-access-8blj9\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.555380 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.555160    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-console-config\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.555791 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.555764    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-service-ca\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.555911 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.555857    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-oauth-serving-cert\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.555911 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.555826    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-console-config\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.556041 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.555994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/409d8430-5b0c-4ba9-9c99-21a0554db548-trusted-ca-bundle\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.557967 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.557926    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/409d8430-5b0c-4ba9-9c99-21a0554db548-console-oauth-config\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.558171 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.558153    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/409d8430-5b0c-4ba9-9c99-21a0554db548-console-serving-cert\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.564205 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.564180    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8blj9\" (UniqueName: \"kubernetes.io/projected/409d8430-5b0c-4ba9-9c99-21a0554db548-kube-api-access-8blj9\") pod \"console-6d77b84c6-bwjz6\" (UID: \"409d8430-5b0c-4ba9-9c99-21a0554db548\") " pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.692767 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.692691    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:35.822371 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:35.822346    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d77b84c6-bwjz6"]
May 26 11:33:35.824537 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:33:35.824509    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409d8430_5b0c_4ba9_9c99_21a0554db548.slice/crio-9068bde001cf3663ac4abf2e3bc395bdde757e7aa1d7568c7fec4cb53f3dd8ea WatchSource:0}: Error finding container 9068bde001cf3663ac4abf2e3bc395bdde757e7aa1d7568c7fec4cb53f3dd8ea: Status 404 returned error can't find the container with id 9068bde001cf3663ac4abf2e3bc395bdde757e7aa1d7568c7fec4cb53f3dd8ea
May 26 11:33:36.642628 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:36.642592    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d77b84c6-bwjz6" event={"ID":"409d8430-5b0c-4ba9-9c99-21a0554db548","Type":"ContainerStarted","Data":"529d249fe85afe9fd50c3dc8399fcc70123343416388f51ce8cdeaeb16266cf2"}
May 26 11:33:36.642628 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:36.642630    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d77b84c6-bwjz6" event={"ID":"409d8430-5b0c-4ba9-9c99-21a0554db548","Type":"ContainerStarted","Data":"9068bde001cf3663ac4abf2e3bc395bdde757e7aa1d7568c7fec4cb53f3dd8ea"}
May 26 11:33:36.662784 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:36.662745    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d77b84c6-bwjz6" podStartSLOduration=1.662732848 podStartE2EDuration="1.662732848s" podCreationTimestamp="2026-05-26 11:33:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:33:36.661891805 +0000 UTC m=+515.301652571" watchObservedRunningTime="2026-05-26 11:33:36.662732848 +0000 UTC m=+515.302493612"
May 26 11:33:45.692986 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:45.692903    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:45.693330 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:45.693042    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:45.697598 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:45.697576    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:46.686150 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:46.686125    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d77b84c6-bwjz6"
May 26 11:33:46.732915 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:33:46.732884    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-547897d6c-nlm5s"]
May 26 11:34:00.623907 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:00.623876    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-6b94ff949c-lmg2q"
May 26 11:34:00.627119 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:00.627097    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:34:01.992476 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:01.992449    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"]
May 26 11:34:01.992941 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:01.992630    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl" podUID="b2d24a4a-773c-4c4f-81da-1ff2ccc39c21" containerName="manager" containerID="cri-o://605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1" gracePeriod=10
May 26 11:34:02.020319 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.020290    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"]
May 26 11:34:02.067708 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.067686    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"]
May 26 11:34:02.067858 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.067809    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:34:02.173887 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.173853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4mm\" (UniqueName: \"kubernetes.io/projected/d7ad6da2-2b4c-426c-a0c0-9fcce397e850-kube-api-access-zv4mm\") pod \"kserve-controller-manager-7cd9b78f5d-9tsnv\" (UID: \"d7ad6da2-2b4c-426c-a0c0-9fcce397e850\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:34:02.174045 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.173911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7ad6da2-2b4c-426c-a0c0-9fcce397e850-cert\") pod \"kserve-controller-manager-7cd9b78f5d-9tsnv\" (UID: \"d7ad6da2-2b4c-426c-a0c0-9fcce397e850\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:34:02.251521 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.251465    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:34:02.275162 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.275136    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4mm\" (UniqueName: \"kubernetes.io/projected/d7ad6da2-2b4c-426c-a0c0-9fcce397e850-kube-api-access-zv4mm\") pod \"kserve-controller-manager-7cd9b78f5d-9tsnv\" (UID: \"d7ad6da2-2b4c-426c-a0c0-9fcce397e850\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:34:02.275307 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.275187    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7ad6da2-2b4c-426c-a0c0-9fcce397e850-cert\") pod \"kserve-controller-manager-7cd9b78f5d-9tsnv\" (UID: \"d7ad6da2-2b4c-426c-a0c0-9fcce397e850\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:34:02.277657 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.277631    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7ad6da2-2b4c-426c-a0c0-9fcce397e850-cert\") pod \"kserve-controller-manager-7cd9b78f5d-9tsnv\" (UID: \"d7ad6da2-2b4c-426c-a0c0-9fcce397e850\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:34:02.284051 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.284029    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4mm\" (UniqueName: \"kubernetes.io/projected/d7ad6da2-2b4c-426c-a0c0-9fcce397e850-kube-api-access-zv4mm\") pod \"kserve-controller-manager-7cd9b78f5d-9tsnv\" (UID: \"d7ad6da2-2b4c-426c-a0c0-9fcce397e850\") " pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:34:02.376158 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.376130    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-cert\") pod \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\" (UID: \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\") "
May 26 11:34:02.376300 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.376205    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wjjt\" (UniqueName: \"kubernetes.io/projected/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-kube-api-access-6wjjt\") pod \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\" (UID: \"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21\") "
May 26 11:34:02.378090 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.378060    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-cert" (OuterVolumeSpecName: "cert") pod "b2d24a4a-773c-4c4f-81da-1ff2ccc39c21" (UID: "b2d24a4a-773c-4c4f-81da-1ff2ccc39c21"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:34:02.378183 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.378145    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-kube-api-access-6wjjt" (OuterVolumeSpecName: "kube-api-access-6wjjt") pod "b2d24a4a-773c-4c4f-81da-1ff2ccc39c21" (UID: "b2d24a4a-773c-4c4f-81da-1ff2ccc39c21"). InnerVolumeSpecName "kube-api-access-6wjjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 11:34:02.448291 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.448264    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:34:02.477406 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.477379    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wjjt\" (UniqueName: \"kubernetes.io/projected/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-kube-api-access-6wjjt\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:34:02.477406 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.477407    2563 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:34:02.582232 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.582208    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"]
May 26 11:34:02.584369 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:34:02.584347    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ad6da2_2b4c_426c_a0c0_9fcce397e850.slice/crio-b455bf0bbeb2d55e63fd742518f92f262dca7d58c90eaf82876f6c97d89a923a WatchSource:0}: Error finding container b455bf0bbeb2d55e63fd742518f92f262dca7d58c90eaf82876f6c97d89a923a: Status 404 returned error can't find the container with id b455bf0bbeb2d55e63fd742518f92f262dca7d58c90eaf82876f6c97d89a923a
May 26 11:34:02.731654 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.731624    2563 generic.go:358] "Generic (PLEG): container finished" podID="b2d24a4a-773c-4c4f-81da-1ff2ccc39c21" containerID="605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1" exitCode=0
May 26 11:34:02.731792 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.731687    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"
May 26 11:34:02.731792 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.731704    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl" event={"ID":"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21","Type":"ContainerDied","Data":"605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1"}
May 26 11:34:02.731792 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.731736    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd9b78f5d-xdhkl" event={"ID":"b2d24a4a-773c-4c4f-81da-1ff2ccc39c21","Type":"ContainerDied","Data":"309231b9cefee781bf7a69ae2a2dfa4d3499f286bf62964d9a11d0e92da47952"}
May 26 11:34:02.731792 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.731751    2563 scope.go:117] "RemoveContainer" containerID="605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1"
May 26 11:34:02.732950 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.732912    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv" event={"ID":"d7ad6da2-2b4c-426c-a0c0-9fcce397e850","Type":"ContainerStarted","Data":"b455bf0bbeb2d55e63fd742518f92f262dca7d58c90eaf82876f6c97d89a923a"}
May 26 11:34:02.739868 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.739854    2563 scope.go:117] "RemoveContainer" containerID="605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1"
May 26 11:34:02.740149 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:34:02.740126    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1\": container with ID starting with 605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1 not found: ID does not exist" containerID="605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1"
May 26 11:34:02.740240 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.740154    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1"} err="failed to get container status \"605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1\": rpc error: code = NotFound desc = could not find container \"605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1\": container with ID starting with 605fb692e823f35ee6215c0fc436b55198032b4d8a8397636b5c2d5a77e1c5f1 not found: ID does not exist"
May 26 11:34:02.757746 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.757723    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"]
May 26 11:34:02.762142 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:02.762120    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7cd9b78f5d-xdhkl"]
May 26 11:34:03.737829 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:03.737795    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv" event={"ID":"d7ad6da2-2b4c-426c-a0c0-9fcce397e850","Type":"ContainerStarted","Data":"81c6afb7760a2514b52a755850072e939e81169263cb715d20515645786fac99"}
May 26 11:34:03.738219 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:03.737848    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:34:03.757063 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:03.757016    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv" podStartSLOduration=1.469153498 podStartE2EDuration="1.75700349s" podCreationTimestamp="2026-05-26 11:34:02 +0000 UTC" firstStartedPulling="2026-05-26 11:34:02.585673005 +0000 UTC m=+541.225433749" lastFinishedPulling="2026-05-26 11:34:02.873522982 +0000 UTC m=+541.513283741" observedRunningTime="2026-05-26 11:34:03.755367133 +0000 UTC m=+542.395127897" watchObservedRunningTime="2026-05-26 11:34:03.75700349 +0000 UTC m=+542.396764265"
May 26 11:34:03.976569 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:03.976536    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d24a4a-773c-4c4f-81da-1ff2ccc39c21" path="/var/lib/kubelet/pods/b2d24a4a-773c-4c4f-81da-1ff2ccc39c21/volumes"
May 26 11:34:11.753452 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:11.753395    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-547897d6c-nlm5s" podUID="81feaac0-7cba-41d5-9e1f-e9566083e16c" containerName="console" containerID="cri-o://e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1" gracePeriod=15
May 26 11:34:11.998264 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:11.998238    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-547897d6c-nlm5s_81feaac0-7cba-41d5-9e1f-e9566083e16c/console/0.log"
May 26 11:34:11.998364 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:11.998294    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:34:12.157252 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157220    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-oauth-serving-cert\") pod \"81feaac0-7cba-41d5-9e1f-e9566083e16c\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") "
May 26 11:34:12.157444 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157272    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t75z4\" (UniqueName: \"kubernetes.io/projected/81feaac0-7cba-41d5-9e1f-e9566083e16c-kube-api-access-t75z4\") pod \"81feaac0-7cba-41d5-9e1f-e9566083e16c\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") "
May 26 11:34:12.157444 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157308    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-trusted-ca-bundle\") pod \"81feaac0-7cba-41d5-9e1f-e9566083e16c\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") "
May 26 11:34:12.157444 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157332    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-oauth-config\") pod \"81feaac0-7cba-41d5-9e1f-e9566083e16c\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") "
May 26 11:34:12.157444 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157400    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-config\") pod \"81feaac0-7cba-41d5-9e1f-e9566083e16c\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") "
May 26 11:34:12.157444 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157425    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-service-ca\") pod \"81feaac0-7cba-41d5-9e1f-e9566083e16c\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") "
May 26 11:34:12.157705 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157479    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-serving-cert\") pod \"81feaac0-7cba-41d5-9e1f-e9566083e16c\" (UID: \"81feaac0-7cba-41d5-9e1f-e9566083e16c\") "
May 26 11:34:12.157705 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157629    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81feaac0-7cba-41d5-9e1f-e9566083e16c" (UID: "81feaac0-7cba-41d5-9e1f-e9566083e16c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:34:12.157835 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157763    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-oauth-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:34:12.158013 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.157990    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "81feaac0-7cba-41d5-9e1f-e9566083e16c" (UID: "81feaac0-7cba-41d5-9e1f-e9566083e16c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:34:12.158133 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.158109    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-config" (OuterVolumeSpecName: "console-config") pod "81feaac0-7cba-41d5-9e1f-e9566083e16c" (UID: "81feaac0-7cba-41d5-9e1f-e9566083e16c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:34:12.158203 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.158111    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-service-ca" (OuterVolumeSpecName: "service-ca") pod "81feaac0-7cba-41d5-9e1f-e9566083e16c" (UID: "81feaac0-7cba-41d5-9e1f-e9566083e16c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:34:12.159719 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.159698    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81feaac0-7cba-41d5-9e1f-e9566083e16c-kube-api-access-t75z4" (OuterVolumeSpecName: "kube-api-access-t75z4") pod "81feaac0-7cba-41d5-9e1f-e9566083e16c" (UID: "81feaac0-7cba-41d5-9e1f-e9566083e16c"). InnerVolumeSpecName "kube-api-access-t75z4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 11:34:12.159817 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.159702    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81feaac0-7cba-41d5-9e1f-e9566083e16c" (UID: "81feaac0-7cba-41d5-9e1f-e9566083e16c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:34:12.159817 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.159778    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81feaac0-7cba-41d5-9e1f-e9566083e16c" (UID: "81feaac0-7cba-41d5-9e1f-e9566083e16c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:34:12.258425 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.258400    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:34:12.258425 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.258422    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-service-ca\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:34:12.258554 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.258431    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-serving-cert\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:34:12.258554 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.258440    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t75z4\" (UniqueName: \"kubernetes.io/projected/81feaac0-7cba-41d5-9e1f-e9566083e16c-kube-api-access-t75z4\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:34:12.258554 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.258450    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81feaac0-7cba-41d5-9e1f-e9566083e16c-trusted-ca-bundle\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:34:12.258554 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.258460    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81feaac0-7cba-41d5-9e1f-e9566083e16c-console-oauth-config\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:34:12.768077 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.768049    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-547897d6c-nlm5s_81feaac0-7cba-41d5-9e1f-e9566083e16c/console/0.log"
May 26 11:34:12.768470 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.768091    2563 generic.go:358] "Generic (PLEG): container finished" podID="81feaac0-7cba-41d5-9e1f-e9566083e16c" containerID="e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1" exitCode=2
May 26 11:34:12.768470 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.768123    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547897d6c-nlm5s" event={"ID":"81feaac0-7cba-41d5-9e1f-e9566083e16c","Type":"ContainerDied","Data":"e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1"}
May 26 11:34:12.768470 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.768160    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547897d6c-nlm5s" event={"ID":"81feaac0-7cba-41d5-9e1f-e9566083e16c","Type":"ContainerDied","Data":"50646e5dcd8168d64431dbdef0a855f257813b9a03c3dfb31f0f0982d3de2730"}
May 26 11:34:12.768470 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.768175    2563 scope.go:117] "RemoveContainer" containerID="e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1"
May 26 11:34:12.768470 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.768187    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547897d6c-nlm5s"
May 26 11:34:12.776685 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.776666    2563 scope.go:117] "RemoveContainer" containerID="e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1"
May 26 11:34:12.776975 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:34:12.776952    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1\": container with ID starting with e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1 not found: ID does not exist" containerID="e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1"
May 26 11:34:12.777029 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.776987    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1"} err="failed to get container status \"e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1\": rpc error: code = NotFound desc = could not find container \"e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1\": container with ID starting with e743da59c86be4b37e5180644ff19ec8a4c276f59b2d086e09b039812419a9e1 not found: ID does not exist"
May 26 11:34:12.789948 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.789907    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-547897d6c-nlm5s"]
May 26 11:34:12.793777 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:12.793758    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-547897d6c-nlm5s"]
May 26 11:34:13.975983 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:13.975952    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81feaac0-7cba-41d5-9e1f-e9566083e16c" path="/var/lib/kubelet/pods/81feaac0-7cba-41d5-9e1f-e9566083e16c/volumes"
May 26 11:34:34.745173 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:34:34.745141    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7cd9b78f5d-9tsnv"
May 26 11:35:03.163635 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:35:03.163615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:35:03.164302 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:35:03.164282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:35:03.169817 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:35:03.169797    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:35:03.170219 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:35:03.170197    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:38:29.593545 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.593398    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"]
May 26 11:38:29.594136 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.593889    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81feaac0-7cba-41d5-9e1f-e9566083e16c" containerName="console"
May 26 11:38:29.594136 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.593909    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="81feaac0-7cba-41d5-9e1f-e9566083e16c" containerName="console"
May 26 11:38:29.594136 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.593963    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d24a4a-773c-4c4f-81da-1ff2ccc39c21" containerName="manager"
May 26 11:38:29.594136 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.593972    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d24a4a-773c-4c4f-81da-1ff2ccc39c21" containerName="manager"
May 26 11:38:29.594136 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.594052    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2d24a4a-773c-4c4f-81da-1ff2ccc39c21" containerName="manager"
May 26 11:38:29.594136 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.594071    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="81feaac0-7cba-41d5-9e1f-e9566083e16c" containerName="console"
May 26 11:38:29.597044 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.597024    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:29.599520 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.599495    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-wtv9z\""
May 26 11:38:29.599653 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.599555    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-ea074-serving-cert\""
May 26 11:38:29.599653 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.599636    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 26 11:38:29.600318 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.600294    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-ea074-kube-rbac-proxy-sar-config\""
May 26 11:38:29.605198 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.605158    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"]
May 26 11:38:29.716946 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.716889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7810e0a-836d-42d6-a847-a6bebe271171-proxy-tls\") pod \"model-chainer-raw-ea074-5dbf4895df-jgrqc\" (UID: \"c7810e0a-836d-42d6-a847-a6bebe271171\") " pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:29.717098 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.717011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7810e0a-836d-42d6-a847-a6bebe271171-openshift-service-ca-bundle\") pod \"model-chainer-raw-ea074-5dbf4895df-jgrqc\" (UID: \"c7810e0a-836d-42d6-a847-a6bebe271171\") " pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:29.818096 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.818061    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7810e0a-836d-42d6-a847-a6bebe271171-proxy-tls\") pod \"model-chainer-raw-ea074-5dbf4895df-jgrqc\" (UID: \"c7810e0a-836d-42d6-a847-a6bebe271171\") " pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:29.818249 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.818122    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7810e0a-836d-42d6-a847-a6bebe271171-openshift-service-ca-bundle\") pod \"model-chainer-raw-ea074-5dbf4895df-jgrqc\" (UID: \"c7810e0a-836d-42d6-a847-a6bebe271171\") " pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:29.818698 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.818672    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7810e0a-836d-42d6-a847-a6bebe271171-openshift-service-ca-bundle\") pod \"model-chainer-raw-ea074-5dbf4895df-jgrqc\" (UID: \"c7810e0a-836d-42d6-a847-a6bebe271171\") " pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:29.820411 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.820390    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7810e0a-836d-42d6-a847-a6bebe271171-proxy-tls\") pod \"model-chainer-raw-ea074-5dbf4895df-jgrqc\" (UID: \"c7810e0a-836d-42d6-a847-a6bebe271171\") " pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:29.910639 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:29.910557    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:30.034251 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:30.034224    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"]
May 26 11:38:30.036329 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:38:30.036301    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7810e0a_836d_42d6_a847_a6bebe271171.slice/crio-ca3d7e6b58825d2ade37a2ff128a2a3fd11f4465a554fd00d711ba091a098ccd WatchSource:0}: Error finding container ca3d7e6b58825d2ade37a2ff128a2a3fd11f4465a554fd00d711ba091a098ccd: Status 404 returned error can't find the container with id ca3d7e6b58825d2ade37a2ff128a2a3fd11f4465a554fd00d711ba091a098ccd
May 26 11:38:30.038205 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:30.038190    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 11:38:30.618992 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:30.618956    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" event={"ID":"c7810e0a-836d-42d6-a847-a6bebe271171","Type":"ContainerStarted","Data":"ca3d7e6b58825d2ade37a2ff128a2a3fd11f4465a554fd00d711ba091a098ccd"}
May 26 11:38:32.627285 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:32.627248    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" event={"ID":"c7810e0a-836d-42d6-a847-a6bebe271171","Type":"ContainerStarted","Data":"0cf688484fc9d0bba001a0b03764f6fae966d4dc091c5671d8449d735e9e0312"}
May 26 11:38:32.627742 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:32.627445    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:32.644157 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:32.644111    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" podStartSLOduration=1.682793707 podStartE2EDuration="3.644098878s" podCreationTimestamp="2026-05-26 11:38:29 +0000 UTC" firstStartedPulling="2026-05-26 11:38:30.038313302 +0000 UTC m=+808.678074045" lastFinishedPulling="2026-05-26 11:38:31.999618474 +0000 UTC m=+810.639379216" observedRunningTime="2026-05-26 11:38:32.642601513 +0000 UTC m=+811.282362278" watchObservedRunningTime="2026-05-26 11:38:32.644098878 +0000 UTC m=+811.283859642"
May 26 11:38:38.636400 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:38.636372    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:39.646036 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:39.646005    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"]
May 26 11:38:39.646415 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:39.646200    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074" containerID="cri-o://0cf688484fc9d0bba001a0b03764f6fae966d4dc091c5671d8449d735e9e0312" gracePeriod=30
May 26 11:38:43.634818 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:43.634773    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:38:48.634979 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:48.634924    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:38:53.634579 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:53.634533    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:38:53.634967 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:53.634636    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:38:58.635171 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:38:58.635129    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:39:03.634568 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:03.634523    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:39:08.635752 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:08.635710    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:39:09.675955 ip-10-0-130-251 kubenswrapper[2563]: E0526 11:39:09.675902    2563 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7810e0a_836d_42d6_a847_a6bebe271171.slice/crio-conmon-0cf688484fc9d0bba001a0b03764f6fae966d4dc091c5671d8449d735e9e0312.scope\": RecentStats: unable to find data in memory cache]"
May 26 11:39:09.753425 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:09.753389    2563 generic.go:358] "Generic (PLEG): container finished" podID="c7810e0a-836d-42d6-a847-a6bebe271171" containerID="0cf688484fc9d0bba001a0b03764f6fae966d4dc091c5671d8449d735e9e0312" exitCode=0
May 26 11:39:09.753577 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:09.753462    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" event={"ID":"c7810e0a-836d-42d6-a847-a6bebe271171","Type":"ContainerDied","Data":"0cf688484fc9d0bba001a0b03764f6fae966d4dc091c5671d8449d735e9e0312"}
May 26 11:39:10.287489 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.287465    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:39:10.375399 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.375354    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7810e0a-836d-42d6-a847-a6bebe271171-proxy-tls\") pod \"c7810e0a-836d-42d6-a847-a6bebe271171\" (UID: \"c7810e0a-836d-42d6-a847-a6bebe271171\") "
May 26 11:39:10.375575 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.375435    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7810e0a-836d-42d6-a847-a6bebe271171-openshift-service-ca-bundle\") pod \"c7810e0a-836d-42d6-a847-a6bebe271171\" (UID: \"c7810e0a-836d-42d6-a847-a6bebe271171\") "
May 26 11:39:10.375782 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.375759    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7810e0a-836d-42d6-a847-a6bebe271171-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c7810e0a-836d-42d6-a847-a6bebe271171" (UID: "c7810e0a-836d-42d6-a847-a6bebe271171"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:39:10.377504 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.377482    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7810e0a-836d-42d6-a847-a6bebe271171-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c7810e0a-836d-42d6-a847-a6bebe271171" (UID: "c7810e0a-836d-42d6-a847-a6bebe271171"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:39:10.476855 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.476755    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7810e0a-836d-42d6-a847-a6bebe271171-proxy-tls\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:39:10.476855 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.476800    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7810e0a-836d-42d6-a847-a6bebe271171-openshift-service-ca-bundle\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:39:10.757474 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.757397    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"
May 26 11:39:10.757474 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.757407    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc" event={"ID":"c7810e0a-836d-42d6-a847-a6bebe271171","Type":"ContainerDied","Data":"ca3d7e6b58825d2ade37a2ff128a2a3fd11f4465a554fd00d711ba091a098ccd"}
May 26 11:39:10.757474 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.757447    2563 scope.go:117] "RemoveContainer" containerID="0cf688484fc9d0bba001a0b03764f6fae966d4dc091c5671d8449d735e9e0312"
May 26 11:39:10.777442 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.777416    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"]
May 26 11:39:10.785382 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:10.785355    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ea074-5dbf4895df-jgrqc"]
May 26 11:39:11.977052 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:39:11.977019    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" path="/var/lib/kubelet/pods/c7810e0a-836d-42d6-a847-a6bebe271171/volumes"
May 26 11:40:03.192772 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:03.186892    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:40:03.192772 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:03.188504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:40:03.195767 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:03.195741    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:40:03.197369 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:03.197351    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:40:09.971016 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.970989    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"]
May 26 11:40:09.971386 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.971366    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074"
May 26 11:40:09.971386 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.971378    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074"
May 26 11:40:09.971460 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.971438    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7810e0a-836d-42d6-a847-a6bebe271171" containerName="model-chainer-raw-ea074"
May 26 11:40:09.974658 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.974628    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:09.977167 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.977139    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-019fa-kube-rbac-proxy-sar-config\""
May 26 11:40:09.977167 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.977163    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-019fa-serving-cert\""
May 26 11:40:09.977916 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.977898    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 26 11:40:09.978057 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.977919    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-wtv9z\""
May 26 11:40:09.982175 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:09.982145    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"]
May 26 11:40:10.040476 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.040447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-019fa-d557f9465-cwxx6\" (UID: \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:10.040645 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.040502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-proxy-tls\") pod \"model-chainer-raw-hpa-019fa-d557f9465-cwxx6\" (UID: \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:10.141374 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.141344    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-019fa-d557f9465-cwxx6\" (UID: \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:10.141538 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.141395    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-proxy-tls\") pod \"model-chainer-raw-hpa-019fa-d557f9465-cwxx6\" (UID: \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:10.142118 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.142099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-019fa-d557f9465-cwxx6\" (UID: \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:10.143969 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.143920    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-proxy-tls\") pod \"model-chainer-raw-hpa-019fa-d557f9465-cwxx6\" (UID: \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:10.286792 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.286710    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:10.411053 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.411025    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"]
May 26 11:40:10.412989 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:40:10.412962    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816b3fc7_b3a4_4efa_9efc_d7daeffd976f.slice/crio-bdcba158144d67acddade0b200291d942ffd396099c42e1c8629dad5e14b22e8 WatchSource:0}: Error finding container bdcba158144d67acddade0b200291d942ffd396099c42e1c8629dad5e14b22e8: Status 404 returned error can't find the container with id bdcba158144d67acddade0b200291d942ffd396099c42e1c8629dad5e14b22e8
May 26 11:40:10.961229 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.961196    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" event={"ID":"816b3fc7-b3a4-4efa-9efc-d7daeffd976f","Type":"ContainerStarted","Data":"961bcd8967056fda9a765a606b36a1c22579bc684cf065b70fbc3f0177452716"}
May 26 11:40:10.961229 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.961231    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" event={"ID":"816b3fc7-b3a4-4efa-9efc-d7daeffd976f","Type":"ContainerStarted","Data":"bdcba158144d67acddade0b200291d942ffd396099c42e1c8629dad5e14b22e8"}
May 26 11:40:10.961463 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.961254    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:10.978891 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:10.978849    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" podStartSLOduration=1.978835182 podStartE2EDuration="1.978835182s" podCreationTimestamp="2026-05-26 11:40:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:40:10.976823549 +0000 UTC m=+909.616584313" watchObservedRunningTime="2026-05-26 11:40:10.978835182 +0000 UTC m=+909.618595949"
May 26 11:40:16.970854 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:16.970826    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:20.016611 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:20.016581    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"]
May 26 11:40:20.016995 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:20.016779    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa" containerID="cri-o://961bcd8967056fda9a765a606b36a1c22579bc684cf065b70fbc3f0177452716" gracePeriod=30
May 26 11:40:21.969733 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:21.969689    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:40:26.969189 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:26.969150    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:40:31.969134 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:31.969095    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:40:31.969532 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:31.969192    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:36.969701 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:36.969659    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:40:41.969071 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:41.969032    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:40:46.969083 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:46.969036    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 11:40:50.096635 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:50.096604    2563 generic.go:358] "Generic (PLEG): container finished" podID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerID="961bcd8967056fda9a765a606b36a1c22579bc684cf065b70fbc3f0177452716" exitCode=137
May 26 11:40:50.096986 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:50.096676    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" event={"ID":"816b3fc7-b3a4-4efa-9efc-d7daeffd976f","Type":"ContainerDied","Data":"961bcd8967056fda9a765a606b36a1c22579bc684cf065b70fbc3f0177452716"}
May 26 11:40:50.204856 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:50.204829    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:50.286791 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:50.286711    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-proxy-tls\") pod \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\" (UID: \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\") "
May 26 11:40:50.286791 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:50.286754    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-openshift-service-ca-bundle\") pod \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\" (UID: \"816b3fc7-b3a4-4efa-9efc-d7daeffd976f\") "
May 26 11:40:50.287107 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:50.287084    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "816b3fc7-b3a4-4efa-9efc-d7daeffd976f" (UID: "816b3fc7-b3a4-4efa-9efc-d7daeffd976f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 11:40:50.288575 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:50.288552    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "816b3fc7-b3a4-4efa-9efc-d7daeffd976f" (UID: "816b3fc7-b3a4-4efa-9efc-d7daeffd976f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 11:40:50.388436 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:50.388405    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-proxy-tls\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:40:50.388436 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:50.388431    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816b3fc7-b3a4-4efa-9efc-d7daeffd976f-openshift-service-ca-bundle\") on node \"ip-10-0-130-251.ec2.internal\" DevicePath \"\""
May 26 11:40:51.100472 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:51.100443    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"
May 26 11:40:51.100472 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:51.100460    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6" event={"ID":"816b3fc7-b3a4-4efa-9efc-d7daeffd976f","Type":"ContainerDied","Data":"bdcba158144d67acddade0b200291d942ffd396099c42e1c8629dad5e14b22e8"}
May 26 11:40:51.101057 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:51.100499    2563 scope.go:117] "RemoveContainer" containerID="961bcd8967056fda9a765a606b36a1c22579bc684cf065b70fbc3f0177452716"
May 26 11:40:51.120800 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:51.120775    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"]
May 26 11:40:51.125952 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:51.125914    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-019fa-d557f9465-cwxx6"]
May 26 11:40:51.983916 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:40:51.983882    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" path="/var/lib/kubelet/pods/816b3fc7-b3a4-4efa-9efc-d7daeffd976f/volumes"
May 26 11:45:03.213758 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:45:03.213633    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:45:03.217984 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:45:03.215375    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:45:03.219595 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:45:03.219571    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:45:03.221322 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:45:03.221301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:49:22.963066 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:22.963041    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qqstg_8b0153f3-c46f-4eb4-a378-752e6f61736e/global-pull-secret-syncer/0.log"
May 26 11:49:23.113666 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:23.113627    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wrbzx_606c2274-61c4-4d6a-85eb-5c9f225860ee/konnectivity-agent/0.log"
May 26 11:49:23.133908 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:23.133882    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-251.ec2.internal_42f8da2d362f9be132a5038f5b173c5f/haproxy/0.log"
May 26 11:49:26.097301 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.097260    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c20c2239-518d-4fd6-8125-901bafb474e5/alertmanager/0.log"
May 26 11:49:26.138141 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.138110    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c20c2239-518d-4fd6-8125-901bafb474e5/config-reloader/0.log"
May 26 11:49:26.178753 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.178726    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c20c2239-518d-4fd6-8125-901bafb474e5/kube-rbac-proxy-web/0.log"
May 26 11:49:26.210645 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.210623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c20c2239-518d-4fd6-8125-901bafb474e5/kube-rbac-proxy/0.log"
May 26 11:49:26.249483 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.249456    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c20c2239-518d-4fd6-8125-901bafb474e5/kube-rbac-proxy-metric/0.log"
May 26 11:49:26.283900 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.283879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c20c2239-518d-4fd6-8125-901bafb474e5/prom-label-proxy/0.log"
May 26 11:49:26.315022 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.315000    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c20c2239-518d-4fd6-8125-901bafb474e5/init-config-reloader/0.log"
May 26 11:49:26.391161 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.391090    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-vn55j_90814779-67af-4b7d-a50e-56471bd7894e/kube-state-metrics/0.log"
May 26 11:49:26.423064 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.423040    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-vn55j_90814779-67af-4b7d-a50e-56471bd7894e/kube-rbac-proxy-main/0.log"
May 26 11:49:26.451235 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.451212    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-vn55j_90814779-67af-4b7d-a50e-56471bd7894e/kube-rbac-proxy-self/0.log"
May 26 11:49:26.547507 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.547483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-297lh_962cb5ad-2cac-4cd5-98dc-c40de0fdff00/node-exporter/0.log"
May 26 11:49:26.570896 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.570876    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-297lh_962cb5ad-2cac-4cd5-98dc-c40de0fdff00/kube-rbac-proxy/0.log"
May 26 11:49:26.602659 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:26.602640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-297lh_962cb5ad-2cac-4cd5-98dc-c40de0fdff00/init-textfile/0.log"
May 26 11:49:27.196878 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:27.196849    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-56rg7_f55860c3-c0b7-4642-a32e-ef302af6c1e3/prometheus-operator-admission-webhook/0.log"
May 26 11:49:29.283026 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:29.282996    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/1.log"
May 26 11:49:29.287274 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:29.287250    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qtkpp_f7e161c7-bb2f-4b78-a1a2-88f13bde5950/console-operator/2.log"
May 26 11:49:29.725965 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:29.725942    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d77b84c6-bwjz6_409d8430-5b0c-4ba9-9c99-21a0554db548/console/0.log"
May 26 11:49:30.067237 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.067203    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"]
May 26 11:49:30.067556 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.067544    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa"
May 26 11:49:30.067600 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.067558    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa"
May 26 11:49:30.067639 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.067632    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="816b3fc7-b3a4-4efa-9efc-d7daeffd976f" containerName="model-chainer-raw-hpa-019fa"
May 26 11:49:30.069773 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.069654    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.072202 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.072175    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpcs5\"/\"openshift-service-ca.crt\""
May 26 11:49:30.072438 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.072425    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rpcs5\"/\"default-dockercfg-vrvc6\""
May 26 11:49:30.073139 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.073124    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpcs5\"/\"kube-root-ca.crt\""
May 26 11:49:30.083831 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.083808    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"]
May 26 11:49:30.171976 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.171917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqm2b\" (UniqueName: \"kubernetes.io/projected/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-kube-api-access-xqm2b\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.171976 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.171980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-lib-modules\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.172220 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.172108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-sys\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.172220 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.172160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-podres\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.172220 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.172207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-proc\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.210508 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.210483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-n2xmd_814f56f8-4e92-4278-ab25-defce0692562/volume-data-source-validator/0.log"
May 26 11:49:30.273124 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.273095    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-lib-modules\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.273277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.273158    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-sys\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.273277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.273191    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-podres\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.273277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.273213    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-proc\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.273277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.273221    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-sys\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.273277 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.273245    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqm2b\" (UniqueName: \"kubernetes.io/projected/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-kube-api-access-xqm2b\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.273460 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.273281    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-lib-modules\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.273460 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.273301    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-proc\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.273460 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.273307    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-podres\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.282315 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.282292    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqm2b\" (UniqueName: \"kubernetes.io/projected/c63ddd98-fd5c-489c-b7d4-75db0740ba3b-kube-api-access-xqm2b\") pod \"perf-node-gather-daemonset-b9vn2\" (UID: \"c63ddd98-fd5c-489c-b7d4-75db0740ba3b\") " pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.379535 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.379449    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.504876 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.504843    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"]
May 26 11:49:30.507320 ip-10-0-130-251 kubenswrapper[2563]: W0526 11:49:30.507292    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc63ddd98_fd5c_489c_b7d4_75db0740ba3b.slice/crio-3828ba3861c9e86a6cf83bf108c87d21ad06e97501a557b74f52a4e21cc5e788 WatchSource:0}: Error finding container 3828ba3861c9e86a6cf83bf108c87d21ad06e97501a557b74f52a4e21cc5e788: Status 404 returned error can't find the container with id 3828ba3861c9e86a6cf83bf108c87d21ad06e97501a557b74f52a4e21cc5e788
May 26 11:49:30.508866 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.508851    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 11:49:30.782733 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.782699    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2" event={"ID":"c63ddd98-fd5c-489c-b7d4-75db0740ba3b","Type":"ContainerStarted","Data":"f397174950e1955564e96452b06e74a308d3da77d60b9fd8c87780b89e513507"}
May 26 11:49:30.782733 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.782735    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2" event={"ID":"c63ddd98-fd5c-489c-b7d4-75db0740ba3b","Type":"ContainerStarted","Data":"3828ba3861c9e86a6cf83bf108c87d21ad06e97501a557b74f52a4e21cc5e788"}
May 26 11:49:30.782961 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.782766    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:30.801183 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:30.801140    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2" podStartSLOduration=0.801126256 podStartE2EDuration="801.126256ms" podCreationTimestamp="2026-05-26 11:49:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:49:30.799571246 +0000 UTC m=+1469.439332029" watchObservedRunningTime="2026-05-26 11:49:30.801126256 +0000 UTC m=+1469.440887021"
May 26 11:49:31.131550 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:31.131525    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9s2r9_d2c43847-0196-4cc1-a21f-c26e7d7e7b27/dns/0.log"
May 26 11:49:31.166181 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:31.166149    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9s2r9_d2c43847-0196-4cc1-a21f-c26e7d7e7b27/kube-rbac-proxy/0.log"
May 26 11:49:31.257585 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:31.257560    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qlg6j_ab49ede9-db47-4d76-a5b3-a546c6d9baaf/dns-node-resolver/0.log"
May 26 11:49:31.688040 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:31.688008    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5cb758cdfd-dgns7_b6be70ab-45d7-4a13-858d-4b8d97bf63ff/registry/0.log"
May 26 11:49:31.738736 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:31.738703    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wb6hv_ebd6dc0d-0732-49fe-ad88-7a6d8550514d/node-ca/0.log"
May 26 11:49:33.004846 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:33.004808    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7w8lh_87e1e63c-e46a-4f6f-92e6-309b1fc52b8e/serve-healthcheck-canary/0.log"
May 26 11:49:33.429336 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:33.429300    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-z974t_1db0d595-1523-4b24-92ad-0992fb41348b/insights-operator/0.log"
May 26 11:49:33.429631 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:33.429614    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-z974t_1db0d595-1523-4b24-92ad-0992fb41348b/insights-operator/1.log"
May 26 11:49:33.532695 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:33.532666    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hqdt5_fc88b325-2c21-4157-9d56-88d38a1342f4/kube-rbac-proxy/0.log"
May 26 11:49:33.559593 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:33.559570    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hqdt5_fc88b325-2c21-4157-9d56-88d38a1342f4/exporter/0.log"
May 26 11:49:33.582857 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:33.582830    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hqdt5_fc88b325-2c21-4157-9d56-88d38a1342f4/extractor/0.log"
May 26 11:49:35.643335 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:35.643305    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-7cd9b78f5d-9tsnv_d7ad6da2-2b4c-426c-a0c0-9fcce397e850/manager/0.log"
May 26 11:49:35.665684 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:35.665656    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-6b94ff949c-lmg2q_b21eac62-0551-4fc3-a34d-d10cf2a29f29/manager/0.log"
May 26 11:49:36.796505 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:36.796481    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rpcs5/perf-node-gather-daemonset-b9vn2"
May 26 11:49:41.315975 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:41.315921    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gxxgq_e00385cd-25f1-4065-8b1e-f7b4965d9240/kube-multus-additional-cni-plugins/0.log"
May 26 11:49:41.342703 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:41.342677    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gxxgq_e00385cd-25f1-4065-8b1e-f7b4965d9240/egress-router-binary-copy/0.log"
May 26 11:49:41.366797 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:41.366771    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gxxgq_e00385cd-25f1-4065-8b1e-f7b4965d9240/cni-plugins/0.log"
May 26 11:49:41.389069 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:41.389047    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gxxgq_e00385cd-25f1-4065-8b1e-f7b4965d9240/bond-cni-plugin/0.log"
May 26 11:49:41.415049 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:41.415020    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gxxgq_e00385cd-25f1-4065-8b1e-f7b4965d9240/routeoverride-cni/0.log"
May 26 11:49:41.460758 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:41.460734    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gxxgq_e00385cd-25f1-4065-8b1e-f7b4965d9240/whereabouts-cni-bincopy/0.log"
May 26 11:49:41.501079 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:41.501050    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gxxgq_e00385cd-25f1-4065-8b1e-f7b4965d9240/whereabouts-cni/0.log"
May 26 11:49:41.928671 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:41.928636    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ftcxs_1a680106-cb94-4758-86e4-e293bc9c27a7/kube-multus/0.log"
May 26 11:49:41.978884 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:41.978859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2lvct_76d1a9f1-5bad-4ab1-93dc-2388810c4796/network-metrics-daemon/0.log"
May 26 11:49:42.001177 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:42.001153    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2lvct_76d1a9f1-5bad-4ab1-93dc-2388810c4796/kube-rbac-proxy/0.log"
May 26 11:49:43.297813 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:43.297785    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-controller/0.log"
May 26 11:49:43.332172 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:43.332148    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/0.log"
May 26 11:49:43.341033 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:43.341012    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovn-acl-logging/1.log"
May 26 11:49:43.391976 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:43.391956    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/kube-rbac-proxy-node/0.log"
May 26 11:49:43.420404 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:43.420375    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/kube-rbac-proxy-ovn-metrics/0.log"
May 26 11:49:43.444730 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:43.444708    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/northd/0.log"
May 26 11:49:43.470668 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:43.470651    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/nbdb/0.log"
May 26 11:49:43.498064 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:43.498045    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/sbdb/0.log"
May 26 11:49:43.601065 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:43.600961    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcr45_bd62691e-bc2b-431c-abe0-71566552c7b0/ovnkube-controller/0.log"
May 26 11:49:45.006254 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:45.006227    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-zfr9x_316ea89e-3cf5-4da7-a1ce-f5831bb0bde2/check-endpoints/0.log"
May 26 11:49:45.086569 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:45.086540    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vbsxn_9bdcc9e5-cf02-4970-ab1e-e6e858e52479/network-check-target-container/0.log"
May 26 11:49:46.069769 ip-10-0-130-251 kubenswrapper[2563]: I0526 11:49:46.069741    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-h5vjn_ef8ff7da-ffea-4290-a8a4-74b20c234e8a/iptables-alerter/0.log"