May 26 01:08:09.214778 ip-10-0-143-139 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 01:08:09.214793 ip-10-0-143-139 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 01:08:09.214805 ip-10-0-143-139 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 01:08:09.215133 ip-10-0-143-139 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 01:08:19.220640 ip-10-0-143-139 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 01:08:19.220657 ip-10-0-143-139 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b9b4ba79f03447eb8b9e86da518ee7a4 --
May 26 01:10:59.538718 ip-10-0-143-139 systemd[1]: Starting Kubernetes Kubelet...
May 26 01:11:00.051750 ip-10-0-143-139 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 01:11:00.051750 ip-10-0-143-139 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 01:11:00.051750 ip-10-0-143-139 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 01:11:00.051750 ip-10-0-143-139 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 01:11:00.051750 ip-10-0-143-139 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 01:11:00.054125 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.054001    2579 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 01:11:00.059850 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059831    2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 01:11:00.059850 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059850    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059854    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059857    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059859    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059862    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059865    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059868    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059871    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059874    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059876    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059879    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059881    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059884    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059886    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059892    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059897    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059899    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059902    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059905    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 01:11:00.059919 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059907    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059910    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059912    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059915    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059917    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059920    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059923    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059925    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059928    2579 feature_gate.go:328] unrecognized feature gate: Example2
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059931    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059934    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059937    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059939    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059942    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059945    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059948    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059951    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059953    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059956    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059959    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 01:11:00.060364 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059961    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059963    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059966    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059968    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059971    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059974    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059976    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059978    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059981    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059983    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059986    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059988    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059991    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059993    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059996    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.059999    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060003    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060007    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060009    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 01:11:00.060871 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060012    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060015    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060018    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060020    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060023    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060025    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060028    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060031    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060034    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060036    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060039    2579 feature_gate.go:328] unrecognized feature gate: Example
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060041    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060044    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060047    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060049    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060051    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060054    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060056    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060058    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060062    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 01:11:00.061328 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060065    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060067    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060070    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060072    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060074    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060077    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060079    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060492    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060498    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060501    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060504    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060506    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060509    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060511    2579 feature_gate.go:328] unrecognized feature gate: Example2
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060514    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060517    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060519    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060522    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060525    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 01:11:00.061829 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060528    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060530    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060532    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060535    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060537    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060542    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060546    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060549    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060552    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060555    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060558    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060560    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060563    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060565    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060567    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060570    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060572    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060575    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060577    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060580    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 01:11:00.062282 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060583    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060586    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060589    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060591    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060594    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060596    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060598    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060601    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060603    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060606    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060608    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060610    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060613    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060615    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060619    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060621    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060623    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060626    2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060629    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060632    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 01:11:00.062785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060634    2579 feature_gate.go:328] unrecognized feature gate: Example
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060637    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060639    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060642    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060644    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060646    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060649    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060651    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060654    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060656    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060659    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060661    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060664    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060669    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060672    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060675    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060678    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060681    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060683    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 01:11:00.063266 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060686    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060688    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060691    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060693    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060695    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060698    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060700    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060703    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060705    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060707    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060710    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060712    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060715    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060717    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.060720    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060791    2579 flags.go:64] FLAG: --address="0.0.0.0"
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060799    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060806    2579 flags.go:64] FLAG: --anonymous-auth="true"
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060811    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060815    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060819    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 01:11:00.063749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060823    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060827    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060831    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060833    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060838    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060842    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060845    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060848    2579 flags.go:64] FLAG: --cgroup-root=""
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060851    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060854    2579 flags.go:64] FLAG: --client-ca-file=""
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060857    2579 flags.go:64] FLAG: --cloud-config=""
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060860    2579 flags.go:64] FLAG: --cloud-provider="external"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060863    2579 flags.go:64] FLAG: --cluster-dns="[]"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060867    2579 flags.go:64] FLAG: --cluster-domain=""
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060870    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060873    2579 flags.go:64] FLAG: --config-dir=""
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060876    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060879    2579 flags.go:64] FLAG: --container-log-max-files="5"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060883    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060886    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060889    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060892    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060895    2579 flags.go:64] FLAG: --contention-profiling="false"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060898    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 01:11:00.064288 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060902    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060905    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060908    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060912    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060915    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060918    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060921    2579 flags.go:64] FLAG: --enable-load-reader="false"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060923    2579 flags.go:64] FLAG: --enable-server="true"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060926    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060931    2579 flags.go:64] FLAG: --event-burst="100"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060934    2579 flags.go:64] FLAG: --event-qps="50"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060937    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060941    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060944    2579 flags.go:64] FLAG: --eviction-hard=""
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060948    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060951    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060953    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060957    2579 flags.go:64] FLAG: --eviction-soft=""
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060960    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060962    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060965    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060968    2579 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060971    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060973    2579 flags.go:64] FLAG: --fail-swap-on="true"
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060976    2579 flags.go:64] FLAG: --feature-gates=""
May 26 01:11:00.064890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060980    2579 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060983    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060986    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060989    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060992    2579 flags.go:64] FLAG: --healthz-port="10248"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060995    2579 flags.go:64] FLAG: --help="false"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.060998    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-143-139.ec2.internal"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061001    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061004    2579 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061007    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061011    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061017    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061020    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061022    2579 flags.go:64] FLAG: --image-service-endpoint=""
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061025    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061028    2579 flags.go:64] FLAG: --kube-api-burst="100"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061032    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061035    2579 flags.go:64] FLAG: --kube-api-qps="50"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061038    2579 flags.go:64] FLAG: --kube-reserved=""
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061041    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061044    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061047    2579 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061049    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061052    2579 flags.go:64] FLAG: --lock-file=""
May 26 01:11:00.065548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061055    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061058    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061061    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061066    2579 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061069    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061072    2579 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061074    2579 flags.go:64] FLAG: --logging-format="text"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061077    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061081    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061083    2579 flags.go:64] FLAG: --manifest-url=""
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061086    2579 flags.go:64] FLAG: --manifest-url-header=""
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061091    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061094    2579 flags.go:64] FLAG: --max-open-files="1000000"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061098    2579 flags.go:64] FLAG: --max-pods="110"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061101    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061104    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061107    2579 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061110    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061113    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061118    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061121    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061128    2579 flags.go:64] FLAG: --node-status-max-images="50"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061131    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061134    2579 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 01:11:00.066128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061138    2579 flags.go:64] FLAG: --pod-cidr=""
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061141    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061147    2579 flags.go:64] FLAG: --pod-manifest-path=""
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061150    2579 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061153    2579 flags.go:64] FLAG: --pods-per-core="0"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061156    2579 flags.go:64] FLAG: --port="10250"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061159    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061162    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-093df0b4999dfff4e"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061165    2579 flags.go:64] FLAG: --qos-reserved=""
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061168    2579 flags.go:64] FLAG: --read-only-port="10255"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061171    2579 flags.go:64] FLAG: --register-node="true"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061174    2579 flags.go:64] FLAG: --register-schedulable="true"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061177    2579 flags.go:64] FLAG: --register-with-taints=""
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061180    2579 flags.go:64] FLAG: --registry-burst="10"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061183    2579 flags.go:64] FLAG: --registry-qps="5"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061186    2579 flags.go:64] FLAG: --reserved-cpus=""
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061188    2579 flags.go:64] FLAG: --reserved-memory=""
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061192    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061195    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061198    2579 flags.go:64] FLAG: --rotate-certificates="false"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061201    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061203    2579 flags.go:64] FLAG: --runonce="false"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061206    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061209    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061212    2579 flags.go:64] FLAG: --seccomp-default="false"
May 26 01:11:00.066743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061215    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061218    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061223    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061226    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061229    2579 flags.go:64] FLAG: --storage-driver-password="root"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061232    2579 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061234    2579 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061237    2579 flags.go:64] FLAG: --storage-driver-user="root"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061240    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061243    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061245    2579 flags.go:64] FLAG: --system-cgroups=""
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061249    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061254    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061257    2579 flags.go:64] FLAG: --tls-cert-file=""
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061259    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061263    2579 flags.go:64] FLAG: --tls-min-version=""
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061266    2579 flags.go:64] FLAG: --tls-private-key-file=""
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061269    2579 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061272    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061275    2579 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061278    2579 flags.go:64] FLAG: --v="2"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061282    2579 flags.go:64] FLAG: --version="false"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061287    2579 flags.go:64] FLAG: --vmodule=""
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061291    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.061294    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 01:11:00.067382 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061385    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061388    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061392    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061397    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061415    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061418    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061421    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061423    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061426    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061434    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061437    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061439    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061442    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061444    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061447    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061450    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061452    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061459    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061461    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061464    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 01:11:00.068028 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061467    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061469    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061472    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061475    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061478    2579 feature_gate.go:328] unrecognized feature gate: Example
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061480    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061483    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061485    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061488    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061490    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061493    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061495    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061499    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061502    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061505    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061508    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061511    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061515    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061518    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061520    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 01:11:00.068549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061523    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061527    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061530    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061533    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061535    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061538    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061540    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061542    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061545    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061549    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061552    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061554    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061557    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061559    2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061561    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061564    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061566    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061569    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061571    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061574    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 01:11:00.069104 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061576    2579 feature_gate.go:328] unrecognized feature gate: Example2
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061579    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061581    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061583    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061586    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061599    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061601    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061604    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061606    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061609    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061611    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061614    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061616    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061623    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061626    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061633    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061636    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061639    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061641    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 01:11:00.069898 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061644    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 01:11:00.070510 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061646    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 01:11:00.070510 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061650    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 01:11:00.070510 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061652    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 01:11:00.070510 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061655    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 01:11:00.070510 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061657    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 01:11:00.070510 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.061659    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 01:11:00.070510 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.062341    2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 01:11:00.071649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.071626    2579 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 01:11:00.071686 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.071651    2579 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 01:11:00.071712 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071706    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 01:11:00.071712 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071712    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071716    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071719    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071722    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071724    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071727    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071730    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071732    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071735    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071738    2579 feature_gate.go:328] unrecognized feature gate: Example
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071740    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071743    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071745    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071748    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071750    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071753    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071755    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071758    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071760    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071763    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 01:11:00.071767 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071765    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071768    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071771    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071775    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071777    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071780    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071783    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071785    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071788    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071790    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071794    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071799    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071802    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071805    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071807    2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071810    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071813    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071815    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071818    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 01:11:00.072297 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071821    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071823    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071826    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071829    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071831    2579 feature_gate.go:328] unrecognized feature gate: Example2
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071834    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071836    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071840    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071842    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071844    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071847    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071849    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071851    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071856    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071859    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071862    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071865    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071868    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071871    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 01:11:00.072785 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071873    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071877    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071879    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071882    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071885    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071887    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071890    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071892    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071895    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071897    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071900    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071902    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071905    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071908    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071910    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071913    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071915    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071919    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071921    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071924    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 01:11:00.073258 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071927    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071930    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071933    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071935    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071938    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071940    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.071943    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.071949    2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072049    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072054    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072057    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072060    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072063    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072066    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072069    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 01:11:00.073771 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072072    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072074    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072077    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072080    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072082    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072085    2579 feature_gate.go:328] unrecognized feature gate: Example
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072087    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072090    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072092    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072094    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072097    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072099    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072102    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072104    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072107    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072110    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072112    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072115    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072118    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072120    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 01:11:00.074161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072123    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072125    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072128    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072131    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072134    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072136    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072139    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072142    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072144    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072148    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072152    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072156    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072160    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072163    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072165    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072168    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072171    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072174    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072176    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 01:11:00.074681 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072179    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072182    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072185    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072188    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072190    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072193    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072195    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072198    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072200    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072204    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072206    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072209    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072211    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072214    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072216    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072219    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072221    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072224    2579 feature_gate.go:328] unrecognized feature gate: Example2
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072227    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072229    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 01:11:00.075144 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072232    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072234    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072237    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072239    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072242    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072244    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072247    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072249    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072251    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072254    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072256    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072259    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072261    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072264    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072266    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072268    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072271    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072273    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072276    2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 01:11:00.075686 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:00.072279    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 01:11:00.076151 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.072284    2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 01:11:00.076151 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.073192    2579 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 01:11:00.077501 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.077485    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 01:11:00.078486 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.078474    2579 server.go:1019] "Starting client certificate rotation"
May 26 01:11:00.078590 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.078572    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 01:11:00.078633 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.078622    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 01:11:00.106979 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.106955    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 01:11:00.108845 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.108824    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 01:11:00.129596 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.129567    2579 log.go:25] "Validated CRI v1 runtime API"
May 26 01:11:00.136175 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.136157    2579 log.go:25] "Validated CRI v1 image API"
May 26 01:11:00.137720 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.137703    2579 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 01:11:00.141170 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.141137    2579 fs.go:135] Filesystem UUIDs: map[01645a62-40e8-45f4-846f-de9a42776dbe:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 84433dc3-8444-4295-9493-bfa880c010ba:/dev/nvme0n1p3]
May 26 01:11:00.141261 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.141171    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 01:11:00.147446 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.147308    2579 manager.go:217] Machine: {Timestamp:2026-05-26 01:11:00.146813633 +0000 UTC m=+0.473597946 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093597 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d48b9bb1210b6e14ff7b5a6455a60 SystemUUID:ec2d48b9-bb12-10b6-e14f-f7b5a6455a60 BootID:b9b4ba79-f034-47eb-8b9e-86da518ee7a4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:a2:ce:ec:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:a2:ce:ec:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:eb:b4:cd:cf:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 01:11:00.147446 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.147430    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 01:11:00.147623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.147549    2579 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 01:11:00.148199 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.148180    2579 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 01:11:00.150420 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.150380    2579 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 01:11:00.150600 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.150422    2579 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 01:11:00.150678 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.150615    2579 topology_manager.go:138] "Creating topology manager with none policy"
May 26 01:11:00.150678 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.150628    2579 container_manager_linux.go:306] "Creating device plugin manager"
May 26 01:11:00.150678 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.150638    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 01:11:00.150678 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.150659    2579 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 01:11:00.153104 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.153090    2579 state_mem.go:36] "Initialized new in-memory state store"
May 26 01:11:00.153237 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.153226    2579 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 01:11:00.155961 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.155950    2579 kubelet.go:491] "Attempting to sync node with API server"
May 26 01:11:00.156027 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.155969    2579 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 01:11:00.156027 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.155987    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 01:11:00.156027 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.156000    2579 kubelet.go:397] "Adding apiserver pod source"
May 26 01:11:00.156027 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.156013    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 01:11:00.157337 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.157323    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 01:11:00.157430 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.157347    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 01:11:00.161202 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.161186    2579 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 01:11:00.162949 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.162931    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x8gcg"
May 26 01:11:00.163484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.163471    2579 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 01:11:00.164381 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164368    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 01:11:00.164436 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164384    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 01:11:00.164436 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164390    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 01:11:00.164436 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164397    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 01:11:00.164436 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164421    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 01:11:00.164436 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164427    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 01:11:00.164436 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164433    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 01:11:00.164436 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164439    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 01:11:00.164620 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164447    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 01:11:00.164620 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164453    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 01:11:00.164620 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164462    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 01:11:00.164835 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.164827    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 01:11:00.166046 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.166033    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 01:11:00.166080 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.166049    2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 01:11:00.169438 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.169372    2579 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 01:11:00.169438 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.169433    2579 server.go:1295] "Started kubelet"
May 26 01:11:00.169628 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.169551    2579 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 01:11:00.169737 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.169661    2579 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 01:11:00.169788 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.169594    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 01:11:00.170095 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.170076    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x8gcg"
May 26 01:11:00.170457 ip-10-0-143-139 systemd[1]: Started Kubernetes Kubelet.
May 26 01:11:00.171054 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.170477    2579 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 01:11:00.171054 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.170520    2579 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 01:11:00.171054 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.170631    2579 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 01:11:00.171244 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.171066    2579 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 01:11:00.173211 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.173195    2579 server.go:317] "Adding debug handlers to kubelet server"
May 26 01:11:00.179800 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.179781    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 01:11:00.179938 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.179921    2579 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 01:11:00.179987 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.179941    2579 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 01:11:00.180105 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.180091    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 01:11:00.180769 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.180749    2579 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 01:11:00.180872 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.180679    2579 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 01:11:00.180935 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.180841    2579 reconstruct.go:97] "Volume reconstruction finished"
May 26 01:11:00.181023 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.181005    2579 reconciler.go:26] "Reconciler: start to sync state"
May 26 01:11:00.181703 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.181678    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 01:11:00.181703 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.181696    2579 factory.go:55] Registering systemd factory
May 26 01:11:00.181855 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.181713    2579 factory.go:223] Registration of the systemd container factory successfully
May 26 01:11:00.181947 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.181934    2579 factory.go:153] Registering CRI-O factory
May 26 01:11:00.181997 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.181950    2579 factory.go:223] Registration of the crio container factory successfully
May 26 01:11:00.181997 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.181964    2579 factory.go:103] Registering Raw factory
May 26 01:11:00.181997 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.181993    2579 manager.go:1196] Started watching for new ooms in manager
May 26 01:11:00.182577 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.182424    2579 manager.go:319] Starting recovery of all containers
May 26 01:11:00.184494 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.184472    2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:00.187297 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.187275    2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-139.ec2.internal\" not found" node="ip-10-0-143-139.ec2.internal"
May 26 01:11:00.188546 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.188523    2579 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 01:11:00.194355 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.194333    2579 manager.go:324] Recovery completed
May 26 01:11:00.198225 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.198213    2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 01:11:00.201777 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.201762    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory"
May 26 01:11:00.201835 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.201791    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure"
May 26 01:11:00.201835 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.201805    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID"
May 26 01:11:00.202289 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.202276    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 01:11:00.202289 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.202287    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 01:11:00.202363 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.202304    2579 state_mem.go:36] "Initialized new in-memory state store"
May 26 01:11:00.205798 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.205787    2579 policy_none.go:49] "None policy: Start"
May 26 01:11:00.205845 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.205805    2579 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 01:11:00.205845 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.205815    2579 state_mem.go:35] "Initializing new in-memory state store"
May 26 01:11:00.246134 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.246107    2579 manager.go:341] "Starting Device Plugin manager"
May 26 01:11:00.272601 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.246173    2579 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 01:11:00.272601 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.246188    2579 server.go:85] "Starting device plugin registration server"
May 26 01:11:00.272601 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.246461    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 01:11:00.272601 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.246472    2579 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 01:11:00.272601 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.246541    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 01:11:00.272601 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.246628    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 01:11:00.272601 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.246637    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 01:11:00.272601 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.247092    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 01:11:00.272601 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.247135    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:00.317553 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.317473    2579 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 01:11:00.318803 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.318788    2579 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 01:11:00.318887 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.318810    2579 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 01:11:00.318887 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.318829    2579 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 01:11:00.318887 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.318836    2579 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 01:11:00.319020 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.318928    2579 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 01:11:00.320944 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.320926    2579 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 01:11:00.347007 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.346974    2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 01:11:00.347953 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.347938    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory"
May 26 01:11:00.348044 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.347970    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure"
May 26 01:11:00.348044 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.347980    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID"
May 26 01:11:00.348044 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.348004    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-139.ec2.internal"
May 26 01:11:00.353755 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.353736    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-139.ec2.internal"
May 26 01:11:00.353857 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.353760    2579 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-139.ec2.internal\": node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:00.370798 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.370770    2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:00.419972 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.419936    2579 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal"]
May 26 01:11:00.420119 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.420073    2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 01:11:00.421009 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.420992    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory"
May 26 01:11:00.421073 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.421025    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure"
May 26 01:11:00.421073 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.421035    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID"
May 26 01:11:00.422809 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.422797    2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 01:11:00.422985 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.422971    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.423022 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.423002    2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 01:11:00.423648 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.423632    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory"
May 26 01:11:00.423736 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.423637    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory"
May 26 01:11:00.423736 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.423682    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure"
May 26 01:11:00.423736 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.423698    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID"
May 26 01:11:00.423736 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.423654    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure"
May 26 01:11:00.423736 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.423737    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID"
May 26 01:11:00.424919 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.424905    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.424977 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.424929    2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 01:11:00.426292 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.426271    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientMemory"
May 26 01:11:00.426364 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.426298    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasNoDiskPressure"
May 26 01:11:00.426364 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.426309    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeHasSufficientPID"
May 26 01:11:00.449219 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.449194    2579 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-139.ec2.internal\" not found" node="ip-10-0-143-139.ec2.internal"
May 26 01:11:00.453741 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.453725    2579 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-139.ec2.internal\" not found" node="ip-10-0-143-139.ec2.internal"
May 26 01:11:00.471750 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.471723    2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:00.483066 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.483041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/843a22a453c173574f663232f41db0b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"843a22a453c173574f663232f41db0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.483176 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.483072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9660ea6fd56285e0df024d588ae3caaf-config\") pod \"kube-apiserver-proxy-ip-10-0-143-139.ec2.internal\" (UID: \"9660ea6fd56285e0df024d588ae3caaf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.483176 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.483094    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/843a22a453c173574f663232f41db0b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"843a22a453c173574f663232f41db0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.572495 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.572383    2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:00.583800 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.583770    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/843a22a453c173574f663232f41db0b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"843a22a453c173574f663232f41db0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.583901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.583807    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9660ea6fd56285e0df024d588ae3caaf-config\") pod \"kube-apiserver-proxy-ip-10-0-143-139.ec2.internal\" (UID: \"9660ea6fd56285e0df024d588ae3caaf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.583901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.583831    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/843a22a453c173574f663232f41db0b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"843a22a453c173574f663232f41db0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.583901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.583881    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/843a22a453c173574f663232f41db0b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"843a22a453c173574f663232f41db0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.584024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.583930    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9660ea6fd56285e0df024d588ae3caaf-config\") pod \"kube-apiserver-proxy-ip-10-0-143-139.ec2.internal\" (UID: \"9660ea6fd56285e0df024d588ae3caaf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.584024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.583961    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/843a22a453c173574f663232f41db0b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal\" (UID: \"843a22a453c173574f663232f41db0b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.673228 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.673182    2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:00.751710 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.751685    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.756519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:00.756498    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal"
May 26 01:11:00.773765 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.773591    2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:00.874184 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.874090    2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:00.974607 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:00.974570    2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:01.028884 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.028854    2579 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 01:11:01.074906 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.074864    2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-139.ec2.internal\" not found"
May 26 01:11:01.076034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.076014    2579 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 01:11:01.079781 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.079768    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 01:11:01.079900 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.079882    2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 01:11:01.079957 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.079882    2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 01:11:01.079957 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.079883    2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 01:11:01.079957 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.079882    2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 01:11:01.081946 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.081931    2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal"
May 26 01:11:01.100780 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.100754    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 01:11:01.101645 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.101632    2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal"
May 26 01:11:01.108963 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.108943    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 01:11:01.157172 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.157094    2579 apiserver.go:52] "Watching apiserver"
May 26 01:11:01.162475 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.162454    2579 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 01:11:01.162819 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.162796    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-bc4s7","openshift-ovn-kubernetes/ovnkube-node-g2584","openshift-dns/node-resolver-kqzkc","openshift-image-registry/node-ca-4jtfg","openshift-multus/multus-additional-cni-plugins-cmhwz","openshift-network-diagnostics/network-check-target-2vxd8","openshift-network-operator/iptables-alerter-ck5lm","kube-system/konnectivity-agent-56gzh","kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8","openshift-cluster-node-tuning-operator/tuned-4hx5l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal","openshift-multus/multus-247n4"]
May 26 01:11:01.164039 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.164019    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.165219 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.165194    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.165845 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.165827    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 01:11:01.165932 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.165871    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 01:11:01.166286 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.166250    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 01:11:01.166374 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.166332    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lvkfr\""
May 26 01:11:01.166603 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.166586    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.166780 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.166761    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 01:11:01.167203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.167184    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 01:11:01.167641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.167424    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qthgh\""
May 26 01:11:01.167641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.167441    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 01:11:01.167641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.167427    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 01:11:01.167641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.167464    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 01:11:01.167641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.167511    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 01:11:01.167957 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.167821    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.168022 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.167963    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 01:11:01.168068 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.168037    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9cfhk\""
May 26 01:11:01.168336 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.168321    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 01:11:01.169202 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.169183    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.169510 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.169493    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 01:11:01.169640 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.169623    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 01:11:01.169703 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.169678    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6w4x9\""
May 26 01:11:01.169762 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.169735    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 01:11:01.170637 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.170614    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:01.170745 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.170719    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:01.171431 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.171364    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 01:11:01.171512 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.171453    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 01:11:01.171512 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.171452    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 01:11:01.171628 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.171364    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 01:11:01.172819 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.171781    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9bmpg\""
May 26 01:11:01.172819 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.172029    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 01:11:01.172819 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.172360    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:01.172819 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.172448    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:01.173032 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.172896    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 01:06:00 +0000 UTC" deadline="2027-12-26 19:46:38.74553619 +0000 UTC"
May 26 01:11:01.173032 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.172922    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13914h35m37.57261721s"
May 26 01:11:01.173751 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.173733    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:01.175078 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.174953    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.175521 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.175501    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ctsnx\""
May 26 01:11:01.175607 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.175588    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 01:11:01.175735 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.175716    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 01:11:01.176135 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.176116    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.176551 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.176535    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 01:11:01.176735 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.176722    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 01:11:01.176861 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.176844    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 01:11:01.177026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.177014    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g26kn\""
May 26 01:11:01.177325 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.177309    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-247n4"
May 26 01:11:01.177866 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.177849    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 01:11:01.177957 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.177869    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zpqsk\""
May 26 01:11:01.177957 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.177884    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 01:11:01.179244 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.179226    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 01:11:01.179431 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.179257    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2rq56\""
May 26 01:11:01.181355 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.181325    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 01:11:01.182174 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.182156    2579 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 01:11:01.187334 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.186952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc44f6dd-8313-4041-8194-258e506678e6-agent-certs\") pod \"konnectivity-agent-56gzh\" (UID: \"bc44f6dd-8313-4041-8194-258e506678e6\") " pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:01.187440 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.187440 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-run-systemd\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.187561 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-run-openvswitch\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.187561 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-kubernetes\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.187561 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b98t\" (UniqueName: \"kubernetes.io/projected/776d35a0-6b5c-472c-8876-266451b05bb9-kube-api-access-8b98t\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.187703 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-os-release\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.187703 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187606    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-run-k8s-cni-cncf-io\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.187703 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-node-log\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.187703 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187661    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-modprobe-d\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.187703 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-sysconfig\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.187880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-systemd\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.187880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-multus-socket-dir-parent\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.187880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-run-netns\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.187880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-hostroot\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.187880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-os-release\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.187880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187829    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-ovnkube-config\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.187880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240-hosts-file\") pod \"node-resolver-kqzkc\" (UID: \"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240\") " pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.187880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85906cfe-5556-403a-bfb1-aa1df8402461-cni-binary-copy\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.187880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187875    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-var-lib-cni-bin\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abcd5f49-10f9-40e9-a066-075120793513-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-sys-fs\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztj2p\" (UniqueName: \"kubernetes.io/projected/004e88b8-2de8-46da-8565-fa5d3004a202-kube-api-access-ztj2p\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjwgt\" (UniqueName: \"kubernetes.io/projected/dae0945b-ed4e-4987-92bd-65482bf722e4-kube-api-access-wjwgt\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.187987    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-cnibin\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdxgq\" (UniqueName: \"kubernetes.io/projected/807fa39d-d488-431c-8d1f-2778e4119009-kube-api-access-zdxgq\") pod \"iptables-alerter-ck5lm\" (UID: \"807fa39d-d488-431c-8d1f-2778e4119009\") " pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-registration-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-run-netns\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkzzm\" (UniqueName: \"kubernetes.io/projected/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-kube-api-access-nkzzm\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjcpb\" (UniqueName: \"kubernetes.io/projected/b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240-kube-api-access-qjcpb\") pod \"node-resolver-kqzkc\" (UID: \"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240\") " pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-sysctl-conf\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-multus-cni-dir\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc44f6dd-8313-4041-8194-258e506678e6-konnectivity-ca\") pod \"konnectivity-agent-56gzh\" (UID: \"bc44f6dd-8313-4041-8194-258e506678e6\") " pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:01.188311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-lib-modules\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-etc-kubernetes\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/807fa39d-d488-431c-8d1f-2778e4119009-host-slash\") pod \"iptables-alerter-ck5lm\" (UID: \"807fa39d-d488-431c-8d1f-2778e4119009\") " pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6-host\") pod \"node-ca-4jtfg\" (UID: \"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6\") " pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n4mg\" (UniqueName: \"kubernetes.io/projected/abcd5f49-10f9-40e9-a066-075120793513-kube-api-access-7n4mg\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-device-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188436    2579 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-ovn-node-metrics-cert\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-host\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-slash\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-log-socket\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-cni-bin\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.188890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188636    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-cni-netd\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.189269 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.188653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-run\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.189269 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-var-lib-kubelet\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.189269 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189117    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/807fa39d-d488-431c-8d1f-2778e4119009-iptables-alerter-script\") pod \"iptables-alerter-ck5lm\" (UID: \"807fa39d-d488-431c-8d1f-2778e4119009\") " pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.189269 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:01.189269 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-var-lib-kubelet\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.189269 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-multus-conf-dir\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.189269 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6-serviceca\") pod \"node-ca-4jtfg\" (UID: \"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6\") " pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abcd5f49-10f9-40e9-a066-075120793513-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-var-lib-openvswitch\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-sys\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-socket-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-run-ovn\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597tt\" (UniqueName: \"kubernetes.io/projected/85906cfe-5556-403a-bfb1-aa1df8402461-kube-api-access-597tt\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/776d35a0-6b5c-472c-8876-266451b05bb9-etc-tuned\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.189557 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-kubelet\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-systemd-units\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-ovnkube-script-lib\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240-tmp-dir\") pod \"node-resolver-kqzkc\" (UID: \"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240\") " pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-system-cni-dir\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-etc-openvswitch\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-run-ovn-kubernetes\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-var-lib-cni-multus\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-sysctl-d\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/776d35a0-6b5c-472c-8876-266451b05bb9-tmp\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85906cfe-5556-403a-bfb1-aa1df8402461-multus-daemon-config\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-run-multus-certs\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjdd\" (UniqueName: \"kubernetes.io/projected/f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6-kube-api-access-xfjdd\") pod \"node-ca-4jtfg\" (UID: \"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6\") " pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-system-cni-dir\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-env-overrides\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-cnibin\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.190034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.189920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abcd5f49-10f9-40e9-a066-075120793513-cni-binary-copy\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.207733 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.207714    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9jbf"
May 26 01:11:01.214785 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.214763    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9jbf"
May 26 01:11:01.290767 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.290727    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:01.290767 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.290764    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/776d35a0-6b5c-472c-8876-266451b05bb9-etc-tuned\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.291026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.290783    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-kubelet\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.291026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.290840    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-kubelet\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.291026 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.290900    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:01.291026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.290920    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-systemd-units\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.291026 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.290974    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs podName:dae0945b-ed4e-4987-92bd-65482bf722e4 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:01.790952075 +0000 UTC m=+2.117736376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs") pod "network-metrics-daemon-bc4s7" (UID: "dae0945b-ed4e-4987-92bd-65482bf722e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:01.291026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.290992    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-systemd-units\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.291026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.290996    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-ovnkube-script-lib\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.291026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291026    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240-tmp-dir\") pod \"node-resolver-kqzkc\" (UID: \"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240\") " pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291108    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-system-cni-dir\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291144    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291157    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-etc-openvswitch\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291213    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-run-ovn-kubernetes\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291238    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-var-lib-cni-multus\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291252    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-system-cni-dir\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291261    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-sysctl-d\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291304    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/776d35a0-6b5c-472c-8876-266451b05bb9-tmp\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291318    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240-tmp-dir\") pod \"node-resolver-kqzkc\" (UID: \"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240\") " pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291321    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-run-ovn-kubernetes\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291332    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85906cfe-5556-403a-bfb1-aa1df8402461-multus-daemon-config\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291381    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-sysctl-d\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.291417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291383    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-run-multus-certs\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291432    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-run-multus-certs\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291447    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjdd\" (UniqueName: \"kubernetes.io/projected/f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6-kube-api-access-xfjdd\") pod \"node-ca-4jtfg\" (UID: \"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6\") " pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291479    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-etc-openvswitch\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291483    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-system-cni-dir\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291516    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-env-overrides\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291524    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-system-cni-dir\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291385    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-var-lib-cni-multus\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291545    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-cnibin\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291573    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abcd5f49-10f9-40e9-a066-075120793513-cni-binary-copy\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291599    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc44f6dd-8313-4041-8194-258e506678e6-agent-certs\") pod \"konnectivity-agent-56gzh\" (UID: \"bc44f6dd-8313-4041-8194-258e506678e6\") " pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291624    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291650    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-run-systemd\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291675    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-run-openvswitch\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291698    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-kubernetes\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291718    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-ovnkube-script-lib\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291726    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8b98t\" (UniqueName: \"kubernetes.io/projected/776d35a0-6b5c-472c-8876-266451b05bb9-kube-api-access-8b98t\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.292024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291827    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291872    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-cnibin\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.291960    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85906cfe-5556-403a-bfb1-aa1df8402461-multus-daemon-config\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292046    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-kubernetes\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292087    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-run-openvswitch\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292118    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-os-release\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292146    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-run-k8s-cni-cncf-io\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292250    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-node-log\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292360    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-modprobe-d\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292384    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-sysconfig\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292424    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-systemd\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292450    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-multus-socket-dir-parent\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292471    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-run-netns\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292495    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-hostroot\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292519    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-os-release\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292544    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-ovnkube-config\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292572    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240-hosts-file\") pod \"node-resolver-kqzkc\" (UID: \"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240\") " pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292585    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abcd5f49-10f9-40e9-a066-075120793513-cni-binary-copy\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.293224 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292595    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85906cfe-5556-403a-bfb1-aa1df8402461-cni-binary-copy\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292619    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-var-lib-cni-bin\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292646    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abcd5f49-10f9-40e9-a066-075120793513-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292637    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-env-overrides\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292679    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-sys-fs\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292722    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztj2p\" (UniqueName: \"kubernetes.io/projected/004e88b8-2de8-46da-8565-fa5d3004a202-kube-api-access-ztj2p\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292749    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjwgt\" (UniqueName: \"kubernetes.io/projected/dae0945b-ed4e-4987-92bd-65482bf722e4-kube-api-access-wjwgt\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292776    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-cnibin\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292817    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdxgq\" (UniqueName: \"kubernetes.io/projected/807fa39d-d488-431c-8d1f-2778e4119009-kube-api-access-zdxgq\") pod \"iptables-alerter-ck5lm\" (UID: \"807fa39d-d488-431c-8d1f-2778e4119009\") " pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292860    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292895    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-registration-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292917    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-run-netns\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292935    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-os-release\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292947    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkzzm\" (UniqueName: \"kubernetes.io/projected/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-kube-api-access-nkzzm\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.292996    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-sysconfig\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293050    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-modprobe-d\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293095    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-os-release\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.294395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293124    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-run-k8s-cni-cncf-io\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293156    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-node-log\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293192    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjcpb\" (UniqueName: \"kubernetes.io/projected/b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240-kube-api-access-qjcpb\") pod \"node-resolver-kqzkc\" (UID: \"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240\") " pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293236    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-hostroot\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293240    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-systemd\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293279    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-multus-socket-dir-parent\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293310    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-run-netns\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293348    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-run-systemd\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293437    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-ovnkube-config\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293531    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-sysctl-conf\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293539    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-sys-fs\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293567    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-multus-cni-dir\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293589    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-var-lib-cni-bin\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293602    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc44f6dd-8313-4041-8194-258e506678e6-konnectivity-ca\") pod \"konnectivity-agent-56gzh\" (UID: \"bc44f6dd-8313-4041-8194-258e506678e6\") " pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293627    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-lib-modules\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293647    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240-hosts-file\") pod \"node-resolver-kqzkc\" (UID: \"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240\") " pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293652    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-etc-kubernetes\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293570    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.295226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293602    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-registration-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.293755    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-lib-modules\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294167    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abcd5f49-10f9-40e9-a066-075120793513-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294198    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85906cfe-5556-403a-bfb1-aa1df8402461-cni-binary-copy\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294224    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-etc-kubernetes\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294234    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/807fa39d-d488-431c-8d1f-2778e4119009-host-slash\") pod \"iptables-alerter-ck5lm\" (UID: \"807fa39d-d488-431c-8d1f-2778e4119009\") " pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294240    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-run-netns\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294197    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-etc-sysctl-conf\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294274    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/807fa39d-d488-431c-8d1f-2778e4119009-host-slash\") pod \"iptables-alerter-ck5lm\" (UID: \"807fa39d-d488-431c-8d1f-2778e4119009\") " pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294329    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-multus-cni-dir\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294393    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-cnibin\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294516    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6-host\") pod \"node-ca-4jtfg\" (UID: \"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6\") " pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294535    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294558    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4mg\" (UniqueName: \"kubernetes.io/projected/abcd5f49-10f9-40e9-a066-075120793513-kube-api-access-7n4mg\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294584    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-device-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294589    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6-host\") pod \"node-ca-4jtfg\" (UID: \"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6\") " pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294608    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-ovn-node-metrics-cert\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294632    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-host\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.296036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294664    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/776d35a0-6b5c-472c-8876-266451b05bb9-etc-tuned\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294678    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-slash\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294692    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/776d35a0-6b5c-472c-8876-266451b05bb9-tmp\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294702    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-log-socket\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294706    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc44f6dd-8313-4041-8194-258e506678e6-konnectivity-ca\") pod \"konnectivity-agent-56gzh\" (UID: \"bc44f6dd-8313-4041-8194-258e506678e6\") " pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294726    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-cni-bin\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294752    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-cni-netd\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294758    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-host\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294780    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-run\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294791    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-slash\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294803    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-device-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294803    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-log-socket\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294805    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-var-lib-kubelet\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294834    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-host-var-lib-kubelet\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294808    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abcd5f49-10f9-40e9-a066-075120793513-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294849    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-cni-netd\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294852    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/807fa39d-d488-431c-8d1f-2778e4119009-iptables-alerter-script\") pod \"iptables-alerter-ck5lm\" (UID: \"807fa39d-d488-431c-8d1f-2778e4119009\") " pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294896    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:01.296614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294904    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-cni-bin\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294923    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-var-lib-kubelet\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294947    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-multus-conf-dir\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294952    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-run\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294977    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc44f6dd-8313-4041-8194-258e506678e6-agent-certs\") pod \"konnectivity-agent-56gzh\" (UID: \"bc44f6dd-8313-4041-8194-258e506678e6\") " pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294987    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85906cfe-5556-403a-bfb1-aa1df8402461-multus-conf-dir\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.294994    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-var-lib-kubelet\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295061    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6-serviceca\") pod \"node-ca-4jtfg\" (UID: \"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6\") " pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295093    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abcd5f49-10f9-40e9-a066-075120793513-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295218    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-var-lib-openvswitch\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295264    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-sys\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295311    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-socket-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295328    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-run-ovn\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295330    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-var-lib-openvswitch\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295344    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295385    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-597tt\" (UniqueName: \"kubernetes.io/projected/85906cfe-5556-403a-bfb1-aa1df8402461-kube-api-access-597tt\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295417    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/776d35a0-6b5c-472c-8876-266451b05bb9-sys\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295427    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/807fa39d-d488-431c-8d1f-2778e4119009-iptables-alerter-script\") pod \"iptables-alerter-ck5lm\" (UID: \"807fa39d-d488-431c-8d1f-2778e4119009\") " pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.297203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295503    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-run-ovn\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.297731 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295538    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/004e88b8-2de8-46da-8565-fa5d3004a202-socket-dir\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.297731 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295550    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.297731 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295670    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abcd5f49-10f9-40e9-a066-075120793513-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.297731 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.295704    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6-serviceca\") pod \"node-ca-4jtfg\" (UID: \"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6\") " pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.297731 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.297463    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-ovn-node-metrics-cert\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.301764 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.301741    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 01:11:01.301764 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.301767    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 01:11:01.301922 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.301777    2579 projected.go:194] Error preparing data for projected volume kube-api-access-s62jw for pod openshift-network-diagnostics/network-check-target-2vxd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:01.301922 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.301840    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw podName:8cd69c33-3cd7-49b9-a6ac-fbcb013c8303 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:01.801823143 +0000 UTC m=+2.128607427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s62jw" (UniqueName: "kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw") pod "network-check-target-2vxd8" (UID: "8cd69c33-3cd7-49b9-a6ac-fbcb013c8303") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:01.305618 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.305503    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjwgt\" (UniqueName: \"kubernetes.io/projected/dae0945b-ed4e-4987-92bd-65482bf722e4-kube-api-access-wjwgt\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:01.306106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.305755    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-597tt\" (UniqueName: \"kubernetes.io/projected/85906cfe-5556-403a-bfb1-aa1df8402461-kube-api-access-597tt\") pod \"multus-247n4\" (UID: \"85906cfe-5556-403a-bfb1-aa1df8402461\") " pod="openshift-multus/multus-247n4"
May 26 01:11:01.306106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.305810    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjcpb\" (UniqueName: \"kubernetes.io/projected/b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240-kube-api-access-qjcpb\") pod \"node-resolver-kqzkc\" (UID: \"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240\") " pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.306106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.306063    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n4mg\" (UniqueName: \"kubernetes.io/projected/abcd5f49-10f9-40e9-a066-075120793513-kube-api-access-7n4mg\") pod \"multus-additional-cni-plugins-cmhwz\" (UID: \"abcd5f49-10f9-40e9-a066-075120793513\") " pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.307571 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.307545    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztj2p\" (UniqueName: \"kubernetes.io/projected/004e88b8-2de8-46da-8565-fa5d3004a202-kube-api-access-ztj2p\") pod \"aws-ebs-csi-driver-node-hbqk8\" (UID: \"004e88b8-2de8-46da-8565-fa5d3004a202\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.307732 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.307710    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjdd\" (UniqueName: \"kubernetes.io/projected/f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6-kube-api-access-xfjdd\") pod \"node-ca-4jtfg\" (UID: \"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6\") " pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.307801 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.307777    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b98t\" (UniqueName: \"kubernetes.io/projected/776d35a0-6b5c-472c-8876-266451b05bb9-kube-api-access-8b98t\") pod \"tuned-4hx5l\" (UID: \"776d35a0-6b5c-472c-8876-266451b05bb9\") " pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.307899 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.307861    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkzzm\" (UniqueName: \"kubernetes.io/projected/533eaf3f-97d8-4c51-a094-1a7fe5ef9a01-kube-api-access-nkzzm\") pod \"ovnkube-node-g2584\" (UID: \"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.308144 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.308128    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-247n4"
May 26 01:11:01.308467 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.308443    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdxgq\" (UniqueName: \"kubernetes.io/projected/807fa39d-d488-431c-8d1f-2778e4119009-kube-api-access-zdxgq\") pod \"iptables-alerter-ck5lm\" (UID: \"807fa39d-d488-431c-8d1f-2778e4119009\") " pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.369683 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.369650    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9660ea6fd56285e0df024d588ae3caaf.slice/crio-a8dd0847ef5fe7f3ca7304b8f6e6a3be7008c4b64dee174353e8091dfa39ab98 WatchSource:0}: Error finding container a8dd0847ef5fe7f3ca7304b8f6e6a3be7008c4b64dee174353e8091dfa39ab98: Status 404 returned error can't find the container with id a8dd0847ef5fe7f3ca7304b8f6e6a3be7008c4b64dee174353e8091dfa39ab98
May 26 01:11:01.369934 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.369914    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843a22a453c173574f663232f41db0b3.slice/crio-3adb35af45f0d229c05c76b1c39fcb7e85ef40aa518db503f578001035d5de58 WatchSource:0}: Error finding container 3adb35af45f0d229c05c76b1c39fcb7e85ef40aa518db503f578001035d5de58: Status 404 returned error can't find the container with id 3adb35af45f0d229c05c76b1c39fcb7e85ef40aa518db503f578001035d5de58
May 26 01:11:01.373999 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.373981    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 01:11:01.483877 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.483772    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ck5lm"
May 26 01:11:01.490004 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.489979    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807fa39d_d488_431c_8d1f_2778e4119009.slice/crio-88f6ff02cf3c9dd9c5c27fe78dcf4400a4cea79f2873230acb0bd159ae19773f WatchSource:0}: Error finding container 88f6ff02cf3c9dd9c5c27fe78dcf4400a4cea79f2873230acb0bd159ae19773f: Status 404 returned error can't find the container with id 88f6ff02cf3c9dd9c5c27fe78dcf4400a4cea79f2873230acb0bd159ae19773f
May 26 01:11:01.505131 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.505105    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:01.511624 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.511596    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533eaf3f_97d8_4c51_a094_1a7fe5ef9a01.slice/crio-5c841ad99f6c4265a4de09c6e0df6cd5f89b9971ab520898e4de84cef9559313 WatchSource:0}: Error finding container 5c841ad99f6c4265a4de09c6e0df6cd5f89b9971ab520898e4de84cef9559313: Status 404 returned error can't find the container with id 5c841ad99f6c4265a4de09c6e0df6cd5f89b9971ab520898e4de84cef9559313
May 26 01:11:01.533524 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.533490    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kqzkc"
May 26 01:11:01.537199 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.537171    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4jtfg"
May 26 01:11:01.542384 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.542356    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f4bd4e_c26c_4dc3_ab89_7edc53b9a240.slice/crio-53c73be7b0fdc4f53665dd4946eec66285c721eb146e2b3aaac91c95865f0c84 WatchSource:0}: Error finding container 53c73be7b0fdc4f53665dd4946eec66285c721eb146e2b3aaac91c95865f0c84: Status 404 returned error can't find the container with id 53c73be7b0fdc4f53665dd4946eec66285c721eb146e2b3aaac91c95865f0c84
May 26 01:11:01.544305 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.544282    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84f5a2b_39c6_4e9e_bf59_5a4b2510d3c6.slice/crio-ada808d67590f67cc177620328d7432f403f4a40c3381928ef3cd2a9261cc571 WatchSource:0}: Error finding container ada808d67590f67cc177620328d7432f403f4a40c3381928ef3cd2a9261cc571: Status 404 returned error can't find the container with id ada808d67590f67cc177620328d7432f403f4a40c3381928ef3cd2a9261cc571
May 26 01:11:01.550956 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.550931    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cmhwz"
May 26 01:11:01.556599 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.556575    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:01.557278 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.557253    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabcd5f49_10f9_40e9_a066_075120793513.slice/crio-3a314d8047859fcab0e224aa4b851f18e4c33a117aa3b7980bbdba869b967939 WatchSource:0}: Error finding container 3a314d8047859fcab0e224aa4b851f18e4c33a117aa3b7980bbdba869b967939: Status 404 returned error can't find the container with id 3a314d8047859fcab0e224aa4b851f18e4c33a117aa3b7980bbdba869b967939
May 26 01:11:01.563012 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.562984    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc44f6dd_8313_4041_8194_258e506678e6.slice/crio-fb10f0f7c686109fd59d49664b3ca118b07df86e803fc372d9583fa2d75a9b70 WatchSource:0}: Error finding container fb10f0f7c686109fd59d49664b3ca118b07df86e803fc372d9583fa2d75a9b70: Status 404 returned error can't find the container with id fb10f0f7c686109fd59d49664b3ca118b07df86e803fc372d9583fa2d75a9b70
May 26 01:11:01.570849 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.570829    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8"
May 26 01:11:01.576757 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.576732    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004e88b8_2de8_46da_8565_fa5d3004a202.slice/crio-72246b9e2e65e8bd169aff72d95b2ec8d86a678f723e1182189eeb1c9d3c3968 WatchSource:0}: Error finding container 72246b9e2e65e8bd169aff72d95b2ec8d86a678f723e1182189eeb1c9d3c3968: Status 404 returned error can't find the container with id 72246b9e2e65e8bd169aff72d95b2ec8d86a678f723e1182189eeb1c9d3c3968
May 26 01:11:01.593503 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.593465    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4hx5l"
May 26 01:11:01.600172 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.600147    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776d35a0_6b5c_472c_8876_266451b05bb9.slice/crio-6bb6ef5dfc9b3c35772f8e3ba24a62b5ebb744c8b0c594ab9000e68d09a4190d WatchSource:0}: Error finding container 6bb6ef5dfc9b3c35772f8e3ba24a62b5ebb744c8b0c594ab9000e68d09a4190d: Status 404 returned error can't find the container with id 6bb6ef5dfc9b3c35772f8e3ba24a62b5ebb744c8b0c594ab9000e68d09a4190d
May 26 01:11:01.659589 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:11:01.659559    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85906cfe_5556_403a_bfb1_aa1df8402461.slice/crio-46a63ae555f2429d872738914149b54cb60644e319fd73f72651c225bab7ed22 WatchSource:0}: Error finding container 46a63ae555f2429d872738914149b54cb60644e319fd73f72651c225bab7ed22: Status 404 returned error can't find the container with id 46a63ae555f2429d872738914149b54cb60644e319fd73f72651c225bab7ed22
May 26 01:11:01.800363 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.800311    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:01.800576 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.800492    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:01.800576 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.800571    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs podName:dae0945b-ed4e-4987-92bd-65482bf722e4 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:02.800551895 +0000 UTC m=+3.127336190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs") pod "network-metrics-daemon-bc4s7" (UID: "dae0945b-ed4e-4987-92bd-65482bf722e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:01.902298 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:01.901563    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:01.902298 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.901762    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 01:11:01.902298 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.901786    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 01:11:01.902298 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.901799    2579 projected.go:194] Error preparing data for projected volume kube-api-access-s62jw for pod openshift-network-diagnostics/network-check-target-2vxd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:01.902298 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:01.901864    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw podName:8cd69c33-3cd7-49b9-a6ac-fbcb013c8303 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:02.901844515 +0000 UTC m=+3.228628811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s62jw" (UniqueName: "kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw") pod "network-check-target-2vxd8" (UID: "8cd69c33-3cd7-49b9-a6ac-fbcb013c8303") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:02.152044 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.151761    2579 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 01:11:02.212332 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.212299    2579 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 01:11:02.216379 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.216291    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 01:06:01 +0000 UTC" deadline="2027-10-19 05:23:21.104071904 +0000 UTC"
May 26 01:11:02.216379 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.216325    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12268h12m18.887750052s"
May 26 01:11:02.338697 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.338607    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-247n4" event={"ID":"85906cfe-5556-403a-bfb1-aa1df8402461","Type":"ContainerStarted","Data":"46a63ae555f2429d872738914149b54cb60644e319fd73f72651c225bab7ed22"}
May 26 01:11:02.344432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.344334    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8" event={"ID":"004e88b8-2de8-46da-8565-fa5d3004a202","Type":"ContainerStarted","Data":"72246b9e2e65e8bd169aff72d95b2ec8d86a678f723e1182189eeb1c9d3c3968"}
May 26 01:11:02.355144 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.355008    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-56gzh" event={"ID":"bc44f6dd-8313-4041-8194-258e506678e6","Type":"ContainerStarted","Data":"fb10f0f7c686109fd59d49664b3ca118b07df86e803fc372d9583fa2d75a9b70"}
May 26 01:11:02.360226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.360187    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmhwz" event={"ID":"abcd5f49-10f9-40e9-a066-075120793513","Type":"ContainerStarted","Data":"3a314d8047859fcab0e224aa4b851f18e4c33a117aa3b7980bbdba869b967939"}
May 26 01:11:02.370678 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.370638    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kqzkc" event={"ID":"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240","Type":"ContainerStarted","Data":"53c73be7b0fdc4f53665dd4946eec66285c721eb146e2b3aaac91c95865f0c84"}
May 26 01:11:02.381897 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.381859    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" event={"ID":"843a22a453c173574f663232f41db0b3","Type":"ContainerStarted","Data":"3adb35af45f0d229c05c76b1c39fcb7e85ef40aa518db503f578001035d5de58"}
May 26 01:11:02.392011 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.391966    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" event={"ID":"9660ea6fd56285e0df024d588ae3caaf","Type":"ContainerStarted","Data":"a8dd0847ef5fe7f3ca7304b8f6e6a3be7008c4b64dee174353e8091dfa39ab98"}
May 26 01:11:02.405578 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.405415    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4hx5l" event={"ID":"776d35a0-6b5c-472c-8876-266451b05bb9","Type":"ContainerStarted","Data":"6bb6ef5dfc9b3c35772f8e3ba24a62b5ebb744c8b0c594ab9000e68d09a4190d"}
May 26 01:11:02.420688 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.420645    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4jtfg" event={"ID":"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6","Type":"ContainerStarted","Data":"ada808d67590f67cc177620328d7432f403f4a40c3381928ef3cd2a9261cc571"}
May 26 01:11:02.448061 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.447970    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" event={"ID":"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01","Type":"ContainerStarted","Data":"5c841ad99f6c4265a4de09c6e0df6cd5f89b9971ab520898e4de84cef9559313"}
May 26 01:11:02.471810 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.471762    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ck5lm" event={"ID":"807fa39d-d488-431c-8d1f-2778e4119009","Type":"ContainerStarted","Data":"88f6ff02cf3c9dd9c5c27fe78dcf4400a4cea79f2873230acb0bd159ae19773f"}
May 26 01:11:02.810635 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.810596    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:02.810814 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:02.810749    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:02.810814 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:02.810811    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs podName:dae0945b-ed4e-4987-92bd-65482bf722e4 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:04.810792657 +0000 UTC m=+5.137576945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs") pod "network-metrics-daemon-bc4s7" (UID: "dae0945b-ed4e-4987-92bd-65482bf722e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:02.911790 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:02.911743    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:02.911982 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:02.911955    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 01:11:02.911982 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:02.911977    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 01:11:02.912086 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:02.911990    2579 projected.go:194] Error preparing data for projected volume kube-api-access-s62jw for pod openshift-network-diagnostics/network-check-target-2vxd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:02.912086 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:02.912053    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw podName:8cd69c33-3cd7-49b9-a6ac-fbcb013c8303 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:04.912034708 +0000 UTC m=+5.238818997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s62jw" (UniqueName: "kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw") pod "network-check-target-2vxd8" (UID: "8cd69c33-3cd7-49b9-a6ac-fbcb013c8303") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:03.217431 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:03.217291    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 01:06:01 +0000 UTC" deadline="2027-12-21 16:33:31.169638594 +0000 UTC"
May 26 01:11:03.217431 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:03.217334    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13791h22m27.952308642s"
May 26 01:11:03.323456 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:03.323415    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:03.323653 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:03.323587    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:03.324001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:03.323416    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:03.324894 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:03.324861    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:03.360290 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:03.360257    2579 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 01:11:04.167111 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:04.167077    2579 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 01:11:04.827653 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:04.827612    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:04.828127 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:04.827762    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:04.828127 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:04.827832    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs podName:dae0945b-ed4e-4987-92bd-65482bf722e4 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:08.827811249 +0000 UTC m=+9.154595532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs") pod "network-metrics-daemon-bc4s7" (UID: "dae0945b-ed4e-4987-92bd-65482bf722e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:04.928236 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:04.928201    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:04.928460 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:04.928419    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 01:11:04.928460 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:04.928444    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 01:11:04.928460 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:04.928457    2579 projected.go:194] Error preparing data for projected volume kube-api-access-s62jw for pod openshift-network-diagnostics/network-check-target-2vxd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:04.928633 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:04.928520    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw podName:8cd69c33-3cd7-49b9-a6ac-fbcb013c8303 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:08.928500842 +0000 UTC m=+9.255285143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s62jw" (UniqueName: "kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw") pod "network-check-target-2vxd8" (UID: "8cd69c33-3cd7-49b9-a6ac-fbcb013c8303") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:05.319761 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:05.319724    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:05.319962 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:05.319867    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:05.319962 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:05.319941    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:05.320092 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:05.320007    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:07.319822 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:07.319787    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:07.320183 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:07.319912    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:07.320279 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:07.320264    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:07.320348 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:07.320333    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:08.860273 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:08.860217    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:08.860782 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:08.860381    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:08.860782 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:08.860460    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs podName:dae0945b-ed4e-4987-92bd-65482bf722e4 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:16.860440652 +0000 UTC m=+17.187224938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs") pod "network-metrics-daemon-bc4s7" (UID: "dae0945b-ed4e-4987-92bd-65482bf722e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:08.961330 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:08.961282    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:08.961535 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:08.961465    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 01:11:08.961535 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:08.961487    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 01:11:08.961535 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:08.961497    2579 projected.go:194] Error preparing data for projected volume kube-api-access-s62jw for pod openshift-network-diagnostics/network-check-target-2vxd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:08.961691 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:08.961550    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw podName:8cd69c33-3cd7-49b9-a6ac-fbcb013c8303 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:16.961536467 +0000 UTC m=+17.288320750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s62jw" (UniqueName: "kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw") pod "network-check-target-2vxd8" (UID: "8cd69c33-3cd7-49b9-a6ac-fbcb013c8303") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:09.320560 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:09.320073    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:09.320560 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:09.320187    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:09.320560 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:09.320249    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:09.320560 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:09.320382    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:11.319595 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:11.319560    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:11.320012 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:11.319688    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:11.320059 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:11.320018    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:11.320107 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:11.320089    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:13.319306 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:13.319268    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:13.319306 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:13.319301    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:13.319819 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:13.319435    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:13.319892 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:13.319858    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:15.319234 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:15.319191    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:15.319673 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:15.319191    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:15.319673 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:15.319312    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:15.319673 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:15.319442    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:16.917734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:16.917687    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:16.918099 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:16.917824    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:16.918099 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:16.917887    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs podName:dae0945b-ed4e-4987-92bd-65482bf722e4 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:32.917869916 +0000 UTC m=+33.244654199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs") pod "network-metrics-daemon-bc4s7" (UID: "dae0945b-ed4e-4987-92bd-65482bf722e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:17.018866 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:17.018817    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:17.019058 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:17.018994    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 01:11:17.019058 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:17.019017    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 01:11:17.019058 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:17.019030    2579 projected.go:194] Error preparing data for projected volume kube-api-access-s62jw for pod openshift-network-diagnostics/network-check-target-2vxd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:17.019160 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:17.019090    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw podName:8cd69c33-3cd7-49b9-a6ac-fbcb013c8303 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:33.019076418 +0000 UTC m=+33.345860704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s62jw" (UniqueName: "kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw") pod "network-check-target-2vxd8" (UID: "8cd69c33-3cd7-49b9-a6ac-fbcb013c8303") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:17.319858 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:17.319772    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:17.320015 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:17.319771    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:17.320015 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:17.319923    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:17.320015 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:17.319961    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:19.319892 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:19.319846    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:19.320297 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:19.319846    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:19.320297 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:19.319960    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:19.320297 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:19.320038    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:21.320204 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:21.319766    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:21.320204 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:21.319923    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:21.320662 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:21.320281    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:21.320662 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:21.320435    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:21.515293 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:21.515102    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" event={"ID":"9660ea6fd56285e0df024d588ae3caaf","Type":"ContainerStarted","Data":"d5146f419a58398fcae74ab947460429751f0556d61bda3bf2047a824e0077fd"}
May 26 01:11:21.516449 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:21.516416    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4hx5l" event={"ID":"776d35a0-6b5c-472c-8876-266451b05bb9","Type":"ContainerStarted","Data":"a904b3419fa606697209b6e341fd2fb22ee04d449e211bf56475db4dafd6ed29"}
May 26 01:11:21.517660 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:21.517637    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-247n4" event={"ID":"85906cfe-5556-403a-bfb1-aa1df8402461","Type":"ContainerStarted","Data":"719f395da7deb54c1e31242c3b7e1efbc023ef5c887b3f8bfaa21c1ecfad26a3"}
May 26 01:11:21.542576 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:21.542522    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-139.ec2.internal" podStartSLOduration=20.542509183 podStartE2EDuration="20.542509183s" podCreationTimestamp="2026-05-26 01:11:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:11:21.528992669 +0000 UTC m=+21.855776974" watchObservedRunningTime="2026-05-26 01:11:21.542509183 +0000 UTC m=+21.869293488"
May 26 01:11:21.542706 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:21.542653    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4hx5l" podStartSLOduration=1.987515989 podStartE2EDuration="21.54264854s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:01.601908304 +0000 UTC m=+1.928692586" lastFinishedPulling="2026-05-26 01:11:21.15704084 +0000 UTC m=+21.483825137" observedRunningTime="2026-05-26 01:11:21.542017336 +0000 UTC m=+21.868801640" watchObservedRunningTime="2026-05-26 01:11:21.54264854 +0000 UTC m=+21.869432843"
May 26 01:11:21.555340 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:21.555290    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-247n4" podStartSLOduration=2.026796822 podStartE2EDuration="21.555277549s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:01.661258893 +0000 UTC m=+1.988043175" lastFinishedPulling="2026-05-26 01:11:21.189739615 +0000 UTC m=+21.516523902" observedRunningTime="2026-05-26 01:11:21.555149305 +0000 UTC m=+21.881933609" watchObservedRunningTime="2026-05-26 01:11:21.555277549 +0000 UTC m=+21.882061853"
May 26 01:11:22.521940 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.521683    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4jtfg" event={"ID":"f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6","Type":"ContainerStarted","Data":"c72457f8943b682185f3be80d78bc00fef54334c1cf300e36bb308428eeb7e01"}
May 26 01:11:22.525901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.525812    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" event={"ID":"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01","Type":"ContainerStarted","Data":"5685e0162c41eeab81e23a638a08460c5459484e746a97046d067ba5bb82741b"}
May 26 01:11:22.525901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.525848    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" event={"ID":"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01","Type":"ContainerStarted","Data":"5c3a38ee7bd0215baeee479be93b46eb603a39e539dabf63d56a067160b278ba"}
May 26 01:11:22.525901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.525861    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" event={"ID":"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01","Type":"ContainerStarted","Data":"8ac4801a5800c3bbf3e8c4e64f8f59713c1d9d2adecf03e51ace29156298e661"}
May 26 01:11:22.525901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.525870    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" event={"ID":"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01","Type":"ContainerStarted","Data":"9639e065d1e6c29c3902f1ea1ffacb2c01e0c3df65d5e0c10c54ee87cc36c129"}
May 26 01:11:22.525901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.525877    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" event={"ID":"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01","Type":"ContainerStarted","Data":"38d463566c2d50cae8116ab2313e20ee66bdd93140809ca49928b378af5b15ed"}
May 26 01:11:22.525901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.525885    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" event={"ID":"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01","Type":"ContainerStarted","Data":"75bf7136dfedb499c82b4258b0c8f43e7e87254b4b3a0995bc1bdc3780a8fa19"}
May 26 01:11:22.527579 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.527442    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8" event={"ID":"004e88b8-2de8-46da-8565-fa5d3004a202","Type":"ContainerStarted","Data":"2ca5eda33ecd614beae0b137cc4e47a708fabffdda8d003070b64b0e53ef261d"}
May 26 01:11:22.528930 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.528911    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-56gzh" event={"ID":"bc44f6dd-8313-4041-8194-258e506678e6","Type":"ContainerStarted","Data":"512313eb083fd4fc7ca931e174de27d9e42e471c59f350a5a06701d20df33aa1"}
May 26 01:11:22.530490 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.530464    2579 generic.go:358] "Generic (PLEG): container finished" podID="abcd5f49-10f9-40e9-a066-075120793513" containerID="07f1d6da30d5e7ed4942598cf5be51bbd2f3b850d8bcdbbbe54710bfeb40862c" exitCode=0
May 26 01:11:22.530593 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.530527    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmhwz" event={"ID":"abcd5f49-10f9-40e9-a066-075120793513","Type":"ContainerDied","Data":"07f1d6da30d5e7ed4942598cf5be51bbd2f3b850d8bcdbbbe54710bfeb40862c"}
May 26 01:11:22.532471 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.532450    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kqzkc" event={"ID":"b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240","Type":"ContainerStarted","Data":"c31246c2ee4be40e798edc3e12a72e27fffd240455c0f35d8075a9a9d3cb33ee"}
May 26 01:11:22.534139 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.534101    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4jtfg" podStartSLOduration=3.023703721 podStartE2EDuration="22.534087665s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:01.545880187 +0000 UTC m=+1.872664469" lastFinishedPulling="2026-05-26 01:11:21.056264116 +0000 UTC m=+21.383048413" observedRunningTime="2026-05-26 01:11:22.534053364 +0000 UTC m=+22.860837662" watchObservedRunningTime="2026-05-26 01:11:22.534087665 +0000 UTC m=+22.860871970"
May 26 01:11:22.535141 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.535115    2579 generic.go:358] "Generic (PLEG): container finished" podID="843a22a453c173574f663232f41db0b3" containerID="de376ebdef6d15b727779d02625832702910f61074d69341d308404efb7655f4" exitCode=0
May 26 01:11:22.535236 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.535185    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" event={"ID":"843a22a453c173574f663232f41db0b3","Type":"ContainerDied","Data":"de376ebdef6d15b727779d02625832702910f61074d69341d308404efb7655f4"}
May 26 01:11:22.570219 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.570066    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-kqzkc" podStartSLOduration=2.959037841 podStartE2EDuration="22.570046858s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:01.544129501 +0000 UTC m=+1.870913784" lastFinishedPulling="2026-05-26 01:11:21.155138514 +0000 UTC m=+21.481922801" observedRunningTime="2026-05-26 01:11:22.568881277 +0000 UTC m=+22.895665605" watchObservedRunningTime="2026-05-26 01:11:22.570046858 +0000 UTC m=+22.896831162"
May 26 01:11:22.583130 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:22.583059    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-56gzh" podStartSLOduration=11.247209946 podStartE2EDuration="22.583040426s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:01.564964458 +0000 UTC m=+1.891748743" lastFinishedPulling="2026-05-26 01:11:12.900794935 +0000 UTC m=+13.227579223" observedRunningTime="2026-05-26 01:11:22.582007676 +0000 UTC m=+22.908791981" watchObservedRunningTime="2026-05-26 01:11:22.583040426 +0000 UTC m=+22.909824759"
May 26 01:11:23.319545 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:23.319243    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:23.319545 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:23.319513    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:23.319802 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:23.319306    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:23.319884 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:23.319868    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:23.441972 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:23.441949    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 01:11:23.539011 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:23.538925    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8" event={"ID":"004e88b8-2de8-46da-8565-fa5d3004a202","Type":"ContainerStarted","Data":"290a15bf74f7433b333630805db49956e249e4088677f07346f55ff96c55f7e7"}
May 26 01:11:23.541096 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:23.541067    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" event={"ID":"843a22a453c173574f663232f41db0b3","Type":"ContainerStarted","Data":"c84d50e7df946cad713886f3c3f831536b3945ed920397322039c48a7417e9bc"}
May 26 01:11:23.542609 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:23.542585    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ck5lm" event={"ID":"807fa39d-d488-431c-8d1f-2778e4119009","Type":"ContainerStarted","Data":"228d38bafcf6bd4d6a25e73b11001fea11677dbeafafda58fb814cffcb67abfb"}
May 26 01:11:23.555782 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:23.555671    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-139.ec2.internal" podStartSLOduration=22.555655586 podStartE2EDuration="22.555655586s" podCreationTimestamp="2026-05-26 01:11:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:11:23.555301285 +0000 UTC m=+23.882085584" watchObservedRunningTime="2026-05-26 01:11:23.555655586 +0000 UTC m=+23.882439891"
May 26 01:11:23.569495 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:23.569453    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ck5lm" podStartSLOduration=3.932334406 podStartE2EDuration="23.569440981s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:01.491439916 +0000 UTC m=+1.818224197" lastFinishedPulling="2026-05-26 01:11:21.128546484 +0000 UTC m=+21.455330772" observedRunningTime="2026-05-26 01:11:23.56917033 +0000 UTC m=+23.895954643" watchObservedRunningTime="2026-05-26 01:11:23.569440981 +0000 UTC m=+23.896225285"
May 26 01:11:24.258641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:24.258546    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T01:11:23.441966853Z","UUID":"69692c25-9074-4e38-9a1b-bc2748ebb7d0","Handler":null,"Name":"","Endpoint":""}
May 26 01:11:24.260147 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:24.260129    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 01:11:24.260260 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:24.260155    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 01:11:24.840553 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:24.840460    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:24.841123 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:24.841103    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:25.319850 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:25.319818    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:25.320036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:25.319821    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:25.320036 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:25.319921    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:25.320036 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:25.319994    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:25.547604 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:25.547565    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8" event={"ID":"004e88b8-2de8-46da-8565-fa5d3004a202","Type":"ContainerStarted","Data":"42a6f56955da9cb0f5a00ebf04e9a4d7722a5fae2f3dc4dddbce9612407d7d95"}
May 26 01:11:25.551136 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:25.551100    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" event={"ID":"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01","Type":"ContainerStarted","Data":"9635166dc9aa6c2321b74aef5d3a377cf7f8a55adf95472fca60b5bf7bbddf42"}
May 26 01:11:25.551136 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:25.551139    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:25.551797 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:25.551776    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-56gzh"
May 26 01:11:25.561979 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:25.561937    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbqk8" podStartSLOduration=2.501506959 podStartE2EDuration="25.561926962s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:01.578273954 +0000 UTC m=+1.905058236" lastFinishedPulling="2026-05-26 01:11:24.638693955 +0000 UTC m=+24.965478239" observedRunningTime="2026-05-26 01:11:25.56181254 +0000 UTC m=+25.888596844" watchObservedRunningTime="2026-05-26 01:11:25.561926962 +0000 UTC m=+25.888711266"
May 26 01:11:27.320175 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:27.319988    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:27.320632 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:27.319988    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:27.320632 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:27.320266    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:27.320632 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:27.320310    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:28.560533 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:28.560442    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" event={"ID":"533eaf3f-97d8-4c51-a094-1a7fe5ef9a01","Type":"ContainerStarted","Data":"ff2bf380cb683e2d63e8cffbd2a3198fd13402ebab6ddac2e7d31c2e747d17e9"}
May 26 01:11:28.561049 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:28.560726    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:28.561049 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:28.560752    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:28.577534 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:28.577507    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:28.585970 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:28.585888    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g2584" podStartSLOduration=8.267599821 podStartE2EDuration="28.585873159s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:01.513150409 +0000 UTC m=+1.839934691" lastFinishedPulling="2026-05-26 01:11:21.831423734 +0000 UTC m=+22.158208029" observedRunningTime="2026-05-26 01:11:28.585089204 +0000 UTC m=+28.911873507" watchObservedRunningTime="2026-05-26 01:11:28.585873159 +0000 UTC m=+28.912657463"
May 26 01:11:29.319866 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:29.319684    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:29.320034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:29.319751    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:29.320034 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:29.319994    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:29.320117 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:29.320035    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:29.563516 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:29.563484    2579 generic.go:358] "Generic (PLEG): container finished" podID="abcd5f49-10f9-40e9-a066-075120793513" containerID="b869cd4a38687ace2a9f3e5e8dccb4be8cba3752a15e20cd494de5908f7abec9" exitCode=0
May 26 01:11:29.563940 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:29.563576    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmhwz" event={"ID":"abcd5f49-10f9-40e9-a066-075120793513","Type":"ContainerDied","Data":"b869cd4a38687ace2a9f3e5e8dccb4be8cba3752a15e20cd494de5908f7abec9"}
May 26 01:11:29.564851 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:29.564276    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:29.583380 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:29.583300    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:11:30.348515 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:30.348482    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bc4s7"]
May 26 01:11:30.348687 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:30.348616    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:30.348771 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:30.348748    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:30.349361 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:30.349337    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2vxd8"]
May 26 01:11:30.349492 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:30.349439    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:30.349536 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:30.349518    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:31.569187 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:31.569153    2579 generic.go:358] "Generic (PLEG): container finished" podID="abcd5f49-10f9-40e9-a066-075120793513" containerID="95ba970ff42afc9878ef3e8ad5e10d5372b4db4b53b2dfdaea447bbcd1b2d37a" exitCode=0
May 26 01:11:31.570012 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:31.569238    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmhwz" event={"ID":"abcd5f49-10f9-40e9-a066-075120793513","Type":"ContainerDied","Data":"95ba970ff42afc9878ef3e8ad5e10d5372b4db4b53b2dfdaea447bbcd1b2d37a"}
May 26 01:11:32.319948 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:32.319744    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:32.320107 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:32.319805    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:32.320107 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:32.320058    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:32.320225 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:32.320130    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:32.932354 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:32.932323    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:32.932691 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:32.932476    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:32.932691 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:32.932542    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs podName:dae0945b-ed4e-4987-92bd-65482bf722e4 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:04.932525275 +0000 UTC m=+65.259309560 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs") pod "network-metrics-daemon-bc4s7" (UID: "dae0945b-ed4e-4987-92bd-65482bf722e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 01:11:33.033633 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:33.033599    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:33.033810 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:33.033777    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 01:11:33.033810 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:33.033801    2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 01:11:33.033877 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:33.033813    2579 projected.go:194] Error preparing data for projected volume kube-api-access-s62jw for pod openshift-network-diagnostics/network-check-target-2vxd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:33.033877 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:33.033866    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw podName:8cd69c33-3cd7-49b9-a6ac-fbcb013c8303 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:05.033852479 +0000 UTC m=+65.360636762 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s62jw" (UniqueName: "kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw") pod "network-check-target-2vxd8" (UID: "8cd69c33-3cd7-49b9-a6ac-fbcb013c8303") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 01:11:33.575067 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:33.575030    2579 generic.go:358] "Generic (PLEG): container finished" podID="abcd5f49-10f9-40e9-a066-075120793513" containerID="1cf860a3a27b0122d87dfeec3b0ec6efe7a009f2e932ddfe6b0ae830e00801ac" exitCode=0
May 26 01:11:33.575204 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:33.575086    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmhwz" event={"ID":"abcd5f49-10f9-40e9-a066-075120793513","Type":"ContainerDied","Data":"1cf860a3a27b0122d87dfeec3b0ec6efe7a009f2e932ddfe6b0ae830e00801ac"}
May 26 01:11:34.319270 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.319226    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:34.319270 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.319270    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:34.319720 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:34.319354    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vxd8" podUID="8cd69c33-3cd7-49b9-a6ac-fbcb013c8303"
May 26 01:11:34.319720 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:34.319498    2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4s7" podUID="dae0945b-ed4e-4987-92bd-65482bf722e4"
May 26 01:11:34.457942 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.457860    2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-139.ec2.internal" event="NodeReady"
May 26 01:11:34.458082 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.458017    2579 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 01:11:34.494244 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.494210    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xglqs"]
May 26 01:11:34.511229 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.511193    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pk67n"]
May 26 01:11:34.511394 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.511361    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.515990 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.515150    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 01:11:34.515990 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.515459    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bf7j4\""
May 26 01:11:34.515990 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.515668    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 01:11:34.527952 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.527883    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pk67n"]
May 26 01:11:34.527952 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.527926    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xglqs"]
May 26 01:11:34.528154 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.528010    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:34.532321 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.532292    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4xl9v\""
May 26 01:11:34.533457 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.533436    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 01:11:34.533457 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.533455    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 01:11:34.533636 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.533487    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 01:11:34.646560 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.646512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcd02f6-2068-461e-8883-96f827dd4691-tmp-dir\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.646560 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.646558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.646791 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.646594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwkcq\" (UniqueName: \"kubernetes.io/projected/5dcd02f6-2068-461e-8883-96f827dd4691-kube-api-access-nwkcq\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.646791 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.646629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dcd02f6-2068-461e-8883-96f827dd4691-config-volume\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.646791 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.646657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:34.646791 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.646711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7kth\" (UniqueName: \"kubernetes.io/projected/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-kube-api-access-m7kth\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:34.748083 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.747993    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwkcq\" (UniqueName: \"kubernetes.io/projected/5dcd02f6-2068-461e-8883-96f827dd4691-kube-api-access-nwkcq\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.748083 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.748051    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dcd02f6-2068-461e-8883-96f827dd4691-config-volume\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.748309 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.748093    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:34.748309 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.748118    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7kth\" (UniqueName: \"kubernetes.io/projected/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-kube-api-access-m7kth\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:34.748309 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.748153    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcd02f6-2068-461e-8883-96f827dd4691-tmp-dir\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.748309 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.748177    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.748309 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:34.748241    2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 01:11:34.748309 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:34.748262    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 01:11:34.748613 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:34.748316    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert podName:ec9edbf7-a34a-487c-98f0-3a17c2de9b84 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:35.248292514 +0000 UTC m=+35.575076812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert") pod "ingress-canary-pk67n" (UID: "ec9edbf7-a34a-487c-98f0-3a17c2de9b84") : secret "canary-serving-cert" not found
May 26 01:11:34.748613 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:34.748338    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls podName:5dcd02f6-2068-461e-8883-96f827dd4691 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:35.248327904 +0000 UTC m=+35.575112200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls") pod "dns-default-xglqs" (UID: "5dcd02f6-2068-461e-8883-96f827dd4691") : secret "dns-default-metrics-tls" not found
May 26 01:11:34.748613 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.748500    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcd02f6-2068-461e-8883-96f827dd4691-tmp-dir\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.748755 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.748647    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dcd02f6-2068-461e-8883-96f827dd4691-config-volume\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.757324 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.757297    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwkcq\" (UniqueName: \"kubernetes.io/projected/5dcd02f6-2068-461e-8883-96f827dd4691-kube-api-access-nwkcq\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:34.757466 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:34.757435    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7kth\" (UniqueName: \"kubernetes.io/projected/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-kube-api-access-m7kth\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:35.251076 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:35.251038    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:35.251396 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:35.251096    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:35.251396 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:35.251195    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 01:11:35.251396 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:35.251200    2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 01:11:35.251396 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:35.251249    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls podName:5dcd02f6-2068-461e-8883-96f827dd4691 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:36.251230752 +0000 UTC m=+36.578015035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls") pod "dns-default-xglqs" (UID: "5dcd02f6-2068-461e-8883-96f827dd4691") : secret "dns-default-metrics-tls" not found
May 26 01:11:35.251396 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:35.251346    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert podName:ec9edbf7-a34a-487c-98f0-3a17c2de9b84 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:36.251328383 +0000 UTC m=+36.578112678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert") pod "ingress-canary-pk67n" (UID: "ec9edbf7-a34a-487c-98f0-3a17c2de9b84") : secret "canary-serving-cert" not found
May 26 01:11:36.258246 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:36.258192    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:36.258720 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:36.258261    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:36.258720 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:36.258364    2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 01:11:36.258720 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:36.258389    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 01:11:36.258720 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:36.258459    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert podName:ec9edbf7-a34a-487c-98f0-3a17c2de9b84 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:38.258439261 +0000 UTC m=+38.585223542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert") pod "ingress-canary-pk67n" (UID: "ec9edbf7-a34a-487c-98f0-3a17c2de9b84") : secret "canary-serving-cert" not found
May 26 01:11:36.258720 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:36.258476    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls podName:5dcd02f6-2068-461e-8883-96f827dd4691 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:38.258469091 +0000 UTC m=+38.585253374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls") pod "dns-default-xglqs" (UID: "5dcd02f6-2068-461e-8883-96f827dd4691") : secret "dns-default-metrics-tls" not found
May 26 01:11:36.319374 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:36.319335    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:11:36.319582 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:36.319557    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:11:36.322343 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:36.322320    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pvgkt\""
May 26 01:11:36.322522 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:36.322365    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 01:11:36.322522 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:36.322371    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 01:11:36.322522 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:36.322320    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 01:11:36.322692 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:36.322569    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-srh2n\""
May 26 01:11:38.274173 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:38.274107    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:38.274619 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:38.274201    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:38.274619 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:38.274286    2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 01:11:38.274619 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:38.274317    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 01:11:38.274619 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:38.274360    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert podName:ec9edbf7-a34a-487c-98f0-3a17c2de9b84 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:42.274338983 +0000 UTC m=+42.601123271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert") pod "ingress-canary-pk67n" (UID: "ec9edbf7-a34a-487c-98f0-3a17c2de9b84") : secret "canary-serving-cert" not found
May 26 01:11:38.274619 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:38.274379    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls podName:5dcd02f6-2068-461e-8883-96f827dd4691 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:42.274372087 +0000 UTC m=+42.601156369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls") pod "dns-default-xglqs" (UID: "5dcd02f6-2068-461e-8883-96f827dd4691") : secret "dns-default-metrics-tls" not found
May 26 01:11:40.591113 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:40.591075    2579 generic.go:358] "Generic (PLEG): container finished" podID="abcd5f49-10f9-40e9-a066-075120793513" containerID="ced47192ef9095fc68a2df9cf05737073d60b28c8056a0a557eb2f72cab84808" exitCode=0
May 26 01:11:40.591497 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:40.591132    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmhwz" event={"ID":"abcd5f49-10f9-40e9-a066-075120793513","Type":"ContainerDied","Data":"ced47192ef9095fc68a2df9cf05737073d60b28c8056a0a557eb2f72cab84808"}
May 26 01:11:41.595524 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:41.595488    2579 generic.go:358] "Generic (PLEG): container finished" podID="abcd5f49-10f9-40e9-a066-075120793513" containerID="da8d738b20162ecedcad05397da5c531d5a6c1d0e297c655183b195e960c886e" exitCode=0
May 26 01:11:41.595884 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:41.595557    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmhwz" event={"ID":"abcd5f49-10f9-40e9-a066-075120793513","Type":"ContainerDied","Data":"da8d738b20162ecedcad05397da5c531d5a6c1d0e297c655183b195e960c886e"}
May 26 01:11:42.302797 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:42.302753    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:42.302987 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:42.302825    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:42.302987 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:42.302902    2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 01:11:42.302987 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:42.302926    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 01:11:42.302987 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:42.302966    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert podName:ec9edbf7-a34a-487c-98f0-3a17c2de9b84 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:50.302951307 +0000 UTC m=+50.629735588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert") pod "ingress-canary-pk67n" (UID: "ec9edbf7-a34a-487c-98f0-3a17c2de9b84") : secret "canary-serving-cert" not found
May 26 01:11:42.302987 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:42.302983    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls podName:5dcd02f6-2068-461e-8883-96f827dd4691 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:50.302976922 +0000 UTC m=+50.629761204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls") pod "dns-default-xglqs" (UID: "5dcd02f6-2068-461e-8883-96f827dd4691") : secret "dns-default-metrics-tls" not found
May 26 01:11:42.600964 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:42.600879    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmhwz" event={"ID":"abcd5f49-10f9-40e9-a066-075120793513","Type":"ContainerStarted","Data":"9ca36009cedb41f0505834517227ea406f3a91d3f8ce0aceaed00797a1446024"}
May 26 01:11:42.623206 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:42.623155    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cmhwz" podStartSLOduration=4.394301271 podStartE2EDuration="42.623137912s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:01.559605855 +0000 UTC m=+1.886390137" lastFinishedPulling="2026-05-26 01:11:39.788442495 +0000 UTC m=+40.115226778" observedRunningTime="2026-05-26 01:11:42.621984194 +0000 UTC m=+42.948768498" watchObservedRunningTime="2026-05-26 01:11:42.623137912 +0000 UTC m=+42.949922216"
May 26 01:11:50.357080 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:50.357040    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:11:50.357550 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:11:50.357093    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:11:50.357550 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:50.357213    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 01:11:50.357550 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:50.357213    2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 01:11:50.357550 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:50.357285    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert podName:ec9edbf7-a34a-487c-98f0-3a17c2de9b84 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:06.357264282 +0000 UTC m=+66.684048564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert") pod "ingress-canary-pk67n" (UID: "ec9edbf7-a34a-487c-98f0-3a17c2de9b84") : secret "canary-serving-cert" not found
May 26 01:11:50.357550 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:11:50.357299    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls podName:5dcd02f6-2068-461e-8883-96f827dd4691 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:06.357293536 +0000 UTC m=+66.684077818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls") pod "dns-default-xglqs" (UID: "5dcd02f6-2068-461e-8883-96f827dd4691") : secret "dns-default-metrics-tls" not found
May 26 01:12:01.580072 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:01.580045    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2584"
May 26 01:12:04.958545 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:04.958490    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:12:04.960685 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:04.960666    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 01:12:04.969199 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:04.969175    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 01:12:04.969295 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:04.969283    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs podName:dae0945b-ed4e-4987-92bd-65482bf722e4 nodeName:}" failed. No retries permitted until 2026-05-26 01:13:08.969263092 +0000 UTC m=+129.296047394 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs") pod "network-metrics-daemon-bc4s7" (UID: "dae0945b-ed4e-4987-92bd-65482bf722e4") : secret "metrics-daemon-secret" not found
May 26 01:12:05.058833 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:05.058798    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:12:05.061141 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:05.061123    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 01:12:05.071907 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:05.071885    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 01:12:05.083702 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:05.083671    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s62jw\" (UniqueName: \"kubernetes.io/projected/8cd69c33-3cd7-49b9-a6ac-fbcb013c8303-kube-api-access-s62jw\") pod \"network-check-target-2vxd8\" (UID: \"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303\") " pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:12:05.133700 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:05.133670    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pvgkt\""
May 26 01:12:05.142358 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:05.142327    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:12:05.278616 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:05.278579    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2vxd8"]
May 26 01:12:05.282458 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:05.282433    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd69c33_3cd7_49b9_a6ac_fbcb013c8303.slice/crio-d94af787a02fe79cbdc78e72f229c0ec98ce314e461750ce5e146c135f9569e9 WatchSource:0}: Error finding container d94af787a02fe79cbdc78e72f229c0ec98ce314e461750ce5e146c135f9569e9: Status 404 returned error can't find the container with id d94af787a02fe79cbdc78e72f229c0ec98ce314e461750ce5e146c135f9569e9
May 26 01:12:05.643150 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:05.643107    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2vxd8" event={"ID":"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303","Type":"ContainerStarted","Data":"d94af787a02fe79cbdc78e72f229c0ec98ce314e461750ce5e146c135f9569e9"}
May 26 01:12:06.366609 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:06.366565    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:12:06.367047 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:06.366668    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:12:06.367047 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:06.366708    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 01:12:06.367047 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:06.366781    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls podName:5dcd02f6-2068-461e-8883-96f827dd4691 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:38.366764299 +0000 UTC m=+98.693548581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls") pod "dns-default-xglqs" (UID: "5dcd02f6-2068-461e-8883-96f827dd4691") : secret "dns-default-metrics-tls" not found
May 26 01:12:06.367047 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:06.366790    2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 01:12:06.367047 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:06.366843    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert podName:ec9edbf7-a34a-487c-98f0-3a17c2de9b84 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:38.366826738 +0000 UTC m=+98.693611029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert") pod "ingress-canary-pk67n" (UID: "ec9edbf7-a34a-487c-98f0-3a17c2de9b84") : secret "canary-serving-cert" not found
May 26 01:12:08.651136 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:08.651094    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2vxd8" event={"ID":"8cd69c33-3cd7-49b9-a6ac-fbcb013c8303","Type":"ContainerStarted","Data":"70b7dbade7a81482abfa2bbb088fe591e92ec6d32eb9c1b70e354975deceedb5"}
May 26 01:12:08.651584 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:08.651251    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:12:08.665360 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:08.665313    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2vxd8" podStartSLOduration=65.974821154 podStartE2EDuration="1m8.665300011s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:12:05.284447512 +0000 UTC m=+65.611231794" lastFinishedPulling="2026-05-26 01:12:07.974926362 +0000 UTC m=+68.301710651" observedRunningTime="2026-05-26 01:12:08.664618744 +0000 UTC m=+68.991403049" watchObservedRunningTime="2026-05-26 01:12:08.665300011 +0000 UTC m=+68.992084315"
May 26 01:12:23.127592 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.127474    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc"]
May 26 01:12:23.129774 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.129757    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc"
May 26 01:12:23.131227 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.131202    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"]
May 26 01:12:23.132162 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.132142    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 26 01:12:23.132313 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.132295    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-m5snq\""
May 26 01:12:23.132724 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.132708    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.132808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.132791    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 26 01:12:23.134614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.134595    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 01:12:23.135180 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.135145    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9vmtf\""
May 26 01:12:23.135679 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.135625    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 26 01:12:23.135751 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.135657    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 26 01:12:23.135751 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.135663    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 01:12:23.145692 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.145663    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc"]
May 26 01:12:23.146611 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.146591    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"]
May 26 01:12:23.173371 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.173332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnp8k\" (UniqueName: \"kubernetes.io/projected/d7c17da1-875b-4e74-8635-34c466ee4720-kube-api-access-tnp8k\") pod \"volume-data-source-validator-5cf8c89d64-8rghc\" (UID: \"d7c17da1-875b-4e74-8635-34c466ee4720\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc"
May 26 01:12:23.173371 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.173371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jb2j\" (UniqueName: \"kubernetes.io/projected/2740f4f5-893f-4bf1-91c1-03c8cf871110-kube-api-access-6jb2j\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.173588 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.173464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2740f4f5-893f-4bf1-91c1-03c8cf871110-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.173588 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.173559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.234556 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.234520    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59d86d6648-kqmts"]
May 26 01:12:23.236343 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.236329    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.238311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.238289    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8ns2s\""
May 26 01:12:23.238468 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.238440    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 26 01:12:23.238611 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.238591    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 01:12:23.238706 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.238689    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 01:12:23.238754 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.238740    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 26 01:12:23.238960 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.238947    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 26 01:12:23.239001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.238944    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 26 01:12:23.247664 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.247642    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59d86d6648-kqmts"]
May 26 01:12:23.274342 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.274308    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2740f4f5-893f-4bf1-91c1-03c8cf871110-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.274526 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.274368    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.274526 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.274422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-default-certificate\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.274526 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.274449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-stats-auth\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.274526 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.274474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkng2\" (UniqueName: \"kubernetes.io/projected/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-kube-api-access-wkng2\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.274526 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.274510    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 01:12:23.274776 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.274560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.274776 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.274600    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls podName:2740f4f5-893f-4bf1-91c1-03c8cf871110 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:23.774584851 +0000 UTC m=+84.101369133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qrcjb" (UID: "2740f4f5-893f-4bf1-91c1-03c8cf871110") : secret "cluster-monitoring-operator-tls" not found
May 26 01:12:23.274776 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.274633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.274776 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.274659    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnp8k\" (UniqueName: \"kubernetes.io/projected/d7c17da1-875b-4e74-8635-34c466ee4720-kube-api-access-tnp8k\") pod \"volume-data-source-validator-5cf8c89d64-8rghc\" (UID: \"d7c17da1-875b-4e74-8635-34c466ee4720\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc"
May 26 01:12:23.274776 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.274677    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jb2j\" (UniqueName: \"kubernetes.io/projected/2740f4f5-893f-4bf1-91c1-03c8cf871110-kube-api-access-6jb2j\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.275099 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.275081    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2740f4f5-893f-4bf1-91c1-03c8cf871110-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.283307 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.283274    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnp8k\" (UniqueName: \"kubernetes.io/projected/d7c17da1-875b-4e74-8635-34c466ee4720-kube-api-access-tnp8k\") pod \"volume-data-source-validator-5cf8c89d64-8rghc\" (UID: \"d7c17da1-875b-4e74-8635-34c466ee4720\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc"
May 26 01:12:23.283820 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.283803    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jb2j\" (UniqueName: \"kubernetes.io/projected/2740f4f5-893f-4bf1-91c1-03c8cf871110-kube-api-access-6jb2j\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.333992 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.333949    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vp2rx"]
May 26 01:12:23.336045 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.336029    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.338326 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.338291    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 26 01:12:23.338516 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.338383    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 26 01:12:23.338516 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.338435    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 01:12:23.338677 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.338661    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 01:12:23.338754 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.338728    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qw6mq\""
May 26 01:12:23.344161 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.344143    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 26 01:12:23.346091 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.346069    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vp2rx"]
May 26 01:12:23.375693 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.375656    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.375693 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.375697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/af1d9615-119c-431b-8f6b-de0a108db247-snapshots\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.375891 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.375802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1d9615-119c-431b-8f6b-de0a108db247-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.375891 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.375831    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:23.875807674 +0000 UTC m=+84.202591974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : configmap references non-existent config key: service-ca.crt
May 26 01:12:23.375966 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.375889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fngdp\" (UniqueName: \"kubernetes.io/projected/af1d9615-119c-431b-8f6b-de0a108db247-kube-api-access-fngdp\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.375966 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.375923    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.375966 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.375942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1d9615-119c-431b-8f6b-de0a108db247-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.376087 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.375964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1d9615-119c-431b-8f6b-de0a108db247-tmp\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.376087 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.375995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af1d9615-119c-431b-8f6b-de0a108db247-serving-cert\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.376087 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.376058    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 01:12:23.376205 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.376123    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:23.876110526 +0000 UTC m=+84.202894807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : secret "router-metrics-certs-default" not found
May 26 01:12:23.376205 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.376138    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-default-certificate\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.376205 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.376160    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-stats-auth\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.376205 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.376176    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkng2\" (UniqueName: \"kubernetes.io/projected/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-kube-api-access-wkng2\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.378757 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.378698    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-stats-auth\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.378757 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.378720    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-default-certificate\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.383623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.383598    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkng2\" (UniqueName: \"kubernetes.io/projected/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-kube-api-access-wkng2\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.444738 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.444695    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc"
May 26 01:12:23.476977 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.476939    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/af1d9615-119c-431b-8f6b-de0a108db247-snapshots\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.476977 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.476979    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1d9615-119c-431b-8f6b-de0a108db247-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.477207 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.476997    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fngdp\" (UniqueName: \"kubernetes.io/projected/af1d9615-119c-431b-8f6b-de0a108db247-kube-api-access-fngdp\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.477207 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.477129    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1d9615-119c-431b-8f6b-de0a108db247-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.477207 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.477170    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1d9615-119c-431b-8f6b-de0a108db247-tmp\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.477370 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.477349    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af1d9615-119c-431b-8f6b-de0a108db247-serving-cert\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.477699 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.477675    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/af1d9615-119c-431b-8f6b-de0a108db247-snapshots\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.477787 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.477708    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1d9615-119c-431b-8f6b-de0a108db247-tmp\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.477945 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.477922    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1d9615-119c-431b-8f6b-de0a108db247-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.478337 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.478318    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1d9615-119c-431b-8f6b-de0a108db247-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.479821 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.479805    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af1d9615-119c-431b-8f6b-de0a108db247-serving-cert\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.485177 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.485150    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fngdp\" (UniqueName: \"kubernetes.io/projected/af1d9615-119c-431b-8f6b-de0a108db247-kube-api-access-fngdp\") pod \"insights-operator-78bdfb888c-vp2rx\" (UID: \"af1d9615-119c-431b-8f6b-de0a108db247\") " pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.569954 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.569910    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc"]
May 26 01:12:23.572927 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:23.572894    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c17da1_875b_4e74_8635_34c466ee4720.slice/crio-aa2d6fd96bb4512fcaa5594f68d4808e17c00638b1fd3aef685efe3fdbe3170b WatchSource:0}: Error finding container aa2d6fd96bb4512fcaa5594f68d4808e17c00638b1fd3aef685efe3fdbe3170b: Status 404 returned error can't find the container with id aa2d6fd96bb4512fcaa5594f68d4808e17c00638b1fd3aef685efe3fdbe3170b
May 26 01:12:23.646043 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.645948    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-vp2rx"
May 26 01:12:23.680606 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.680571    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc" event={"ID":"d7c17da1-875b-4e74-8635-34c466ee4720","Type":"ContainerStarted","Data":"aa2d6fd96bb4512fcaa5594f68d4808e17c00638b1fd3aef685efe3fdbe3170b"}
May 26 01:12:23.779316 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.779277    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:23.779522 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.779448    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 01:12:23.779604 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.779526    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls podName:2740f4f5-893f-4bf1-91c1-03c8cf871110 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:24.779503631 +0000 UTC m=+85.106287913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qrcjb" (UID: "2740f4f5-893f-4bf1-91c1-03c8cf871110") : secret "cluster-monitoring-operator-tls" not found
May 26 01:12:23.780914 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.780889    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vp2rx"]
May 26 01:12:23.784332 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:23.784308    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1d9615_119c_431b_8f6b_de0a108db247.slice/crio-d5f14df09895649f1f8c301bb694eee3162ae0d56fb2d030b65c53ce467df366 WatchSource:0}: Error finding container d5f14df09895649f1f8c301bb694eee3162ae0d56fb2d030b65c53ce467df366: Status 404 returned error can't find the container with id d5f14df09895649f1f8c301bb694eee3162ae0d56fb2d030b65c53ce467df366
May 26 01:12:23.880194 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.880156    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.880194 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:23.880199    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:23.880390 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.880326    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 01:12:23.880390 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.880338    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:24.88031764 +0000 UTC m=+85.207101924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : configmap references non-existent config key: service-ca.crt
May 26 01:12:23.880390 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:23.880363    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:24.880352961 +0000 UTC m=+85.207137243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : secret "router-metrics-certs-default" not found
May 26 01:12:24.684537 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:24.684488    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vp2rx" event={"ID":"af1d9615-119c-431b-8f6b-de0a108db247","Type":"ContainerStarted","Data":"d5f14df09895649f1f8c301bb694eee3162ae0d56fb2d030b65c53ce467df366"}
May 26 01:12:24.789097 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:24.789051    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:24.789266 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:24.789248    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 01:12:24.789348 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:24.789319    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls podName:2740f4f5-893f-4bf1-91c1-03c8cf871110 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:26.789301476 +0000 UTC m=+87.116085759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qrcjb" (UID: "2740f4f5-893f-4bf1-91c1-03c8cf871110") : secret "cluster-monitoring-operator-tls" not found
May 26 01:12:24.890314 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:24.890275    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:24.890314 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:24.890320    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:24.890580 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:24.890443    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 01:12:24.890580 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:24.890476    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:26.890457696 +0000 UTC m=+87.217241979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : configmap references non-existent config key: service-ca.crt
May 26 01:12:24.890580 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:24.890499    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:26.890492785 +0000 UTC m=+87.217277067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : secret "router-metrics-certs-default" not found
May 26 01:12:25.687661 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:25.687622    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc" event={"ID":"d7c17da1-875b-4e74-8635-34c466ee4720","Type":"ContainerStarted","Data":"20a9cfef0da000fa78dc5d905136ad3ac9a9c0ea003d636eb754ac07173546fc"}
May 26 01:12:25.688964 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:25.688936    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vp2rx" event={"ID":"af1d9615-119c-431b-8f6b-de0a108db247","Type":"ContainerStarted","Data":"ad5668b752e2e0460d0233a54d07982898a5bb7ecef5343b3003cefa7f69c324"}
May 26 01:12:25.701697 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:25.701641    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8rghc" podStartSLOduration=1.245519279 podStartE2EDuration="2.701628353s" podCreationTimestamp="2026-05-26 01:12:23 +0000 UTC" firstStartedPulling="2026-05-26 01:12:23.574792619 +0000 UTC m=+83.901576904" lastFinishedPulling="2026-05-26 01:12:25.030901695 +0000 UTC m=+85.357685978" observedRunningTime="2026-05-26 01:12:25.701120721 +0000 UTC m=+86.027905023" watchObservedRunningTime="2026-05-26 01:12:25.701628353 +0000 UTC m=+86.028412656"
May 26 01:12:25.715001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:25.714957    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-vp2rx" podStartSLOduration=0.919240992 podStartE2EDuration="2.714943833s" podCreationTimestamp="2026-05-26 01:12:23 +0000 UTC" firstStartedPulling="2026-05-26 01:12:23.78603272 +0000 UTC m=+84.112817001" lastFinishedPulling="2026-05-26 01:12:25.581735561 +0000 UTC m=+85.908519842" observedRunningTime="2026-05-26 01:12:25.714553437 +0000 UTC m=+86.041337740" watchObservedRunningTime="2026-05-26 01:12:25.714943833 +0000 UTC m=+86.041728177"
May 26 01:12:26.806011 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:26.805972    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:26.806464 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:26.806113    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 01:12:26.806464 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:26.806196    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls podName:2740f4f5-893f-4bf1-91c1-03c8cf871110 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:30.806176053 +0000 UTC m=+91.132960338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qrcjb" (UID: "2740f4f5-893f-4bf1-91c1-03c8cf871110") : secret "cluster-monitoring-operator-tls" not found
May 26 01:12:26.906923 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:26.906879    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:26.907096 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:26.906939    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:26.907096 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:26.907052    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:30.907035455 +0000 UTC m=+91.233819737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : configmap references non-existent config key: service-ca.crt
May 26 01:12:26.907096 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:26.907067    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 01:12:26.907249 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:26.907129    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:30.907111475 +0000 UTC m=+91.233895758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : secret "router-metrics-certs-default" not found
May 26 01:12:28.822944 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:28.822916    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kqzkc_b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240/dns-node-resolver/0.log"
May 26 01:12:29.426817 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:29.426786    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4jtfg_f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6/node-ca/0.log"
May 26 01:12:30.836186 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:30.836146    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:30.836683 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:30.836332    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 01:12:30.836683 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:30.836441    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls podName:2740f4f5-893f-4bf1-91c1-03c8cf871110 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:38.836394945 +0000 UTC m=+99.163179232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qrcjb" (UID: "2740f4f5-893f-4bf1-91c1-03c8cf871110") : secret "cluster-monitoring-operator-tls" not found
May 26 01:12:30.937254 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:30.937213    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:30.937254 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:30.937258    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:30.937535 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:30.937373    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 01:12:30.937535 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:30.937445    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:38.937392934 +0000 UTC m=+99.264177217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : configmap references non-existent config key: service-ca.crt
May 26 01:12:30.937535 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:30.937479    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs podName:bd9911d2-77ab-41fb-9ca7-c8053c30ad49 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:38.937468304 +0000 UTC m=+99.264252586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs") pod "router-default-59d86d6648-kqmts" (UID: "bd9911d2-77ab-41fb-9ca7-c8053c30ad49") : secret "router-metrics-certs-default" not found
May 26 01:12:38.395692 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.395655    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:12:38.396076 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.395720    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:12:38.398222 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.398193    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd02f6-2068-461e-8883-96f827dd4691-metrics-tls\") pod \"dns-default-xglqs\" (UID: \"5dcd02f6-2068-461e-8883-96f827dd4691\") " pod="openshift-dns/dns-default-xglqs"
May 26 01:12:38.398327 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.398266    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec9edbf7-a34a-487c-98f0-3a17c2de9b84-cert\") pod \"ingress-canary-pk67n\" (UID: \"ec9edbf7-a34a-487c-98f0-3a17c2de9b84\") " pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:12:38.425528 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.425495    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bf7j4\""
May 26 01:12:38.433619 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.433592    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xglqs"
May 26 01:12:38.441474 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.441448    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4xl9v\""
May 26 01:12:38.448824 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.448794    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pk67n"
May 26 01:12:38.563579 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.563545    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xglqs"]
May 26 01:12:38.567975 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:38.567948    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcd02f6_2068_461e_8883_96f827dd4691.slice/crio-1797e2f08fff95bc512a037b4f3a7b1d191bb3fc041e64f69eadf56eccd4b1aa WatchSource:0}: Error finding container 1797e2f08fff95bc512a037b4f3a7b1d191bb3fc041e64f69eadf56eccd4b1aa: Status 404 returned error can't find the container with id 1797e2f08fff95bc512a037b4f3a7b1d191bb3fc041e64f69eadf56eccd4b1aa
May 26 01:12:38.575619 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.575591    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pk67n"]
May 26 01:12:38.578347 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:38.578321    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9edbf7_a34a_487c_98f0_3a17c2de9b84.slice/crio-1012b086b0e60398689b57aadec142100f136721e26813b2689b9fe23e596155 WatchSource:0}: Error finding container 1012b086b0e60398689b57aadec142100f136721e26813b2689b9fe23e596155: Status 404 returned error can't find the container with id 1012b086b0e60398689b57aadec142100f136721e26813b2689b9fe23e596155
May 26 01:12:38.716972 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.716871    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xglqs" event={"ID":"5dcd02f6-2068-461e-8883-96f827dd4691","Type":"ContainerStarted","Data":"1797e2f08fff95bc512a037b4f3a7b1d191bb3fc041e64f69eadf56eccd4b1aa"}
May 26 01:12:38.717812 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.717788    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pk67n" event={"ID":"ec9edbf7-a34a-487c-98f0-3a17c2de9b84","Type":"ContainerStarted","Data":"1012b086b0e60398689b57aadec142100f136721e26813b2689b9fe23e596155"}
May 26 01:12:38.900683 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:38.900647    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:38.900925 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:38.900802    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 01:12:38.900925 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:12:38.900864    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls podName:2740f4f5-893f-4bf1-91c1-03c8cf871110 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:54.900846883 +0000 UTC m=+115.227631166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-qrcjb" (UID: "2740f4f5-893f-4bf1-91c1-03c8cf871110") : secret "cluster-monitoring-operator-tls" not found
May 26 01:12:39.001951 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.001868    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:39.001951 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.001911    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:39.002500 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.002478    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-service-ca-bundle\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:39.004347 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.004329    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9911d2-77ab-41fb-9ca7-c8053c30ad49-metrics-certs\") pod \"router-default-59d86d6648-kqmts\" (UID: \"bd9911d2-77ab-41fb-9ca7-c8053c30ad49\") " pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:39.145688 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.145647    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:39.309940 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.309375    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59d86d6648-kqmts"]
May 26 01:12:39.314534 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:39.314503    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9911d2_77ab_41fb_9ca7_c8053c30ad49.slice/crio-4d57df4227a3107ab2baba1fae8a1ff0df9f6b43611005a09bd816b0688c11ff WatchSource:0}: Error finding container 4d57df4227a3107ab2baba1fae8a1ff0df9f6b43611005a09bd816b0688c11ff: Status 404 returned error can't find the container with id 4d57df4227a3107ab2baba1fae8a1ff0df9f6b43611005a09bd816b0688c11ff
May 26 01:12:39.655290 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.655205    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2vxd8"
May 26 01:12:39.724771 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.724727    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59d86d6648-kqmts" event={"ID":"bd9911d2-77ab-41fb-9ca7-c8053c30ad49","Type":"ContainerStarted","Data":"1fc03373d153db80fcc5dda13f3f8d21e1e29584584537904c3c5ca485b1c63c"}
May 26 01:12:39.724771 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.724767    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59d86d6648-kqmts" event={"ID":"bd9911d2-77ab-41fb-9ca7-c8053c30ad49","Type":"ContainerStarted","Data":"4d57df4227a3107ab2baba1fae8a1ff0df9f6b43611005a09bd816b0688c11ff"}
May 26 01:12:39.744646 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:39.744591    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-59d86d6648-kqmts" podStartSLOduration=16.744547878 podStartE2EDuration="16.744547878s" podCreationTimestamp="2026-05-26 01:12:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:12:39.743060806 +0000 UTC m=+100.069845126" watchObservedRunningTime="2026-05-26 01:12:39.744547878 +0000 UTC m=+100.071332182"
May 26 01:12:40.146769 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:40.146729    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:40.149663 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:40.149635    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:40.727757 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:40.727717    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:40.729225 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:40.729189    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59d86d6648-kqmts"
May 26 01:12:41.731974 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:41.731941    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xglqs" event={"ID":"5dcd02f6-2068-461e-8883-96f827dd4691","Type":"ContainerStarted","Data":"e9a42d3cb978ce301d357202e823c02e61e255eb4b8c6db05f6754afc9de8516"}
May 26 01:12:41.731974 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:41.731976    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xglqs" event={"ID":"5dcd02f6-2068-461e-8883-96f827dd4691","Type":"ContainerStarted","Data":"cdb19f8547277368e098a024e490f3d1f7cbc1d72352444db43fe7d4566b4688"}
May 26 01:12:41.732505 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:41.732044    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xglqs"
May 26 01:12:41.733238 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:41.733209    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pk67n" event={"ID":"ec9edbf7-a34a-487c-98f0-3a17c2de9b84","Type":"ContainerStarted","Data":"8c33e108918f82ab63ce5cf7fd3b1edf6419851329dc1c7530d0a75d58637406"}
May 26 01:12:41.749628 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:41.749574    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xglqs" podStartSLOduration=65.656716474 podStartE2EDuration="1m7.749563256s" podCreationTimestamp="2026-05-26 01:11:34 +0000 UTC" firstStartedPulling="2026-05-26 01:12:38.56990919 +0000 UTC m=+98.896693476" lastFinishedPulling="2026-05-26 01:12:40.66275596 +0000 UTC m=+100.989540258" observedRunningTime="2026-05-26 01:12:41.748824037 +0000 UTC m=+102.075608342" watchObservedRunningTime="2026-05-26 01:12:41.749563256 +0000 UTC m=+102.076347560"
May 26 01:12:41.767364 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:41.767321    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pk67n" podStartSLOduration=65.68616467 podStartE2EDuration="1m7.767309541s" podCreationTimestamp="2026-05-26 01:11:34 +0000 UTC" firstStartedPulling="2026-05-26 01:12:38.58028703 +0000 UTC m=+98.907071312" lastFinishedPulling="2026-05-26 01:12:40.661431896 +0000 UTC m=+100.988216183" observedRunningTime="2026-05-26 01:12:41.766316295 +0000 UTC m=+102.093100599" watchObservedRunningTime="2026-05-26 01:12:41.767309541 +0000 UTC m=+102.094093842"
May 26 01:12:51.738458 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:51.738423    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xglqs"
May 26 01:12:52.833967 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.833938    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78c5dc89d7-nfqfw"]
May 26 01:12:52.836249 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.836229    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:52.838884 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.838853    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 01:12:52.839129 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.839116    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 01:12:52.839705 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.839678    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ntqzw\""
May 26 01:12:52.839816 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.839756    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 01:12:52.850034 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.850003    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 01:12:52.851125 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.851096    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78c5dc89d7-nfqfw"]
May 26 01:12:52.860134 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.860102    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jvsss"]
May 26 01:12:52.862561 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.862543    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:52.864633 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.864610    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p4ktw\""
May 26 01:12:52.864907 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.864886    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 01:12:52.864907 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.864896    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 01:12:52.872425 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.872375    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jvsss"]
May 26 01:12:52.910551 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.910518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11583618-6c12-4489-8665-40ce2927c5d6-ca-trust-extracted\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:52.910551 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.910555    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11583618-6c12-4489-8665-40ce2927c5d6-image-registry-private-configuration\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:52.910770 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.910582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11583618-6c12-4489-8665-40ce2927c5d6-registry-certificates\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:52.910770 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.910648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11583618-6c12-4489-8665-40ce2927c5d6-trusted-ca\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:52.910770 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.910698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11583618-6c12-4489-8665-40ce2927c5d6-installation-pull-secrets\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:52.910770 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.910715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11583618-6c12-4489-8665-40ce2927c5d6-bound-sa-token\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:52.910770 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.910736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11583618-6c12-4489-8665-40ce2927c5d6-registry-tls\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:52.910770 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:52.910751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwj74\" (UniqueName: \"kubernetes.io/projected/11583618-6c12-4489-8665-40ce2927c5d6-kube-api-access-jwj74\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011273 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011240    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11583618-6c12-4489-8665-40ce2927c5d6-ca-trust-extracted\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011273 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011278    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11583618-6c12-4489-8665-40ce2927c5d6-bound-sa-token\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011529 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011297    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwj74\" (UniqueName: \"kubernetes.io/projected/11583618-6c12-4489-8665-40ce2927c5d6-kube-api-access-jwj74\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011529 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011476    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11583618-6c12-4489-8665-40ce2927c5d6-image-registry-private-configuration\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011610 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011552    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11583618-6c12-4489-8665-40ce2927c5d6-trusted-ca\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011610 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011590    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11583618-6c12-4489-8665-40ce2927c5d6-registry-certificates\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011690 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/741455fb-67de-4982-9d8b-c542cba5f289-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.011690 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ggnq\" (UniqueName: \"kubernetes.io/projected/741455fb-67de-4982-9d8b-c542cba5f289-kube-api-access-5ggnq\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.011789 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011688    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11583618-6c12-4489-8665-40ce2927c5d6-installation-pull-secrets\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011789 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/741455fb-67de-4982-9d8b-c542cba5f289-data-volume\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.011789 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011760    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/741455fb-67de-4982-9d8b-c542cba5f289-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.011789 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011782    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11583618-6c12-4489-8665-40ce2927c5d6-ca-trust-extracted\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011975 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011794    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11583618-6c12-4489-8665-40ce2927c5d6-registry-tls\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.011975 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.011843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/741455fb-67de-4982-9d8b-c542cba5f289-crio-socket\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.012663 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.012624    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11583618-6c12-4489-8665-40ce2927c5d6-registry-certificates\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.012663 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.012657    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11583618-6c12-4489-8665-40ce2927c5d6-trusted-ca\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.014299 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.014278    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11583618-6c12-4489-8665-40ce2927c5d6-registry-tls\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.014299 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.014287    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11583618-6c12-4489-8665-40ce2927c5d6-image-registry-private-configuration\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.014435 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.014344    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11583618-6c12-4489-8665-40ce2927c5d6-installation-pull-secrets\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.021911 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.021882    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11583618-6c12-4489-8665-40ce2927c5d6-bound-sa-token\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.021995 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.021967    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwj74\" (UniqueName: \"kubernetes.io/projected/11583618-6c12-4489-8665-40ce2927c5d6-kube-api-access-jwj74\") pod \"image-registry-78c5dc89d7-nfqfw\" (UID: \"11583618-6c12-4489-8665-40ce2927c5d6\") " pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.112605 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.112504    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/741455fb-67de-4982-9d8b-c542cba5f289-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.112605 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.112541    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ggnq\" (UniqueName: \"kubernetes.io/projected/741455fb-67de-4982-9d8b-c542cba5f289-kube-api-access-5ggnq\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.112605 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.112561    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/741455fb-67de-4982-9d8b-c542cba5f289-data-volume\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.112605 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.112592    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/741455fb-67de-4982-9d8b-c542cba5f289-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.112883 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.112619    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/741455fb-67de-4982-9d8b-c542cba5f289-crio-socket\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.112883 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.112756    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/741455fb-67de-4982-9d8b-c542cba5f289-crio-socket\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.113000 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.112977    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/741455fb-67de-4982-9d8b-c542cba5f289-data-volume\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.113157 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.113131    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/741455fb-67de-4982-9d8b-c542cba5f289-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.115336 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.115312    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/741455fb-67de-4982-9d8b-c542cba5f289-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.122881 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.122856    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ggnq\" (UniqueName: \"kubernetes.io/projected/741455fb-67de-4982-9d8b-c542cba5f289-kube-api-access-5ggnq\") pod \"insights-runtime-extractor-jvsss\" (UID: \"741455fb-67de-4982-9d8b-c542cba5f289\") " pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.154832 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.154793    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.172698 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.172667    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jvsss"
May 26 01:12:53.291510 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.291471    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78c5dc89d7-nfqfw"]
May 26 01:12:53.294161 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:53.294125    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11583618_6c12_4489_8665_40ce2927c5d6.slice/crio-4713fddcc6336a3b7271a2b1eb405ba25cbe3e7ac541235a5a752e0997e77cbc WatchSource:0}: Error finding container 4713fddcc6336a3b7271a2b1eb405ba25cbe3e7ac541235a5a752e0997e77cbc: Status 404 returned error can't find the container with id 4713fddcc6336a3b7271a2b1eb405ba25cbe3e7ac541235a5a752e0997e77cbc
May 26 01:12:53.311074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.311048    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jvsss"]
May 26 01:12:53.323490 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:53.323461    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741455fb_67de_4982_9d8b_c542cba5f289.slice/crio-334e2abdb43034da7483f46f72adce12dae19449221cd572727e524cbaa5781a WatchSource:0}: Error finding container 334e2abdb43034da7483f46f72adce12dae19449221cd572727e524cbaa5781a: Status 404 returned error can't find the container with id 334e2abdb43034da7483f46f72adce12dae19449221cd572727e524cbaa5781a
May 26 01:12:53.770637 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.770598    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw" event={"ID":"11583618-6c12-4489-8665-40ce2927c5d6","Type":"ContainerStarted","Data":"048784ad852d5eee8d97fe4ca8a1982cd4d313e4b309867dda6fb96809977653"}
May 26 01:12:53.770839 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.770645    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw" event={"ID":"11583618-6c12-4489-8665-40ce2927c5d6","Type":"ContainerStarted","Data":"4713fddcc6336a3b7271a2b1eb405ba25cbe3e7ac541235a5a752e0997e77cbc"}
May 26 01:12:53.770839 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.770734    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:12:53.771986 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.771961    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvsss" event={"ID":"741455fb-67de-4982-9d8b-c542cba5f289","Type":"ContainerStarted","Data":"75c30f89d0ef3d7beb3b5c98a6d7a737ca12f5b49dd4cc51a74f4be31447b743"}
May 26 01:12:53.771986 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.771985    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvsss" event={"ID":"741455fb-67de-4982-9d8b-c542cba5f289","Type":"ContainerStarted","Data":"334e2abdb43034da7483f46f72adce12dae19449221cd572727e524cbaa5781a"}
May 26 01:12:53.787775 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:53.787716    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw" podStartSLOduration=1.787696667 podStartE2EDuration="1.787696667s" podCreationTimestamp="2026-05-26 01:12:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:12:53.786556123 +0000 UTC m=+114.113340427" watchObservedRunningTime="2026-05-26 01:12:53.787696667 +0000 UTC m=+114.114480974"
May 26 01:12:54.776991 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:54.776953    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvsss" event={"ID":"741455fb-67de-4982-9d8b-c542cba5f289","Type":"ContainerStarted","Data":"5f0521dee89eb8981f9697b606b1023c8d6fb189d976636717fbd740db3296fa"}
May 26 01:12:54.928347 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:54.928298    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:54.931436 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:54.931389    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2740f4f5-893f-4bf1-91c1-03c8cf871110-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-qrcjb\" (UID: \"2740f4f5-893f-4bf1-91c1-03c8cf871110\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:54.947426 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:54.947380    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"
May 26 01:12:55.220525 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:55.220497    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb"]
May 26 01:12:55.223630 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:55.223602    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2740f4f5_893f_4bf1_91c1_03c8cf871110.slice/crio-bb54ba6e97422016e785fa18e7b0c98cdf01c4bdbe43d5abf80fb580f657b30f WatchSource:0}: Error finding container bb54ba6e97422016e785fa18e7b0c98cdf01c4bdbe43d5abf80fb580f657b30f: Status 404 returned error can't find the container with id bb54ba6e97422016e785fa18e7b0c98cdf01c4bdbe43d5abf80fb580f657b30f
May 26 01:12:55.780495 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:55.780463    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb" event={"ID":"2740f4f5-893f-4bf1-91c1-03c8cf871110","Type":"ContainerStarted","Data":"bb54ba6e97422016e785fa18e7b0c98cdf01c4bdbe43d5abf80fb580f657b30f"}
May 26 01:12:55.782199 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:55.782163    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvsss" event={"ID":"741455fb-67de-4982-9d8b-c542cba5f289","Type":"ContainerStarted","Data":"9640b26caf89db024ff0d1c56e3592ab70dd270689bd97e8f1e086b7c24580e5"}
May 26 01:12:55.802605 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:55.802553    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jvsss" podStartSLOduration=2.044290661 podStartE2EDuration="3.802537379s" podCreationTimestamp="2026-05-26 01:12:52 +0000 UTC" firstStartedPulling="2026-05-26 01:12:53.374085928 +0000 UTC m=+113.700870211" lastFinishedPulling="2026-05-26 01:12:55.132332647 +0000 UTC m=+115.459116929" observedRunningTime="2026-05-26 01:12:55.801397012 +0000 UTC m=+116.128181315" watchObservedRunningTime="2026-05-26 01:12:55.802537379 +0000 UTC m=+116.129321725"
May 26 01:12:57.786865 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:57.786828    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"]
May 26 01:12:57.789211 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:57.789184    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb" event={"ID":"2740f4f5-893f-4bf1-91c1-03c8cf871110","Type":"ContainerStarted","Data":"96776e2ac8d86abdf23a653f79aac80ece99a1898ee8bd46e3efc53a4459c792"}
May 26 01:12:57.789416 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:57.789384    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"
May 26 01:12:57.791239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:57.791221    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hbf2p\""
May 26 01:12:57.791239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:57.791231    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 26 01:12:57.796168 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:57.796143    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"]
May 26 01:12:57.807340 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:57.807292    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-qrcjb" podStartSLOduration=32.709251216 podStartE2EDuration="34.807278371s" podCreationTimestamp="2026-05-26 01:12:23 +0000 UTC" firstStartedPulling="2026-05-26 01:12:55.225438299 +0000 UTC m=+115.552222581" lastFinishedPulling="2026-05-26 01:12:57.323465439 +0000 UTC m=+117.650249736" observedRunningTime="2026-05-26 01:12:57.806894254 +0000 UTC m=+118.133678572" watchObservedRunningTime="2026-05-26 01:12:57.807278371 +0000 UTC m=+118.134062675"
May 26 01:12:57.955748 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:57.955709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e28659b-f83a-49e0-84c5-ff69da9829a4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z\" (UID: \"5e28659b-f83a-49e0-84c5-ff69da9829a4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"
May 26 01:12:58.057042 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:58.056948    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e28659b-f83a-49e0-84c5-ff69da9829a4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z\" (UID: \"5e28659b-f83a-49e0-84c5-ff69da9829a4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"
May 26 01:12:58.059598 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:58.059572    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e28659b-f83a-49e0-84c5-ff69da9829a4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z\" (UID: \"5e28659b-f83a-49e0-84c5-ff69da9829a4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"
May 26 01:12:58.098153 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:58.098101    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"
May 26 01:12:58.222981 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:58.222948    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"]
May 26 01:12:58.226253 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:12:58.226225    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e28659b_f83a_49e0_84c5_ff69da9829a4.slice/crio-622cc205b6293f678bf0e2380032bf8f23e1ffe4d308100963c791087cfd4275 WatchSource:0}: Error finding container 622cc205b6293f678bf0e2380032bf8f23e1ffe4d308100963c791087cfd4275: Status 404 returned error can't find the container with id 622cc205b6293f678bf0e2380032bf8f23e1ffe4d308100963c791087cfd4275
May 26 01:12:58.792751 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:58.792715    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z" event={"ID":"5e28659b-f83a-49e0-84c5-ff69da9829a4","Type":"ContainerStarted","Data":"622cc205b6293f678bf0e2380032bf8f23e1ffe4d308100963c791087cfd4275"}
May 26 01:12:59.796886 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:59.796846    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z" event={"ID":"5e28659b-f83a-49e0-84c5-ff69da9829a4","Type":"ContainerStarted","Data":"2d3ff18df68a2018e6be44a03916cfad1f8e6634e471b47e6b320b4e26a68b23"}
May 26 01:12:59.797308 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:59.797057    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"
May 26 01:12:59.801751 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:59.801728    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z"
May 26 01:12:59.810063 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:12:59.810014    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z" podStartSLOduration=1.722504923 podStartE2EDuration="2.810002164s" podCreationTimestamp="2026-05-26 01:12:57 +0000 UTC" firstStartedPulling="2026-05-26 01:12:58.228167459 +0000 UTC m=+118.554951741" lastFinishedPulling="2026-05-26 01:12:59.315664701 +0000 UTC m=+119.642448982" observedRunningTime="2026-05-26 01:12:59.808901601 +0000 UTC m=+120.135685906" watchObservedRunningTime="2026-05-26 01:12:59.810002164 +0000 UTC m=+120.136786468"
May 26 01:13:05.174044 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.174008    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"]
May 26 01:13:05.176797 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.176775    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.178991 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.178963    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 26 01:13:05.178991 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.178973    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 01:13:05.179191 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.179000    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 26 01:13:05.179740 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.179723    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5fvq7\""
May 26 01:13:05.184840 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.184812    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"]
May 26 01:13:05.196116 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.196087    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"]
May 26 01:13:05.198220 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.198196    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.200728 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.200702    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-flbxr\""
May 26 01:13:05.200845 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.200702    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 26 01:13:05.200845 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.200740    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 26 01:13:05.200845 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.200704    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 26 01:13:05.206222 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.206189    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lftbq"]
May 26 01:13:05.208204 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.208186    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.210710 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.210682    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 01:13:05.210710 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.210712    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bkgsh\""
May 26 01:13:05.210914 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.210691    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 01:13:05.210914 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.210815    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"]
May 26 01:13:05.212008 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.211989    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 01:13:05.312806 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.312768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93365189-4412-48d5-b996-f58f42b1bd69-sys\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.312806 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.312819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.313028 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.312847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba697fbf-0939-475c-a0e9-38db05d0f5b5-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.313028 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.312913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93365189-4412-48d5-b996-f58f42b1bd69-metrics-client-ca\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.313028 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.312957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdplh\" (UniqueName: \"kubernetes.io/projected/ba697fbf-0939-475c-a0e9-38db05d0f5b5-kube-api-access-fdplh\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.313028 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-textfile\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.313028 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-wtmp\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.313175 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba697fbf-0939-475c-a0e9-38db05d0f5b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.313175 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba697fbf-0939-475c-a0e9-38db05d0f5b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.313175 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313117    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.313175 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/005b638b-378b-4bb5-a36b-3a08d7e0d96a-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.313175 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s48lw\" (UniqueName: \"kubernetes.io/projected/93365189-4412-48d5-b996-f58f42b1bd69-kube-api-access-s48lw\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.313309 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005b638b-378b-4bb5-a36b-3a08d7e0d96a-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.313309 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.313309 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-865nx\" (UniqueName: \"kubernetes.io/projected/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-api-access-865nx\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.313309 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.313463 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-accelerators-collector-config\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.313463 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93365189-4412-48d5-b996-f58f42b1bd69-root\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.313463 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.313372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-tls\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414019 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.413978    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-tls\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414194 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414047    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93365189-4412-48d5-b996-f58f42b1bd69-sys\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414194 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414108    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.414194 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:13:05.414125    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 26 01:13:05.414194 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414137    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93365189-4412-48d5-b996-f58f42b1bd69-sys\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414434 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:13:05.414201    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-tls podName:93365189-4412-48d5-b996-f58f42b1bd69 nodeName:}" failed. No retries permitted until 2026-05-26 01:13:05.914182058 +0000 UTC m=+126.240966339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-tls") pod "node-exporter-lftbq" (UID: "93365189-4412-48d5-b996-f58f42b1bd69") : secret "node-exporter-tls" not found
May 26 01:13:05.414434 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414133    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba697fbf-0939-475c-a0e9-38db05d0f5b5-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.414434 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:13:05.414239    2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 26 01:13:05.414434 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414266    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93365189-4412-48d5-b996-f58f42b1bd69-metrics-client-ca\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414434 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:13:05.414293    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-tls podName:005b638b-378b-4bb5-a36b-3a08d7e0d96a nodeName:}" failed. No retries permitted until 2026-05-26 01:13:05.914278989 +0000 UTC m=+126.241063271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-gxplz" (UID: "005b638b-378b-4bb5-a36b-3a08d7e0d96a") : secret "kube-state-metrics-tls" not found
May 26 01:13:05.414434 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414315    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdplh\" (UniqueName: \"kubernetes.io/projected/ba697fbf-0939-475c-a0e9-38db05d0f5b5-kube-api-access-fdplh\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.414434 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414359    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-textfile\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414434 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414377    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-wtmp\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414434 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414425    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba697fbf-0939-475c-a0e9-38db05d0f5b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414464    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba697fbf-0939-475c-a0e9-38db05d0f5b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414496    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414533    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/005b638b-378b-4bb5-a36b-3a08d7e0d96a-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414557    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s48lw\" (UniqueName: \"kubernetes.io/projected/93365189-4412-48d5-b996-f58f42b1bd69-kube-api-access-s48lw\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414591    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005b638b-378b-4bb5-a36b-3a08d7e0d96a-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414616    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-wtmp\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414641    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414672    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-865nx\" (UniqueName: \"kubernetes.io/projected/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-api-access-865nx\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414703    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414731    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-accelerators-collector-config\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414772    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93365189-4412-48d5-b996-f58f42b1bd69-root\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414850    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93365189-4412-48d5-b996-f58f42b1bd69-root\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.414882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414862    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-textfile\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.415568 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.414905    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93365189-4412-48d5-b996-f58f42b1bd69-metrics-client-ca\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.415568 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.415017    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba697fbf-0939-475c-a0e9-38db05d0f5b5-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.415839 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.415240    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/005b638b-378b-4bb5-a36b-3a08d7e0d96a-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.416144 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.415331    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.416291 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.416137    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005b638b-378b-4bb5-a36b-3a08d7e0d96a-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.416291 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:13:05.416195    2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 26 01:13:05.416504 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:13:05.416347    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba697fbf-0939-475c-a0e9-38db05d0f5b5-openshift-state-metrics-tls podName:ba697fbf-0939-475c-a0e9-38db05d0f5b5 nodeName:}" failed. No retries permitted until 2026-05-26 01:13:05.916327856 +0000 UTC m=+126.243112140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ba697fbf-0939-475c-a0e9-38db05d0f5b5-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-vgpkd" (UID: "ba697fbf-0939-475c-a0e9-38db05d0f5b5") : secret "openshift-state-metrics-tls" not found
May 26 01:13:05.416504 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.416197    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-accelerators-collector-config\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.418024 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.418000    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.418148 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.418127    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.418208 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.418127    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba697fbf-0939-475c-a0e9-38db05d0f5b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.422459 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.422431    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdplh\" (UniqueName: \"kubernetes.io/projected/ba697fbf-0939-475c-a0e9-38db05d0f5b5-kube-api-access-fdplh\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.423064 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.423034    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s48lw\" (UniqueName: \"kubernetes.io/projected/93365189-4412-48d5-b996-f58f42b1bd69-kube-api-access-s48lw\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.423775 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.423752    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-865nx\" (UniqueName: \"kubernetes.io/projected/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-api-access-865nx\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.919382 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.919343    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-tls\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.919575 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.919391    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:05.919698 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.919673    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba697fbf-0939-475c-a0e9-38db05d0f5b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.921965 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.921932    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93365189-4412-48d5-b996-f58f42b1bd69-node-exporter-tls\") pod \"node-exporter-lftbq\" (UID: \"93365189-4412-48d5-b996-f58f42b1bd69\") " pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:05.922084 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.921988    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba697fbf-0939-475c-a0e9-38db05d0f5b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vgpkd\" (UID: \"ba697fbf-0939-475c-a0e9-38db05d0f5b5\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:05.922084 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:05.922002    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/005b638b-378b-4bb5-a36b-3a08d7e0d96a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gxplz\" (UID: \"005b638b-378b-4bb5-a36b-3a08d7e0d96a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:06.086615 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.086573    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"
May 26 01:13:06.108298 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.108268    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"
May 26 01:13:06.118179 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.118142    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lftbq"
May 26 01:13:06.128876 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:13:06.128375    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93365189_4412_48d5_b996_f58f42b1bd69.slice/crio-6794dc937c59d51f1c4c35949ee305e1a0b0584e55bfa7a8f031edb23477e5f5 WatchSource:0}: Error finding container 6794dc937c59d51f1c4c35949ee305e1a0b0584e55bfa7a8f031edb23477e5f5: Status 404 returned error can't find the container with id 6794dc937c59d51f1c4c35949ee305e1a0b0584e55bfa7a8f031edb23477e5f5
May 26 01:13:06.264271 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.264233    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd"]
May 26 01:13:06.268566 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:13:06.268536    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba697fbf_0939_475c_a0e9_38db05d0f5b5.slice/crio-d585c13aaeafa97cba350fab0aab982bc34149cc9fe1dfbf533f884ab806197c WatchSource:0}: Error finding container d585c13aaeafa97cba350fab0aab982bc34149cc9fe1dfbf533f884ab806197c: Status 404 returned error can't find the container with id d585c13aaeafa97cba350fab0aab982bc34149cc9fe1dfbf533f884ab806197c
May 26 01:13:06.278247 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.278204    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz"]
May 26 01:13:06.281671 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:13:06.281638    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005b638b_378b_4bb5_a36b_3a08d7e0d96a.slice/crio-76d3ca965932c22f8b5b8e024d7f44874d3866091a848895fd60e6fe324fbe37 WatchSource:0}: Error finding container 76d3ca965932c22f8b5b8e024d7f44874d3866091a848895fd60e6fe324fbe37: Status 404 returned error can't find the container with id 76d3ca965932c22f8b5b8e024d7f44874d3866091a848895fd60e6fe324fbe37
May 26 01:13:06.816682 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.816636    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lftbq" event={"ID":"93365189-4412-48d5-b996-f58f42b1bd69","Type":"ContainerStarted","Data":"6794dc937c59d51f1c4c35949ee305e1a0b0584e55bfa7a8f031edb23477e5f5"}
May 26 01:13:06.817882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.817853    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz" event={"ID":"005b638b-378b-4bb5-a36b-3a08d7e0d96a","Type":"ContainerStarted","Data":"76d3ca965932c22f8b5b8e024d7f44874d3866091a848895fd60e6fe324fbe37"}
May 26 01:13:06.819676 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.819644    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd" event={"ID":"ba697fbf-0939-475c-a0e9-38db05d0f5b5","Type":"ContainerStarted","Data":"ed51becd09ee9459739c6fa139fde8c28cf45026344a12726e4c8fc88423292d"}
May 26 01:13:06.819805 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.819685    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd" event={"ID":"ba697fbf-0939-475c-a0e9-38db05d0f5b5","Type":"ContainerStarted","Data":"e58004269d35fc66cb9345387dac04e6a438e29e9df034cab089903455ce72cf"}
May 26 01:13:06.819805 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:06.819696    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd" event={"ID":"ba697fbf-0939-475c-a0e9-38db05d0f5b5","Type":"ContainerStarted","Data":"d585c13aaeafa97cba350fab0aab982bc34149cc9fe1dfbf533f884ab806197c"}
May 26 01:13:07.824195 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:07.824159    2579 generic.go:358] "Generic (PLEG): container finished" podID="93365189-4412-48d5-b996-f58f42b1bd69" containerID="cf25eb33025e12f9b2efe0e8146d3549ffff9b050b6c55bf8b8999f7a8f16d06" exitCode=0
May 26 01:13:07.824651 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:07.824231    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lftbq" event={"ID":"93365189-4412-48d5-b996-f58f42b1bd69","Type":"ContainerDied","Data":"cf25eb33025e12f9b2efe0e8146d3549ffff9b050b6c55bf8b8999f7a8f16d06"}
May 26 01:13:08.829812 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:08.829780    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lftbq" event={"ID":"93365189-4412-48d5-b996-f58f42b1bd69","Type":"ContainerStarted","Data":"32ecc1aab4c07a186d9988606f2e0cd690dca82d47feea5feb324d85c34bffa4"}
May 26 01:13:08.830278 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:08.829822    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lftbq" event={"ID":"93365189-4412-48d5-b996-f58f42b1bd69","Type":"ContainerStarted","Data":"d0a61bda48a1e983f8d5142b59a7d6008771b615da45b480403880e2721c0a5c"}
May 26 01:13:08.831706 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:08.831670    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz" event={"ID":"005b638b-378b-4bb5-a36b-3a08d7e0d96a","Type":"ContainerStarted","Data":"712fd7233512f1e66f0df0266a74f79638ff253f7674918aa2285efce49111bf"}
May 26 01:13:08.831706 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:08.831701    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz" event={"ID":"005b638b-378b-4bb5-a36b-3a08d7e0d96a","Type":"ContainerStarted","Data":"18841cca10c5128439e4029461f740dbd322ab9b15565050805131cb71753e81"}
May 26 01:13:08.831874 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:08.831711    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz" event={"ID":"005b638b-378b-4bb5-a36b-3a08d7e0d96a","Type":"ContainerStarted","Data":"1ecd4086c2212f7aa3d5d63adcf15767ce9955022de52325d2fdb7d9316753f8"}
May 26 01:13:08.833458 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:08.833434    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd" event={"ID":"ba697fbf-0939-475c-a0e9-38db05d0f5b5","Type":"ContainerStarted","Data":"247c054a8b31cddc3f14346c0581508f1cb20b42cf1ae47fff79540688973df7"}
May 26 01:13:08.853133 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:08.853087    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lftbq" podStartSLOduration=2.9776891819999998 podStartE2EDuration="3.853070998s" podCreationTimestamp="2026-05-26 01:13:05 +0000 UTC" firstStartedPulling="2026-05-26 01:13:06.130608185 +0000 UTC m=+126.457392470" lastFinishedPulling="2026-05-26 01:13:07.005989989 +0000 UTC m=+127.332774286" observedRunningTime="2026-05-26 01:13:08.852157199 +0000 UTC m=+129.178941502" watchObservedRunningTime="2026-05-26 01:13:08.853070998 +0000 UTC m=+129.179855325"
May 26 01:13:08.875076 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:08.875024    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vgpkd" podStartSLOduration=2.373066465 podStartE2EDuration="3.875010421s" podCreationTimestamp="2026-05-26 01:13:05 +0000 UTC" firstStartedPulling="2026-05-26 01:13:06.402334613 +0000 UTC m=+126.729118897" lastFinishedPulling="2026-05-26 01:13:07.904278568 +0000 UTC m=+128.231062853" observedRunningTime="2026-05-26 01:13:08.87371811 +0000 UTC m=+129.200502416" watchObservedRunningTime="2026-05-26 01:13:08.875010421 +0000 UTC m=+129.201794756"
May 26 01:13:08.896936 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:08.896880    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gxplz" podStartSLOduration=2.277198067 podStartE2EDuration="3.896866736s" podCreationTimestamp="2026-05-26 01:13:05 +0000 UTC" firstStartedPulling="2026-05-26 01:13:06.283667454 +0000 UTC m=+126.610451736" lastFinishedPulling="2026-05-26 01:13:07.903336119 +0000 UTC m=+128.230120405" observedRunningTime="2026-05-26 01:13:08.895836013 +0000 UTC m=+129.222620317" watchObservedRunningTime="2026-05-26 01:13:08.896866736 +0000 UTC m=+129.223651093"
May 26 01:13:09.049013 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.048977    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:13:09.051836 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.051742    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dae0945b-ed4e-4987-92bd-65482bf722e4-metrics-certs\") pod \"network-metrics-daemon-bc4s7\" (UID: \"dae0945b-ed4e-4987-92bd-65482bf722e4\") " pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:13:09.340762 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.340727    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-srh2n\""
May 26 01:13:09.349534 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.349507    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4s7"
May 26 01:13:09.482723 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.482689    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bc4s7"]
May 26 01:13:09.485856 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:13:09.485831    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae0945b_ed4e_4987_92bd_65482bf722e4.slice/crio-8ce7acc17dbcc94a77cd6a07f3232668c856432bf37252d3477b4124177d0882 WatchSource:0}: Error finding container 8ce7acc17dbcc94a77cd6a07f3232668c856432bf37252d3477b4124177d0882: Status 404 returned error can't find the container with id 8ce7acc17dbcc94a77cd6a07f3232668c856432bf37252d3477b4124177d0882
May 26 01:13:09.490260 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.490234    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d684c644f-svhkm"]
May 26 01:13:09.492758 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.492741    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.494984 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.494965    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 26 01:13:09.495092 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.494964    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-28l5w\""
May 26 01:13:09.495703 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.495494    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 26 01:13:09.496591 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.495995    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 26 01:13:09.496591 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.496585    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 26 01:13:09.499065 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.498535    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-biubl1oepl6ad\""
May 26 01:13:09.502533 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.502450    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d684c644f-svhkm"]
May 26 01:13:09.552886 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.552846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5b2e59dc-a8d9-442f-bca7-77fad68834d8-secret-metrics-server-tls\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.552886 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.552891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b2e59dc-a8d9-442f-bca7-77fad68834d8-client-ca-bundle\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.553104 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.552917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrrpt\" (UniqueName: \"kubernetes.io/projected/5b2e59dc-a8d9-442f-bca7-77fad68834d8-kube-api-access-wrrpt\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.553104 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.552979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5b2e59dc-a8d9-442f-bca7-77fad68834d8-audit-log\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.553104 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.553044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b2e59dc-a8d9-442f-bca7-77fad68834d8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.553104 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.553083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5b2e59dc-a8d9-442f-bca7-77fad68834d8-secret-metrics-server-client-certs\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.553228 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.553105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5b2e59dc-a8d9-442f-bca7-77fad68834d8-metrics-server-audit-profiles\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.654053 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.653968    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5b2e59dc-a8d9-442f-bca7-77fad68834d8-secret-metrics-server-tls\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.654053 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.654010    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b2e59dc-a8d9-442f-bca7-77fad68834d8-client-ca-bundle\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.654053 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.654039    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrrpt\" (UniqueName: \"kubernetes.io/projected/5b2e59dc-a8d9-442f-bca7-77fad68834d8-kube-api-access-wrrpt\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.654719 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.654102    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5b2e59dc-a8d9-442f-bca7-77fad68834d8-audit-log\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.654719 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.654160    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b2e59dc-a8d9-442f-bca7-77fad68834d8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.654719 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.654216    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5b2e59dc-a8d9-442f-bca7-77fad68834d8-secret-metrics-server-client-certs\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.654719 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.654256    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5b2e59dc-a8d9-442f-bca7-77fad68834d8-metrics-server-audit-profiles\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.654915 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.654822    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5b2e59dc-a8d9-442f-bca7-77fad68834d8-audit-log\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.655052 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.655002    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b2e59dc-a8d9-442f-bca7-77fad68834d8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.655649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.655624    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5b2e59dc-a8d9-442f-bca7-77fad68834d8-metrics-server-audit-profiles\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.656879 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.656857    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5b2e59dc-a8d9-442f-bca7-77fad68834d8-secret-metrics-server-tls\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.656957 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.656912    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5b2e59dc-a8d9-442f-bca7-77fad68834d8-secret-metrics-server-client-certs\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.656957 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.656948    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b2e59dc-a8d9-442f-bca7-77fad68834d8-client-ca-bundle\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.662008 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.661988    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrrpt\" (UniqueName: \"kubernetes.io/projected/5b2e59dc-a8d9-442f-bca7-77fad68834d8-kube-api-access-wrrpt\") pod \"metrics-server-7d684c644f-svhkm\" (UID: \"5b2e59dc-a8d9-442f-bca7-77fad68834d8\") " pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.805191 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.805157    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:09.837431 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.837362    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bc4s7" event={"ID":"dae0945b-ed4e-4987-92bd-65482bf722e4","Type":"ContainerStarted","Data":"8ce7acc17dbcc94a77cd6a07f3232668c856432bf37252d3477b4124177d0882"}
May 26 01:13:09.956263 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.956173    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d684c644f-svhkm"]
May 26 01:13:09.960164 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:13:09.960125    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2e59dc_a8d9_442f_bca7_77fad68834d8.slice/crio-5d933ea0756a79d16b39aab6e91df7b709335c440c22e9f125f9748275596864 WatchSource:0}: Error finding container 5d933ea0756a79d16b39aab6e91df7b709335c440c22e9f125f9748275596864: Status 404 returned error can't find the container with id 5d933ea0756a79d16b39aab6e91df7b709335c440c22e9f125f9748275596864
May 26 01:13:09.966216 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.966186    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"]
May 26 01:13:09.968888 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.968867    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"
May 26 01:13:09.970777 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.970754    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 26 01:13:09.970879 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.970788    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-mvbgf\""
May 26 01:13:09.977125 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:09.977090    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"]
May 26 01:13:10.057990 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:10.057953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f3cfa09-bfc4-4906-bb31-d0ac50144a6b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4pspn\" (UID: \"9f3cfa09-bfc4-4906-bb31-d0ac50144a6b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"
May 26 01:13:10.159161 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:10.159103    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f3cfa09-bfc4-4906-bb31-d0ac50144a6b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4pspn\" (UID: \"9f3cfa09-bfc4-4906-bb31-d0ac50144a6b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"
May 26 01:13:10.159340 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:13:10.159250    2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 26 01:13:10.159340 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:13:10.159320    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f3cfa09-bfc4-4906-bb31-d0ac50144a6b-monitoring-plugin-cert podName:9f3cfa09-bfc4-4906-bb31-d0ac50144a6b nodeName:}" failed. No retries permitted until 2026-05-26 01:13:10.659302633 +0000 UTC m=+130.986086915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9f3cfa09-bfc4-4906-bb31-d0ac50144a6b-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-4pspn" (UID: "9f3cfa09-bfc4-4906-bb31-d0ac50144a6b") : secret "monitoring-plugin-cert" not found
May 26 01:13:10.663785 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:10.663751    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f3cfa09-bfc4-4906-bb31-d0ac50144a6b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4pspn\" (UID: \"9f3cfa09-bfc4-4906-bb31-d0ac50144a6b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"
May 26 01:13:10.666314 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:10.666289    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f3cfa09-bfc4-4906-bb31-d0ac50144a6b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4pspn\" (UID: \"9f3cfa09-bfc4-4906-bb31-d0ac50144a6b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"
May 26 01:13:10.842748 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:10.842488    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bc4s7" event={"ID":"dae0945b-ed4e-4987-92bd-65482bf722e4","Type":"ContainerStarted","Data":"9d8b3c1a3772bb927e761f40c48dbc056986540b92c9dc5b7a020bcd769bd4c7"}
May 26 01:13:10.842748 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:10.842534    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bc4s7" event={"ID":"dae0945b-ed4e-4987-92bd-65482bf722e4","Type":"ContainerStarted","Data":"e6b6a8eb2288f90b3fc1e6b40230ab29d1f2d7fceed2fdddb82c125b9b9d5365"}
May 26 01:13:10.843775 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:10.843741    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d684c644f-svhkm" event={"ID":"5b2e59dc-a8d9-442f-bca7-77fad68834d8","Type":"ContainerStarted","Data":"5d933ea0756a79d16b39aab6e91df7b709335c440c22e9f125f9748275596864"}
May 26 01:13:10.862618 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:10.862552    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bc4s7" podStartSLOduration=129.777432838 podStartE2EDuration="2m10.862534074s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:13:09.48776782 +0000 UTC m=+129.814552105" lastFinishedPulling="2026-05-26 01:13:10.572869056 +0000 UTC m=+130.899653341" observedRunningTime="2026-05-26 01:13:10.861646198 +0000 UTC m=+131.188430505" watchObservedRunningTime="2026-05-26 01:13:10.862534074 +0000 UTC m=+131.189318379"
May 26 01:13:10.882121 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:10.882082    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"
May 26 01:13:11.021465 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.021430    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"]
May 26 01:13:11.025379 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:13:11.025349    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3cfa09_bfc4_4906_bb31_d0ac50144a6b.slice/crio-6641ff0997857e3c2a0af83396a3cc006e1b4542f063f9d31b70481d28a2eb3d WatchSource:0}: Error finding container 6641ff0997857e3c2a0af83396a3cc006e1b4542f063f9d31b70481d28a2eb3d: Status 404 returned error can't find the container with id 6641ff0997857e3c2a0af83396a3cc006e1b4542f063f9d31b70481d28a2eb3d
May 26 01:13:11.467444 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.467389    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 01:13:11.470583 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.470554    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.472950 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.472926    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 01:13:11.473628 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.473606    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8rrfl9dt8shdm\""
May 26 01:13:11.473933 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.473623    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 01:13:11.474182 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.474163    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p5dr4\""
May 26 01:13:11.474272 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.474181    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 01:13:11.474533 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.474514    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 01:13:11.474641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.474594    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 01:13:11.474641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.474626    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 01:13:11.474757 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.474631    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 01:13:11.475481 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.475460    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 01:13:11.475587 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.475547    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 01:13:11.476575 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.476553    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 01:13:11.477331 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.477305    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 01:13:11.479577 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.479558    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 01:13:11.486882 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.486855    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 01:13:11.570804 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.570756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.570810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.570849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.570880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.570911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.570928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.570952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.570982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rb6\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-kube-api-access-w7rb6\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.571432 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.571277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.671975 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.671931    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672149 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.671983    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672149 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672007    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672149 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672030    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672149 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672054    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672149 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672091    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672149 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672125    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672149 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672151    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672224    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672251    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rb6\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-kube-api-access-w7rb6\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672274    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672298    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672313    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672338    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672380    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672397    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672443    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.672519 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.672472    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.673305 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.673223    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.673672 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.673627    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.674035 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.673990    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.674307 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.674280    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.675027 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.674996    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.676878 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.676849    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.677478 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.677456    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.678071 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.677791    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.678071 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.677808    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.678071 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.677854    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.678071 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.678043    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.678371 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.678187    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.678721 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.678659    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.679319 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.679295    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.679544 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.679504    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.679750 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.679708    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.680129 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.680105    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.681916 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.681894    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rb6\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-kube-api-access-w7rb6\") pod \"prometheus-k8s-0\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.787388 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.787354    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:11.848971 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.848887    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn" event={"ID":"9f3cfa09-bfc4-4906-bb31-d0ac50144a6b","Type":"ContainerStarted","Data":"6641ff0997857e3c2a0af83396a3cc006e1b4542f063f9d31b70481d28a2eb3d"}
May 26 01:13:11.850943 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.850895    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d684c644f-svhkm" event={"ID":"5b2e59dc-a8d9-442f-bca7-77fad68834d8","Type":"ContainerStarted","Data":"e038a0eacf311398ebfae9f778a016a284dfd04ce0336e8ec1663cd5e4de5ed9"}
May 26 01:13:11.872846 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.872771    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d684c644f-svhkm" podStartSLOduration=1.101302307 podStartE2EDuration="2.872750985s" podCreationTimestamp="2026-05-26 01:13:09 +0000 UTC" firstStartedPulling="2026-05-26 01:13:09.962363005 +0000 UTC m=+130.289147291" lastFinishedPulling="2026-05-26 01:13:11.733811688 +0000 UTC m=+132.060595969" observedRunningTime="2026-05-26 01:13:11.872087286 +0000 UTC m=+132.198871616" watchObservedRunningTime="2026-05-26 01:13:11.872750985 +0000 UTC m=+132.199535292"
May 26 01:13:11.935646 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:11.935594    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 01:13:11.940053 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:13:11.939900    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60a1c2d_8f73_402f_8e55_7c47dc6ee7f3.slice/crio-ceb6c8e5d7f1cd02dd9de6bad5ebd78e7fd2054ad2374768a3457e7709127b93 WatchSource:0}: Error finding container ceb6c8e5d7f1cd02dd9de6bad5ebd78e7fd2054ad2374768a3457e7709127b93: Status 404 returned error can't find the container with id ceb6c8e5d7f1cd02dd9de6bad5ebd78e7fd2054ad2374768a3457e7709127b93
May 26 01:13:12.855482 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:12.855444    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerStarted","Data":"ceb6c8e5d7f1cd02dd9de6bad5ebd78e7fd2054ad2374768a3457e7709127b93"}
May 26 01:13:13.859249 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:13.859214    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn" event={"ID":"9f3cfa09-bfc4-4906-bb31-d0ac50144a6b","Type":"ContainerStarted","Data":"c97109adf839e3dca498604797821bd0f91a3fc8fcec50f496dc625a5c35fe78"}
May 26 01:13:13.859707 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:13.859444    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"
May 26 01:13:13.860698 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:13.860665    2579 generic.go:358] "Generic (PLEG): container finished" podID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerID="5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87" exitCode=0
May 26 01:13:13.860823 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:13.860731    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerDied","Data":"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"}
May 26 01:13:13.864867 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:13.864846    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn"
May 26 01:13:13.877784 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:13.877738    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4pspn" podStartSLOduration=2.668676139 podStartE2EDuration="4.877725342s" podCreationTimestamp="2026-05-26 01:13:09 +0000 UTC" firstStartedPulling="2026-05-26 01:13:11.027838422 +0000 UTC m=+131.354622718" lastFinishedPulling="2026-05-26 01:13:13.236887637 +0000 UTC m=+133.563671921" observedRunningTime="2026-05-26 01:13:13.876704602 +0000 UTC m=+134.203488907" watchObservedRunningTime="2026-05-26 01:13:13.877725342 +0000 UTC m=+134.204509645"
May 26 01:13:14.781694 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:14.781657    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78c5dc89d7-nfqfw"
May 26 01:13:17.876742 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:17.876704    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerStarted","Data":"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"}
May 26 01:13:17.877175 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:17.876751    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerStarted","Data":"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"}
May 26 01:13:18.882445 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:18.882386    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerStarted","Data":"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"}
May 26 01:13:19.888658 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:19.888623    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerStarted","Data":"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"}
May 26 01:13:19.888658 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:19.888658    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerStarted","Data":"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"}
May 26 01:13:19.889070 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:19.888667    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerStarted","Data":"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"}
May 26 01:13:19.939180 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:19.939120    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.095493148 podStartE2EDuration="8.939104075s" podCreationTimestamp="2026-05-26 01:13:11 +0000 UTC" firstStartedPulling="2026-05-26 01:13:11.942754542 +0000 UTC m=+132.269538824" lastFinishedPulling="2026-05-26 01:13:18.786365454 +0000 UTC m=+139.113149751" observedRunningTime="2026-05-26 01:13:19.935926941 +0000 UTC m=+140.262711246" watchObservedRunningTime="2026-05-26 01:13:19.939104075 +0000 UTC m=+140.265888378"
May 26 01:13:21.787623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:21.787585    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:13:29.805561 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:29.805510    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:29.805561 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:29.805573    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:49.811373 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:49.811273    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:49.815795 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:49.815773    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d684c644f-svhkm"
May 26 01:13:51.987887 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:51.987852    2579 generic.go:358] "Generic (PLEG): container finished" podID="af1d9615-119c-431b-8f6b-de0a108db247" containerID="ad5668b752e2e0460d0233a54d07982898a5bb7ecef5343b3003cefa7f69c324" exitCode=0
May 26 01:13:51.988368 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:51.987897    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vp2rx" event={"ID":"af1d9615-119c-431b-8f6b-de0a108db247","Type":"ContainerDied","Data":"ad5668b752e2e0460d0233a54d07982898a5bb7ecef5343b3003cefa7f69c324"}
May 26 01:13:51.988368 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:51.988338    2579 scope.go:117] "RemoveContainer" containerID="ad5668b752e2e0460d0233a54d07982898a5bb7ecef5343b3003cefa7f69c324"
May 26 01:13:52.995434 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:13:52.995367    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vp2rx" event={"ID":"af1d9615-119c-431b-8f6b-de0a108db247","Type":"ContainerStarted","Data":"1a0822d89356addadafbd13acd69866c56ffc30d4220dd4dcb7a87a7124cad1d"}
May 26 01:14:11.788004 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:11.787966    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:11.804829 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:11.804796    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:12.068262 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:12.068186    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:29.772460 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:29.772392    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 01:14:29.773099 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:29.773054    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="prometheus" containerID="cri-o://1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da" gracePeriod=600
May 26 01:14:29.773248 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:29.773101    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa" gracePeriod=600
May 26 01:14:29.773248 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:29.773114    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy-web" containerID="cri-o://f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22" gracePeriod=600
May 26 01:14:29.773248 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:29.773136    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="thanos-sidecar" containerID="cri-o://27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072" gracePeriod=600
May 26 01:14:29.773248 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:29.773152    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy" containerID="cri-o://4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d" gracePeriod=600
May 26 01:14:29.773248 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:29.773226    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="config-reloader" containerID="cri-o://795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36" gracePeriod=600
May 26 01:14:30.023239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.023171    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.108316 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108283    2579 generic.go:358] "Generic (PLEG): container finished" podID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerID="66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa" exitCode=0
May 26 01:14:30.108316 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108309    2579 generic.go:358] "Generic (PLEG): container finished" podID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerID="4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d" exitCode=0
May 26 01:14:30.108316 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108317    2579 generic.go:358] "Generic (PLEG): container finished" podID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerID="f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22" exitCode=0
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108327    2579 generic.go:358] "Generic (PLEG): container finished" podID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerID="27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072" exitCode=0
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108335    2579 generic.go:358] "Generic (PLEG): container finished" podID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerID="795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36" exitCode=0
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108341    2579 generic.go:358] "Generic (PLEG): container finished" podID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerID="1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da" exitCode=0
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108357    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerDied","Data":"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"}
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108393    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108421    2579 scope.go:117] "RemoveContainer" containerID="66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108395    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerDied","Data":"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"}
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108519    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerDied","Data":"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"}
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108539    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerDied","Data":"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"}
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108555    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerDied","Data":"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"}
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108571    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerDied","Data":"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"}
May 26 01:14:30.108623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.108585    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3","Type":"ContainerDied","Data":"ceb6c8e5d7f1cd02dd9de6bad5ebd78e7fd2054ad2374768a3457e7709127b93"}
May 26 01:14:30.116260 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.116243    2579 scope.go:117] "RemoveContainer" containerID="4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"
May 26 01:14:30.123163 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.123141    2579 scope.go:117] "RemoveContainer" containerID="f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"
May 26 01:14:30.129793 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.129773    2579 scope.go:117] "RemoveContainer" containerID="27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"
May 26 01:14:30.136394 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.136373    2579 scope.go:117] "RemoveContainer" containerID="795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"
May 26 01:14:30.142901 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.142885    2579 scope.go:117] "RemoveContainer" containerID="1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"
May 26 01:14:30.149924 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.149906    2579 scope.go:117] "RemoveContainer" containerID="5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"
May 26 01:14:30.157706 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.157624    2579 scope.go:117] "RemoveContainer" containerID="66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"
May 26 01:14:30.158855 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:14:30.158829    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": container with ID starting with 66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa not found: ID does not exist" containerID="66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"
May 26 01:14:30.158933 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.158862    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"} err="failed to get container status \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": rpc error: code = NotFound desc = could not find container \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": container with ID starting with 66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa not found: ID does not exist"
May 26 01:14:30.158933 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.158899    2579 scope.go:117] "RemoveContainer" containerID="4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"
May 26 01:14:30.159150 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:14:30.159126    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": container with ID starting with 4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d not found: ID does not exist" containerID="4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"
May 26 01:14:30.159280 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.159159    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"} err="failed to get container status \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": rpc error: code = NotFound desc = could not find container \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": container with ID starting with 4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d not found: ID does not exist"
May 26 01:14:30.159280 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.159178    2579 scope.go:117] "RemoveContainer" containerID="f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"
May 26 01:14:30.159503 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:14:30.159473    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": container with ID starting with f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22 not found: ID does not exist" containerID="f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"
May 26 01:14:30.159580 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.159503    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"} err="failed to get container status \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": rpc error: code = NotFound desc = could not find container \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": container with ID starting with f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22 not found: ID does not exist"
May 26 01:14:30.159580 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.159535    2579 scope.go:117] "RemoveContainer" containerID="27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"
May 26 01:14:30.159806 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:14:30.159789    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": container with ID starting with 27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072 not found: ID does not exist" containerID="27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"
May 26 01:14:30.159875 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.159811    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"} err="failed to get container status \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": rpc error: code = NotFound desc = could not find container \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": container with ID starting with 27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072 not found: ID does not exist"
May 26 01:14:30.159875 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.159834    2579 scope.go:117] "RemoveContainer" containerID="795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"
May 26 01:14:30.160083 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:14:30.160067    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": container with ID starting with 795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36 not found: ID does not exist" containerID="795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"
May 26 01:14:30.160121 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.160089    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"} err="failed to get container status \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": rpc error: code = NotFound desc = could not find container \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": container with ID starting with 795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36 not found: ID does not exist"
May 26 01:14:30.160121 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.160112    2579 scope.go:117] "RemoveContainer" containerID="1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"
May 26 01:14:30.160338 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:14:30.160322    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": container with ID starting with 1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da not found: ID does not exist" containerID="1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"
May 26 01:14:30.160415 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.160345    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"} err="failed to get container status \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": rpc error: code = NotFound desc = could not find container \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": container with ID starting with 1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da not found: ID does not exist"
May 26 01:14:30.160415 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.160365    2579 scope.go:117] "RemoveContainer" containerID="5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"
May 26 01:14:30.160661 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:14:30.160645    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": container with ID starting with 5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87 not found: ID does not exist" containerID="5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"
May 26 01:14:30.160699 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.160666    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"} err="failed to get container status \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": rpc error: code = NotFound desc = could not find container \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": container with ID starting with 5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87 not found: ID does not exist"
May 26 01:14:30.160699 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.160682    2579 scope.go:117] "RemoveContainer" containerID="66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"
May 26 01:14:30.160867 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.160849    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"} err="failed to get container status \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": rpc error: code = NotFound desc = could not find container \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": container with ID starting with 66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa not found: ID does not exist"
May 26 01:14:30.160932 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.160868    2579 scope.go:117] "RemoveContainer" containerID="4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"
May 26 01:14:30.161087 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161070    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"} err="failed to get container status \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": rpc error: code = NotFound desc = could not find container \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": container with ID starting with 4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d not found: ID does not exist"
May 26 01:14:30.161134 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161088    2579 scope.go:117] "RemoveContainer" containerID="f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"
May 26 01:14:30.161275 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161257    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"} err="failed to get container status \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": rpc error: code = NotFound desc = could not find container \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": container with ID starting with f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22 not found: ID does not exist"
May 26 01:14:30.161319 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161276    2579 scope.go:117] "RemoveContainer" containerID="27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"
May 26 01:14:30.161470 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161455    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"} err="failed to get container status \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": rpc error: code = NotFound desc = could not find container \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": container with ID starting with 27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072 not found: ID does not exist"
May 26 01:14:30.161517 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161472    2579 scope.go:117] "RemoveContainer" containerID="795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"
May 26 01:14:30.161651 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161627    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"} err="failed to get container status \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": rpc error: code = NotFound desc = could not find container \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": container with ID starting with 795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36 not found: ID does not exist"
May 26 01:14:30.161688 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161651    2579 scope.go:117] "RemoveContainer" containerID="1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"
May 26 01:14:30.161862 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161844    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"} err="failed to get container status \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": rpc error: code = NotFound desc = could not find container \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": container with ID starting with 1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da not found: ID does not exist"
May 26 01:14:30.161903 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.161864    2579 scope.go:117] "RemoveContainer" containerID="5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"
May 26 01:14:30.162080 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162064    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"} err="failed to get container status \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": rpc error: code = NotFound desc = could not find container \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": container with ID starting with 5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87 not found: ID does not exist"
May 26 01:14:30.162122 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162081    2579 scope.go:117] "RemoveContainer" containerID="66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"
May 26 01:14:30.162278 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162259    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"} err="failed to get container status \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": rpc error: code = NotFound desc = could not find container \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": container with ID starting with 66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa not found: ID does not exist"
May 26 01:14:30.162334 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162279    2579 scope.go:117] "RemoveContainer" containerID="4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"
May 26 01:14:30.162548 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162530    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"} err="failed to get container status \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": rpc error: code = NotFound desc = could not find container \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": container with ID starting with 4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d not found: ID does not exist"
May 26 01:14:30.162609 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162547    2579 scope.go:117] "RemoveContainer" containerID="f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"
May 26 01:14:30.162773 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162754    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"} err="failed to get container status \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": rpc error: code = NotFound desc = could not find container \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": container with ID starting with f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22 not found: ID does not exist"
May 26 01:14:30.162825 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162773    2579 scope.go:117] "RemoveContainer" containerID="27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"
May 26 01:14:30.162970 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162950    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"} err="failed to get container status \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": rpc error: code = NotFound desc = could not find container \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": container with ID starting with 27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072 not found: ID does not exist"
May 26 01:14:30.163019 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.162970    2579 scope.go:117] "RemoveContainer" containerID="795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"
May 26 01:14:30.163134 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163120    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"} err="failed to get container status \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": rpc error: code = NotFound desc = could not find container \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": container with ID starting with 795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36 not found: ID does not exist"
May 26 01:14:30.163134 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163133    2579 scope.go:117] "RemoveContainer" containerID="1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"
May 26 01:14:30.163301 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163286    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"} err="failed to get container status \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": rpc error: code = NotFound desc = could not find container \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": container with ID starting with 1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da not found: ID does not exist"
May 26 01:14:30.163349 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163303    2579 scope.go:117] "RemoveContainer" containerID="5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"
May 26 01:14:30.163487 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163473    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"} err="failed to get container status \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": rpc error: code = NotFound desc = could not find container \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": container with ID starting with 5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87 not found: ID does not exist"
May 26 01:14:30.163539 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163487    2579 scope.go:117] "RemoveContainer" containerID="66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"
May 26 01:14:30.163667 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163654    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"} err="failed to get container status \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": rpc error: code = NotFound desc = could not find container \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": container with ID starting with 66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa not found: ID does not exist"
May 26 01:14:30.163715 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163668    2579 scope.go:117] "RemoveContainer" containerID="4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"
May 26 01:14:30.163865 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163850    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"} err="failed to get container status \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": rpc error: code = NotFound desc = could not find container \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": container with ID starting with 4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d not found: ID does not exist"
May 26 01:14:30.163914 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.163865    2579 scope.go:117] "RemoveContainer" containerID="f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"
May 26 01:14:30.164046 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164025    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"} err="failed to get container status \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": rpc error: code = NotFound desc = could not find container \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": container with ID starting with f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22 not found: ID does not exist"
May 26 01:14:30.164097 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164047    2579 scope.go:117] "RemoveContainer" containerID="27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"
May 26 01:14:30.164282 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164263    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"} err="failed to get container status \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": rpc error: code = NotFound desc = could not find container \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": container with ID starting with 27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072 not found: ID does not exist"
May 26 01:14:30.164328 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164283    2579 scope.go:117] "RemoveContainer" containerID="795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"
May 26 01:14:30.164476 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164461    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"} err="failed to get container status \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": rpc error: code = NotFound desc = could not find container \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": container with ID starting with 795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36 not found: ID does not exist"
May 26 01:14:30.164516 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164476    2579 scope.go:117] "RemoveContainer" containerID="1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"
May 26 01:14:30.164646 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164630    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"} err="failed to get container status \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": rpc error: code = NotFound desc = could not find container \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": container with ID starting with 1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da not found: ID does not exist"
May 26 01:14:30.164686 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164645    2579 scope.go:117] "RemoveContainer" containerID="5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"
May 26 01:14:30.164821 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164806    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"} err="failed to get container status \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": rpc error: code = NotFound desc = could not find container \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": container with ID starting with 5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87 not found: ID does not exist"
May 26 01:14:30.164868 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.164823    2579 scope.go:117] "RemoveContainer" containerID="66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"
May 26 01:14:30.165019 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165004    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"} err="failed to get container status \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": rpc error: code = NotFound desc = could not find container \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": container with ID starting with 66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa not found: ID does not exist"
May 26 01:14:30.165019 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165018    2579 scope.go:117] "RemoveContainer" containerID="4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"
May 26 01:14:30.165191 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165175    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"} err="failed to get container status \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": rpc error: code = NotFound desc = could not find container \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": container with ID starting with 4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d not found: ID does not exist"
May 26 01:14:30.165231 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165192    2579 scope.go:117] "RemoveContainer" containerID="f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"
May 26 01:14:30.165368 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165355    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"} err="failed to get container status \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": rpc error: code = NotFound desc = could not find container \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": container with ID starting with f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22 not found: ID does not exist"
May 26 01:14:30.165434 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165368    2579 scope.go:117] "RemoveContainer" containerID="27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"
May 26 01:14:30.165578 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165562    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"} err="failed to get container status \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": rpc error: code = NotFound desc = could not find container \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": container with ID starting with 27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072 not found: ID does not exist"
May 26 01:14:30.165622 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165579    2579 scope.go:117] "RemoveContainer" containerID="795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"
May 26 01:14:30.165768 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165752    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"} err="failed to get container status \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": rpc error: code = NotFound desc = could not find container \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": container with ID starting with 795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36 not found: ID does not exist"
May 26 01:14:30.165809 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165768    2579 scope.go:117] "RemoveContainer" containerID="1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"
May 26 01:14:30.165953 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165938    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"} err="failed to get container status \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": rpc error: code = NotFound desc = could not find container \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": container with ID starting with 1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da not found: ID does not exist"
May 26 01:14:30.165953 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.165951    2579 scope.go:117] "RemoveContainer" containerID="5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"
May 26 01:14:30.166155 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166134    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"} err="failed to get container status \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": rpc error: code = NotFound desc = could not find container \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": container with ID starting with 5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87 not found: ID does not exist"
May 26 01:14:30.166197 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166158    2579 scope.go:117] "RemoveContainer" containerID="66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"
May 26 01:14:30.166335 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166319    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa"} err="failed to get container status \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": rpc error: code = NotFound desc = could not find container \"66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa\": container with ID starting with 66dd02339b504ec86b43e2509355b32641512781ecb4fc26898b3f12898da8fa not found: ID does not exist"
May 26 01:14:30.166376 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166335    2579 scope.go:117] "RemoveContainer" containerID="4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"
May 26 01:14:30.166576 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166560    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d"} err="failed to get container status \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": rpc error: code = NotFound desc = could not find container \"4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d\": container with ID starting with 4020f05ac499c02868df036271ef9282933afb5a8c6b925d30079d459d078c5d not found: ID does not exist"
May 26 01:14:30.166576 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166575    2579 scope.go:117] "RemoveContainer" containerID="f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"
May 26 01:14:30.166747 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166732    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22"} err="failed to get container status \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": rpc error: code = NotFound desc = could not find container \"f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22\": container with ID starting with f7f2340f920841f46303b59d540b357eaa2f83f85258a315c172482942252f22 not found: ID does not exist"
May 26 01:14:30.166781 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166747    2579 scope.go:117] "RemoveContainer" containerID="27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"
May 26 01:14:30.166946 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166930    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072"} err="failed to get container status \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": rpc error: code = NotFound desc = could not find container \"27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072\": container with ID starting with 27f8322dfe04a8aced8291dd64036ca863e8026dcad32379d2c76f3df58c7072 not found: ID does not exist"
May 26 01:14:30.166984 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.166946    2579 scope.go:117] "RemoveContainer" containerID="795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"
May 26 01:14:30.167152 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.167137    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36"} err="failed to get container status \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": rpc error: code = NotFound desc = could not find container \"795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36\": container with ID starting with 795b0290b28a55ae8aac53d144e917f21ec4bfae649ec48325d6e117dcab8d36 not found: ID does not exist"
May 26 01:14:30.167192 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.167152    2579 scope.go:117] "RemoveContainer" containerID="1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"
May 26 01:14:30.167340 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.167322    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da"} err="failed to get container status \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": rpc error: code = NotFound desc = could not find container \"1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da\": container with ID starting with 1f217c5f2634abc08bfbdbf90c79a6203d75f2039bc9cffc924285aa52d976da not found: ID does not exist"
May 26 01:14:30.167380 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.167341    2579 scope.go:117] "RemoveContainer" containerID="5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"
May 26 01:14:30.167551 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.167531    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87"} err="failed to get container status \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": rpc error: code = NotFound desc = could not find container \"5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87\": container with ID starting with 5bc0acc0c7a456fa14171dadec6dc658dc0b2daf46ef82e66d411407f5f14f87 not found: ID does not exist"
May 26 01:14:30.186834 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.186804    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-db\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.186945 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.186856    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-metrics-client-ca\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.186945 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.186879    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-thanos-prometheus-http-client-file\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.186945 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.186916    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-web-config\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.186945 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.186942    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-tls-assets\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.186968    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-kube-rbac-proxy\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.186991    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-trusted-ca-bundle\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187039    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config-out\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187077    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187108    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-serving-certs-ca-bundle\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187131    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-kubelet-serving-ca-bundle\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187169    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-rulefiles-0\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187198    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187222    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7rb6\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-kube-api-access-w7rb6\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187265    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187294    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-grpc-tls\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187320    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-metrics-client-certs\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187346    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-tls\") pod \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\" (UID: \"d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3\") "
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187351    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187496    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187850    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-metrics-client-ca\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.188484 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.187988    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.189653 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.188445    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 01:14:30.189959 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.189931    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 01:14:30.190060 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.190014    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 01:14:30.190278 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.190256    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:14:30.190377 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.190294    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 01:14:30.191623 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.191580    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 01:14:30.191722 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.191618    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:14:30.191722 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.191635    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:14:30.191722 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.191629    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-kube-api-access-w7rb6" (OuterVolumeSpecName: "kube-api-access-w7rb6") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "kube-api-access-w7rb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 01:14:30.192085 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.192053    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config-out" (OuterVolumeSpecName: "config-out") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 01:14:30.192250 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.192222    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:14:30.192337 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.192305    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:14:30.192560 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.192540    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:14:30.192707 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.192684    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config" (OuterVolumeSpecName: "config") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:14:30.193221 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.193193    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:14:30.201743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.201711    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-web-config" (OuterVolumeSpecName: "web-config") pod "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" (UID: "d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:14:30.288464 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288362    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288464 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288418    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288464 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288437    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7rb6\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-kube-api-access-w7rb6\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288464 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288448    2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288464 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288463    2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-grpc-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288476    2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-metrics-client-certs\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288490    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288505    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-prometheus-k8s-db\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288518    2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288529    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-web-config\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288538    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-tls-assets\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288545    2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-kube-rbac-proxy\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288555    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-config-out\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288564    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288573    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.288734 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.288584    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:14:30.425517 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.425484    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 01:14:30.429263 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.429237    2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 01:14:30.451309 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451274    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 01:14:30.451636 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451616    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="config-reloader"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451640    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="config-reloader"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451658    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy-thanos"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451665    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy-thanos"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451677    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="init-config-reloader"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451685    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="init-config-reloader"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451694    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy-web"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451702    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy-web"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451721    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="thanos-sidecar"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451730    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="thanos-sidecar"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451739    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy"
May 26 01:14:30.451746 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451746    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy"
May 26 01:14:30.452264 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451764    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="prometheus"
May 26 01:14:30.452264 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451772    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="prometheus"
May 26 01:14:30.452264 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451843    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="prometheus"
May 26 01:14:30.452264 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451855    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="config-reloader"
May 26 01:14:30.452264 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451866    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy-web"
May 26 01:14:30.452264 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451878    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy"
May 26 01:14:30.452264 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451887    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="kube-rbac-proxy-thanos"
May 26 01:14:30.452264 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.451897    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" containerName="thanos-sidecar"
May 26 01:14:30.457650 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.457629    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.459742 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.459716    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 01:14:30.459938 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.459717    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 01:14:30.459938 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.459719    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 01:14:30.459938 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.459717    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 01:14:30.459938 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.459718    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 01:14:30.460172 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.460084    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p5dr4\""
May 26 01:14:30.460172 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.460109    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 01:14:30.460172 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.460122    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 01:14:30.460350 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.460230    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8rrfl9dt8shdm\""
May 26 01:14:30.460615 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.460592    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 01:14:30.460706 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.460614    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 01:14:30.460706 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.460595    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 01:14:30.463661 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.463641    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 01:14:30.467889 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.467709    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 01:14:30.468825 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.468797    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 01:14:30.591715 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-config\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591715 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591715 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591715 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-web-config\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591964 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1183e876-117c-4eed-b5ca-cddebb2ce39a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591964 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591964 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591833    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591964 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591964 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591964 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.591964 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.592242 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.591982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.592242 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.592023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.592242 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.592038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.592242 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.592068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1183e876-117c-4eed-b5ca-cddebb2ce39a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.592242 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.592083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngsw8\" (UniqueName: \"kubernetes.io/projected/1183e876-117c-4eed-b5ca-cddebb2ce39a-kube-api-access-ngsw8\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.592242 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.592110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.592242 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.592176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1183e876-117c-4eed-b5ca-cddebb2ce39a-config-out\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693481 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693435    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693481 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693486    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693730 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693524    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693730 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693679    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693841 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693739    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693841 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693766    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693841 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693814    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1183e876-117c-4eed-b5ca-cddebb2ce39a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693981 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693841    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngsw8\" (UniqueName: \"kubernetes.io/projected/1183e876-117c-4eed-b5ca-cddebb2ce39a-kube-api-access-ngsw8\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693981 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693873    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693981 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693907    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1183e876-117c-4eed-b5ca-cddebb2ce39a-config-out\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693981 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693944    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-config\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.693981 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.693974    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.694213 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.694002    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.694213 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.694033    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-web-config\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.694213 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.694067    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1183e876-117c-4eed-b5ca-cddebb2ce39a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.694213 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.694086    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.694213 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.694105    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.694213 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.694121    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.694517 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.694379    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.694517 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.694383    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.695748 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.694935    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1183e876-117c-4eed-b5ca-cddebb2ce39a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.695748 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.695429    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.695748 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.695524    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.696911 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.696880    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.697051 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.697027    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.697121 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.697096    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1183e876-117c-4eed-b5ca-cddebb2ce39a-config-out\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.697939 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.697658    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-config\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.697939 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.697811    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.698256 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.698205    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-web-config\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.698783 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.698761    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.699329 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.699309    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1183e876-117c-4eed-b5ca-cddebb2ce39a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.699657 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.699638    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.699922 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.699900    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.700145 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.700110    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1183e876-117c-4eed-b5ca-cddebb2ce39a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.700209 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.700124    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1183e876-117c-4eed-b5ca-cddebb2ce39a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.701385 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.701368    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngsw8\" (UniqueName: \"kubernetes.io/projected/1183e876-117c-4eed-b5ca-cddebb2ce39a-kube-api-access-ngsw8\") pod \"prometheus-k8s-0\" (UID: \"1183e876-117c-4eed-b5ca-cddebb2ce39a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.769264 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.769231    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:14:30.911583 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:30.911543    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 01:14:30.915039 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:14:30.914995    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1183e876_117c_4eed_b5ca_cddebb2ce39a.slice/crio-4ba76e0564ff4d06f153fdf9c1801d7f380cf575de3d3f367247bf660b1aaab4 WatchSource:0}: Error finding container 4ba76e0564ff4d06f153fdf9c1801d7f380cf575de3d3f367247bf660b1aaab4: Status 404 returned error can't find the container with id 4ba76e0564ff4d06f153fdf9c1801d7f380cf575de3d3f367247bf660b1aaab4
May 26 01:14:31.112586 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:31.112488    2579 generic.go:358] "Generic (PLEG): container finished" podID="1183e876-117c-4eed-b5ca-cddebb2ce39a" containerID="fbaf580ad390abe9421e926c562046249532a0ac08fa493e7236947b0666303f" exitCode=0
May 26 01:14:31.112736 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:31.112575    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1183e876-117c-4eed-b5ca-cddebb2ce39a","Type":"ContainerDied","Data":"fbaf580ad390abe9421e926c562046249532a0ac08fa493e7236947b0666303f"}
May 26 01:14:31.112736 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:31.112618    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1183e876-117c-4eed-b5ca-cddebb2ce39a","Type":"ContainerStarted","Data":"4ba76e0564ff4d06f153fdf9c1801d7f380cf575de3d3f367247bf660b1aaab4"}
May 26 01:14:32.119988 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:32.119892    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1183e876-117c-4eed-b5ca-cddebb2ce39a","Type":"ContainerStarted","Data":"1b3e8c7d854a54ce6b6420800a0c321346214ef4f8a33648667dbaa11e57188b"}
May 26 01:14:32.119988 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:32.119939    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1183e876-117c-4eed-b5ca-cddebb2ce39a","Type":"ContainerStarted","Data":"0af8636b512d388c9d6048a2b6f2c02e043d6681d4ff25ebaaf89c21b4f918ef"}
May 26 01:14:32.119988 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:32.119950    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1183e876-117c-4eed-b5ca-cddebb2ce39a","Type":"ContainerStarted","Data":"0ccc08cf2214d8bf5bee36bc284e9be3c15115c37e63e3250df77b3fe4e2c1a4"}
May 26 01:14:32.119988 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:32.119959    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1183e876-117c-4eed-b5ca-cddebb2ce39a","Type":"ContainerStarted","Data":"f0a15eafd02e3cd24ebf30057866cc2d057121118ed2330263f35c17801ee228"}
May 26 01:14:32.119988 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:32.119967    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1183e876-117c-4eed-b5ca-cddebb2ce39a","Type":"ContainerStarted","Data":"fca230d8d3203d8745f99c9a5cb375b1a3572b7639ae8c2dd035e43465909eca"}
May 26 01:14:32.119988 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:32.119975    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1183e876-117c-4eed-b5ca-cddebb2ce39a","Type":"ContainerStarted","Data":"3334c251a7265654f3593e5c2fa335b3f1ada4b82947ab6d85aa3fc8f2bc0288"}
May 26 01:14:32.144016 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:32.143949    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.143929921 podStartE2EDuration="2.143929921s" podCreationTimestamp="2026-05-26 01:14:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:14:32.142173918 +0000 UTC m=+212.468958232" watchObservedRunningTime="2026-05-26 01:14:32.143929921 +0000 UTC m=+212.470714223"
May 26 01:14:32.324123 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:32.324076    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3" path="/var/lib/kubelet/pods/d60a1c2d-8f73-402f-8e55-7c47dc6ee7f3/volumes"
May 26 01:14:35.769896 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:14:35.769843    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:15:30.769689 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:15:30.769604    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:15:30.785896 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:15:30.785868    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:15:31.316267 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:15:31.316237    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 01:16:00.203151 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:00.203122    2579 kubelet.go:1628] "Image garbage collection succeeded"
May 26 01:16:29.843214 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.843174    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-64985"]
May 26 01:16:29.846649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.846626    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:29.848793 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.848769    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 01:16:29.854856 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.854829    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-64985"]
May 26 01:16:29.897990 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.897952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/050a97ee-1a5c-4e38-9382-c7cc3d5c17c1-original-pull-secret\") pod \"global-pull-secret-syncer-64985\" (UID: \"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1\") " pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:29.898158 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.898001    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/050a97ee-1a5c-4e38-9382-c7cc3d5c17c1-kubelet-config\") pod \"global-pull-secret-syncer-64985\" (UID: \"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1\") " pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:29.898158 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.898084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/050a97ee-1a5c-4e38-9382-c7cc3d5c17c1-dbus\") pod \"global-pull-secret-syncer-64985\" (UID: \"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1\") " pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:29.998929 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.998889    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/050a97ee-1a5c-4e38-9382-c7cc3d5c17c1-original-pull-secret\") pod \"global-pull-secret-syncer-64985\" (UID: \"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1\") " pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:29.998929 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.998935    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/050a97ee-1a5c-4e38-9382-c7cc3d5c17c1-kubelet-config\") pod \"global-pull-secret-syncer-64985\" (UID: \"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1\") " pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:29.999152 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.999011    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/050a97ee-1a5c-4e38-9382-c7cc3d5c17c1-dbus\") pod \"global-pull-secret-syncer-64985\" (UID: \"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1\") " pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:29.999152 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.999110    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/050a97ee-1a5c-4e38-9382-c7cc3d5c17c1-kubelet-config\") pod \"global-pull-secret-syncer-64985\" (UID: \"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1\") " pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:29.999258 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:29.999239    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/050a97ee-1a5c-4e38-9382-c7cc3d5c17c1-dbus\") pod \"global-pull-secret-syncer-64985\" (UID: \"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1\") " pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:30.001679 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:30.001646    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/050a97ee-1a5c-4e38-9382-c7cc3d5c17c1-original-pull-secret\") pod \"global-pull-secret-syncer-64985\" (UID: \"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1\") " pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:30.156748 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:30.156646    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64985"
May 26 01:16:30.290138 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:30.290104    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-64985"]
May 26 01:16:30.293046 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:16:30.293018    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050a97ee_1a5c_4e38_9382_c7cc3d5c17c1.slice/crio-83d92799a9b3a0cbc7684091a51c9444bf8f151edb32bb3ffeda2a95c3afd84a WatchSource:0}: Error finding container 83d92799a9b3a0cbc7684091a51c9444bf8f151edb32bb3ffeda2a95c3afd84a: Status 404 returned error can't find the container with id 83d92799a9b3a0cbc7684091a51c9444bf8f151edb32bb3ffeda2a95c3afd84a
May 26 01:16:30.294672 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:30.294646    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 01:16:30.472885 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:30.472796    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-64985" event={"ID":"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1","Type":"ContainerStarted","Data":"83d92799a9b3a0cbc7684091a51c9444bf8f151edb32bb3ffeda2a95c3afd84a"}
May 26 01:16:35.492189 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:35.492149    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-64985" event={"ID":"050a97ee-1a5c-4e38-9382-c7cc3d5c17c1","Type":"ContainerStarted","Data":"6720f09e78fd1d35b59cbff49589bb9fc202ac49f516915cbaabfcb8c569dd92"}
May 26 01:16:35.504674 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:16:35.504605    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-64985" podStartSLOduration=2.340866451 podStartE2EDuration="6.504588044s" podCreationTimestamp="2026-05-26 01:16:29 +0000 UTC" firstStartedPulling="2026-05-26 01:16:30.294791807 +0000 UTC m=+330.621576090" lastFinishedPulling="2026-05-26 01:16:34.458513397 +0000 UTC m=+334.785297683" observedRunningTime="2026-05-26 01:16:35.504115362 +0000 UTC m=+335.830899670" watchObservedRunningTime="2026-05-26 01:16:35.504588044 +0000 UTC m=+335.831372347"
May 26 01:40:19.498897 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.498856    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"]
May 26 01:40:19.502761 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.502738    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.504827 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.504803    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 01:40:19.504985 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.504965    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 01:40:19.505039 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.505022    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5kfzb\""
May 26 01:40:19.505091 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.505059    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 01:40:19.505091 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.505074    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 01:40:19.505196 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.505102    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 01:40:19.505196 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.505168    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 01:40:19.511938 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.511910    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"]
May 26 01:40:19.529411 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.529372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.529537 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.529465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.529537 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.529493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.529537 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.529519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d135787f-b986-4300-b2a4-4abbdfcc293d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.529638 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.529553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxsb2\" (UniqueName: \"kubernetes.io/projected/d135787f-b986-4300-b2a4-4abbdfcc293d-kube-api-access-qxsb2\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.529638 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.529611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.630556 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.630503    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.630760 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.630591    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.630760 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.630623    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.630760 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:40:19.630645    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 26 01:40:19.630760 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:40:19.630717    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-offline-tls podName:d135787f-b986-4300-b2a4-4abbdfcc293d nodeName:}" failed. No retries permitted until 2026-05-26 01:40:20.130700727 +0000 UTC m=+1760.457485013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-t2kl6" (UID: "d135787f-b986-4300-b2a4-4abbdfcc293d") : secret "feast-simple-feast-setup-offline-tls" not found
May 26 01:40:19.630760 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.630649    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d135787f-b986-4300-b2a4-4abbdfcc293d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.631036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.630819    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxsb2\" (UniqueName: \"kubernetes.io/projected/d135787f-b986-4300-b2a4-4abbdfcc293d-kube-api-access-qxsb2\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.631036 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:40:19.630750    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 01:40:19.631036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.630889    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.631036 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:40:19.630912    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-registry-tls podName:d135787f-b986-4300-b2a4-4abbdfcc293d nodeName:}" failed. No retries permitted until 2026-05-26 01:40:20.130891177 +0000 UTC m=+1760.457675486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-t2kl6" (UID: "d135787f-b986-4300-b2a4-4abbdfcc293d") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 01:40:19.631036 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:40:19.630982    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 01:40:19.631036 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:40:19.631028    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-online-tls podName:d135787f-b986-4300-b2a4-4abbdfcc293d nodeName:}" failed. No retries permitted until 2026-05-26 01:40:20.131015535 +0000 UTC m=+1760.457799817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-online-tls") pod "feast-simple-feast-setup-664fcfcc58-t2kl6" (UID: "d135787f-b986-4300-b2a4-4abbdfcc293d") : secret "feast-simple-feast-setup-online-tls" not found
May 26 01:40:19.631036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.631031    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d135787f-b986-4300-b2a4-4abbdfcc293d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.633231 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.633210    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:19.640598 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:19.640571    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxsb2\" (UniqueName: \"kubernetes.io/projected/d135787f-b986-4300-b2a4-4abbdfcc293d-kube-api-access-qxsb2\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:20.135675 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.135629    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:20.135857 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.135693    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:20.135857 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.135747    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:20.138565 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.138529    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:20.138692 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.138561    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:20.138692 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.138529    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-t2kl6\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:20.424884 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.424778    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:20.560226 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.560194    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"]
May 26 01:40:20.562731 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:40:20.562698    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd135787f_b986_4300_b2a4_4abbdfcc293d.slice/crio-29d703d50be891869f58f3925e8d7b1bacea645a44b32760ff8168d794e5dde1 WatchSource:0}: Error finding container 29d703d50be891869f58f3925e8d7b1bacea645a44b32760ff8168d794e5dde1: Status 404 returned error can't find the container with id 29d703d50be891869f58f3925e8d7b1bacea645a44b32760ff8168d794e5dde1
May 26 01:40:20.564321 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.564303    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 01:40:20.648017 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:20.647982    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerStarted","Data":"29d703d50be891869f58f3925e8d7b1bacea645a44b32760ff8168d794e5dde1"}
May 26 01:40:34.698219 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:34.698176    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerStarted","Data":"2a5ea0573f46d6fed3ddd9f2f2b39ce0ca938d19e401c41a245b3d1859b00b5a"}
May 26 01:40:39.713358 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:39.713325    2579 generic.go:358] "Generic (PLEG): container finished" podID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerID="2a5ea0573f46d6fed3ddd9f2f2b39ce0ca938d19e401c41a245b3d1859b00b5a" exitCode=0
May 26 01:40:39.713939 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:39.713414    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerDied","Data":"2a5ea0573f46d6fed3ddd9f2f2b39ce0ca938d19e401c41a245b3d1859b00b5a"}
May 26 01:40:40.717967 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:40.717885    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerStarted","Data":"ed36886b221c9c9c64e29a489e4c465d8932fc9c7a326c8fc84964069f836bbe"}
May 26 01:40:45.734581 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:45.734494    2579 generic.go:358] "Generic (PLEG): container finished" podID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerID="ed36886b221c9c9c64e29a489e4c465d8932fc9c7a326c8fc84964069f836bbe" exitCode=0
May 26 01:40:45.734581 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:45.734536    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerDied","Data":"ed36886b221c9c9c64e29a489e4c465d8932fc9c7a326c8fc84964069f836bbe"}
May 26 01:40:46.741666 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:46.741625    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerStarted","Data":"81dbbde7a2c8fb4df285606fe7894f2b21e873b2a217166afef812ea6e31f491"}
May 26 01:40:46.742170 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:46.741679    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerStarted","Data":"79c58ceb68c07283c034c682fa229a105308690074ad4911fe052a232874d8a1"}
May 26 01:40:46.742170 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:46.741693    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerStarted","Data":"ca4b26e11b18e36d87a31a3cedd5785007d19341fbf975cb24634ca0890f76ce"}
May 26 01:40:46.742170 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:46.741705    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerStarted","Data":"641cf51c896bd795917aa4de7e1ede5c53405c1557ec183e5ef5ba175983836b"}
May 26 01:40:46.764640 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:46.764558    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podStartSLOduration=13.777146743 podStartE2EDuration="27.764538547s" podCreationTimestamp="2026-05-26 01:40:19 +0000 UTC" firstStartedPulling="2026-05-26 01:40:20.564483871 +0000 UTC m=+1760.891268166" lastFinishedPulling="2026-05-26 01:40:34.551875688 +0000 UTC m=+1774.878659970" observedRunningTime="2026-05-26 01:40:46.762313673 +0000 UTC m=+1787.089098000" watchObservedRunningTime="2026-05-26 01:40:46.764538547 +0000 UTC m=+1787.091322852"
May 26 01:40:47.425032 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:47.424972    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:47.425318 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:47.425302    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:47.425453 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:47.425440    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:47.425547 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:47.425538    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:47.427061 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:47.426910    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.21:6571: connect: connection refused"
May 26 01:40:47.427061 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:47.426947    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.21:8816: connect: connection refused"
May 26 01:40:47.427061 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:47.426964    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
May 26 01:40:47.427061 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:47.427059    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
May 26 01:40:50.425876 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:50.425830    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:50.426485 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:50.426461    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:50.426588 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:50.426489    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:50.426588 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:50.426502    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:50.426588 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:50.426303    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.21:6571: connect: connection refused"
May 26 01:40:50.426588 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:50.426234    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.21:8816: connect: connection refused"
May 26 01:40:50.426588 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:50.426112    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
May 26 01:40:50.426915 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:50.426130    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
May 26 01:40:53.426259 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:53.426226    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:53.426699 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:53.426339    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:53.426699 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:53.426545    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:53.427044 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:53.427019    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:53.427240 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:53.427216    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:53.427388 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:53.427371    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:53.431229 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:53.431207    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:40:53.770062 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:40:53.770036    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:41:54.921132 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:54.921096    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"]
May 26 01:41:54.921650 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:54.921474    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="registry" containerID="cri-o://641cf51c896bd795917aa4de7e1ede5c53405c1557ec183e5ef5ba175983836b" gracePeriod=30
May 26 01:41:54.921714 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:54.921687    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="online" containerID="cri-o://ca4b26e11b18e36d87a31a3cedd5785007d19341fbf975cb24634ca0890f76ce" gracePeriod=30
May 26 01:41:54.921763 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:54.921709    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="offline" containerID="cri-o://79c58ceb68c07283c034c682fa229a105308690074ad4911fe052a232874d8a1" gracePeriod=30
May 26 01:41:54.921920 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:54.921827    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="ui" containerID="cri-o://81dbbde7a2c8fb4df285606fe7894f2b21e873b2a217166afef812ea6e31f491" gracePeriod=30
May 26 01:41:55.201976 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.201879    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"]
May 26 01:41:55.205842 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.205823    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.208109 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.208083    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-vnk86\""
May 26 01:41:55.214855 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.214829    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"]
May 26 01:41:55.306413 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.306373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85f44\" (UniqueName: \"kubernetes.io/projected/0b99ef30-92bd-41f1-a61a-1362dd07227c-kube-api-access-85f44\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.306640 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.306447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.306640 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.306475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.306640 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.306575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.306640 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.306597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.306640 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.306638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b99ef30-92bd-41f1-a61a-1362dd07227c-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.407808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.407766    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85f44\" (UniqueName: \"kubernetes.io/projected/0b99ef30-92bd-41f1-a61a-1362dd07227c-kube-api-access-85f44\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.407989 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.407837    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.407989 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.407861    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.407989 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.407944    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 01:41:55.407989 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.407975    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 01:41:55.408201 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.408029    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-registry-tls podName:0b99ef30-92bd-41f1-a61a-1362dd07227c nodeName:}" failed. No retries permitted until 2026-05-26 01:41:55.908006587 +0000 UTC m=+1856.234790874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-v2ks4" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 01:41:55.408201 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.408123    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls podName:0b99ef30-92bd-41f1-a61a-1362dd07227c nodeName:}" failed. No retries permitted until 2026-05-26 01:41:55.908104267 +0000 UTC m=+1856.234888563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-v2ks4" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 01:41:55.408201 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.408172    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.408358 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.408205    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.408358 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.408233    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b99ef30-92bd-41f1-a61a-1362dd07227c-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.408358 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.408272    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 26 01:41:55.408358 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.408303    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 01:41:55.408358 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.408320    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-offline-tls podName:0b99ef30-92bd-41f1-a61a-1362dd07227c nodeName:}" failed. No retries permitted until 2026-05-26 01:41:55.908310133 +0000 UTC m=+1856.235094419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-v2ks4" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c") : secret "feast-simple-feast-setup-offline-tls" not found
May 26 01:41:55.408567 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.408378    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-online-tls podName:0b99ef30-92bd-41f1-a61a-1362dd07227c nodeName:}" failed. No retries permitted until 2026-05-26 01:41:55.908363067 +0000 UTC m=+1856.235147351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-online-tls") pod "feast-simple-feast-setup-664fcfcc58-v2ks4" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c") : secret "feast-simple-feast-setup-online-tls" not found
May 26 01:41:55.408638 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.408620    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b99ef30-92bd-41f1-a61a-1362dd07227c-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.417080 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.417053    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85f44\" (UniqueName: \"kubernetes.io/projected/0b99ef30-92bd-41f1-a61a-1362dd07227c-kube-api-access-85f44\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.913830 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.913792    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.913830 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.913833    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.914059 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.913896    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.914059 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.913915    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.914059 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.914017    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 01:41:55.914154 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:41:55.914084    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls podName:0b99ef30-92bd-41f1-a61a-1362dd07227c nodeName:}" failed. No retries permitted until 2026-05-26 01:41:56.914067778 +0000 UTC m=+1857.240852059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-v2ks4" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 01:41:55.916520 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.916487    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.916664 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.916536    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.916664 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.916573    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:55.956773 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.956741    2579 generic.go:358] "Generic (PLEG): container finished" podID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerID="81dbbde7a2c8fb4df285606fe7894f2b21e873b2a217166afef812ea6e31f491" exitCode=0
May 26 01:41:55.956773 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.956769    2579 generic.go:358] "Generic (PLEG): container finished" podID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerID="ca4b26e11b18e36d87a31a3cedd5785007d19341fbf975cb24634ca0890f76ce" exitCode=0
May 26 01:41:55.957172 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.956802    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerDied","Data":"81dbbde7a2c8fb4df285606fe7894f2b21e873b2a217166afef812ea6e31f491"}
May 26 01:41:55.957172 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:55.956823    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerDied","Data":"ca4b26e11b18e36d87a31a3cedd5785007d19341fbf975cb24634ca0890f76ce"}
May 26 01:41:56.924494 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:56.924435    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:56.927038 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:56.927016    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-v2ks4\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:57.016974 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:57.016939    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:41:57.150201 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:57.150172    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"]
May 26 01:41:57.152621 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:41:57.152591    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b99ef30_92bd_41f1_a61a_1362dd07227c.slice/crio-8d59eda6c6d3f4252ade0ccda0b1e565d8ad08846b3a9d849a8f57542fe4d795 WatchSource:0}: Error finding container 8d59eda6c6d3f4252ade0ccda0b1e565d8ad08846b3a9d849a8f57542fe4d795: Status 404 returned error can't find the container with id 8d59eda6c6d3f4252ade0ccda0b1e565d8ad08846b3a9d849a8f57542fe4d795
May 26 01:41:57.964923 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:57.964880    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerStarted","Data":"caa8fb7f194d5f68e1a3b37aa8387c86d15c134d57f18eb17c725ad40acc11f3"}
May 26 01:41:57.965108 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:41:57.964929    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerStarted","Data":"8d59eda6c6d3f4252ade0ccda0b1e565d8ad08846b3a9d849a8f57542fe4d795"}
May 26 01:42:01.981311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:01.981276    2579 generic.go:358] "Generic (PLEG): container finished" podID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerID="caa8fb7f194d5f68e1a3b37aa8387c86d15c134d57f18eb17c725ad40acc11f3" exitCode=0
May 26 01:42:01.981702 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:01.981350    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerDied","Data":"caa8fb7f194d5f68e1a3b37aa8387c86d15c134d57f18eb17c725ad40acc11f3"}
May 26 01:42:02.986454 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:02.986395    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerStarted","Data":"9779a0b2d28d831aee33e64a6a21231738992e72a52b6f908e4d121163c08428"}
May 26 01:42:03.427984 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:03.427935    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
May 26 01:42:03.767769 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:03.767721    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
May 26 01:42:08.010454 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:08.010422    2579 generic.go:358] "Generic (PLEG): container finished" podID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerID="9779a0b2d28d831aee33e64a6a21231738992e72a52b6f908e4d121163c08428" exitCode=0
May 26 01:42:08.010454 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:08.010442    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerDied","Data":"9779a0b2d28d831aee33e64a6a21231738992e72a52b6f908e4d121163c08428"}
May 26 01:42:09.017871 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:09.017827    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerStarted","Data":"c0d8a4010d1aba21c1271e983a1fa65f85d058114a480895f6c06f7f80a1789b"}
May 26 01:42:09.018371 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:09.017881    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerStarted","Data":"9e147f0c895831ec6c7f42c1bffda32e89fade0028f8cd82572d9c67ed988687"}
May 26 01:42:09.018371 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:09.017896    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerStarted","Data":"7ca85d3b51e559ed3173e0bfd66406b619833c962c8a9783ed15e5481b854083"}
May 26 01:42:09.018371 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:09.017910    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerStarted","Data":"24e97e42dcaf8d8c635fcf7de35fd173caef2cab748579689862762fef5891a0"}
May 26 01:42:09.042753 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:09.042678    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podStartSLOduration=14.042656204 podStartE2EDuration="14.042656204s" podCreationTimestamp="2026-05-26 01:41:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:42:09.040753862 +0000 UTC m=+1869.367538166" watchObservedRunningTime="2026-05-26 01:42:09.042656204 +0000 UTC m=+1869.369440509"
May 26 01:42:12.018015 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:12.017794    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:12.018015 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:12.017844    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:12.018015 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:12.017860    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:12.018015 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:12.017872    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:12.020284 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:12.020127    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused"
May 26 01:42:12.020284 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:12.020148    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
May 26 01:42:12.020284 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:12.020180    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.22:6571: connect: connection refused"
May 26 01:42:12.020284 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:12.020193    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
May 26 01:42:13.427585 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:13.427289    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
May 26 01:42:13.767784 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:13.767746    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
May 26 01:42:15.019180 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.019144    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.019582 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.019294    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.019653 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.019630    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.019985 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.019960    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.020118 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.019990    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.020118 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.020000    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.020118 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.020056    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.020118 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.020088    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.020282 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.020248    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.023618 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.023601    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.039841 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.039813    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:15.043266 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:15.043237    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:42:23.427142 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:23.427097    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
May 26 01:42:23.427596 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:23.427249    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:42:23.767355 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:23.767310    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
May 26 01:42:23.767538 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:23.767465    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:42:25.074328 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.074291    2579 generic.go:358] "Generic (PLEG): container finished" podID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerID="79c58ceb68c07283c034c682fa229a105308690074ad4911fe052a232874d8a1" exitCode=137
May 26 01:42:25.074328 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.074319    2579 generic.go:358] "Generic (PLEG): container finished" podID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerID="641cf51c896bd795917aa4de7e1ede5c53405c1557ec183e5ef5ba175983836b" exitCode=137
May 26 01:42:25.074750 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.074366    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerDied","Data":"79c58ceb68c07283c034c682fa229a105308690074ad4911fe052a232874d8a1"}
May 26 01:42:25.074750 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.074431    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerDied","Data":"641cf51c896bd795917aa4de7e1ede5c53405c1557ec183e5ef5ba175983836b"}
May 26 01:42:25.573820 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.573795    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:42:25.578691 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.578671    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-offline-tls\") pod \"d135787f-b986-4300-b2a4-4abbdfcc293d\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") "
May 26 01:42:25.578782 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.578726    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-registry-tls\") pod \"d135787f-b986-4300-b2a4-4abbdfcc293d\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") "
May 26 01:42:25.578782 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.578774    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d135787f-b986-4300-b2a4-4abbdfcc293d-feast-data\") pod \"d135787f-b986-4300-b2a4-4abbdfcc293d\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") "
May 26 01:42:25.578854 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.578793    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxsb2\" (UniqueName: \"kubernetes.io/projected/d135787f-b986-4300-b2a4-4abbdfcc293d-kube-api-access-qxsb2\") pod \"d135787f-b986-4300-b2a4-4abbdfcc293d\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") "
May 26 01:42:25.578854 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.578823    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-ui-tls\") pod \"d135787f-b986-4300-b2a4-4abbdfcc293d\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") "
May 26 01:42:25.578854 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.578849    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-online-tls\") pod \"d135787f-b986-4300-b2a4-4abbdfcc293d\" (UID: \"d135787f-b986-4300-b2a4-4abbdfcc293d\") "
May 26 01:42:25.579282 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.579253    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d135787f-b986-4300-b2a4-4abbdfcc293d-feast-data" (OuterVolumeSpecName: "feast-data") pod "d135787f-b986-4300-b2a4-4abbdfcc293d" (UID: "d135787f-b986-4300-b2a4-4abbdfcc293d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 01:42:25.581143 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.581118    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d135787f-b986-4300-b2a4-4abbdfcc293d" (UID: "d135787f-b986-4300-b2a4-4abbdfcc293d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:42:25.581468 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.581441    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d135787f-b986-4300-b2a4-4abbdfcc293d" (UID: "d135787f-b986-4300-b2a4-4abbdfcc293d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:42:25.581579 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.581469    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d135787f-b986-4300-b2a4-4abbdfcc293d-kube-api-access-qxsb2" (OuterVolumeSpecName: "kube-api-access-qxsb2") pod "d135787f-b986-4300-b2a4-4abbdfcc293d" (UID: "d135787f-b986-4300-b2a4-4abbdfcc293d"). InnerVolumeSpecName "kube-api-access-qxsb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 01:42:25.581641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.581598    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d135787f-b986-4300-b2a4-4abbdfcc293d" (UID: "d135787f-b986-4300-b2a4-4abbdfcc293d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:42:25.581641 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.581598    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-online-tls" (OuterVolumeSpecName: "online-tls") pod "d135787f-b986-4300-b2a4-4abbdfcc293d" (UID: "d135787f-b986-4300-b2a4-4abbdfcc293d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:42:25.679749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.679710    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-online-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:42:25.679749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.679744    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-offline-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:42:25.679749 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.679754    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-registry-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:42:25.679988 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.679768    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d135787f-b986-4300-b2a4-4abbdfcc293d-feast-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:42:25.679988 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.679780    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxsb2\" (UniqueName: \"kubernetes.io/projected/d135787f-b986-4300-b2a4-4abbdfcc293d-kube-api-access-qxsb2\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:42:25.679988 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:25.679789    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d135787f-b986-4300-b2a4-4abbdfcc293d-ui-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:42:26.079455 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.079421    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6" event={"ID":"d135787f-b986-4300-b2a4-4abbdfcc293d","Type":"ContainerDied","Data":"29d703d50be891869f58f3925e8d7b1bacea645a44b32760ff8168d794e5dde1"}
May 26 01:42:26.080026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.079468    2579 scope.go:117] "RemoveContainer" containerID="81dbbde7a2c8fb4df285606fe7894f2b21e873b2a217166afef812ea6e31f491"
May 26 01:42:26.080026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.079484    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"
May 26 01:42:26.091072 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.091048    2579 scope.go:117] "RemoveContainer" containerID="79c58ceb68c07283c034c682fa229a105308690074ad4911fe052a232874d8a1"
May 26 01:42:26.098790 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.098768    2579 scope.go:117] "RemoveContainer" containerID="ca4b26e11b18e36d87a31a3cedd5785007d19341fbf975cb24634ca0890f76ce"
May 26 01:42:26.106090 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.106061    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"]
May 26 01:42:26.107247 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.107189    2579 scope.go:117] "RemoveContainer" containerID="641cf51c896bd795917aa4de7e1ede5c53405c1557ec183e5ef5ba175983836b"
May 26 01:42:26.109163 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.109130    2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-t2kl6"]
May 26 01:42:26.114840 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.114822    2579 scope.go:117] "RemoveContainer" containerID="ed36886b221c9c9c64e29a489e4c465d8932fc9c7a326c8fc84964069f836bbe"
May 26 01:42:26.122114 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.122097    2579 scope.go:117] "RemoveContainer" containerID="2a5ea0573f46d6fed3ddd9f2f2b39ce0ca938d19e401c41a245b3d1859b00b5a"
May 26 01:42:26.323928 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:42:26.323893    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" path="/var/lib/kubelet/pods/d135787f-b986-4300-b2a4-4abbdfcc293d/volumes"
May 26 01:43:16.857677 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.857644    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"]
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.857982    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="registry"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.857994    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="registry"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858003    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="ui"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858008    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="ui"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858021    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="feast-init"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858027    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="feast-init"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858037    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="online"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858043    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="online"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858048    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="offline"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858053    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="offline"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858066    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="feast-apply"
May 26 01:43:16.858074 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858072    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="feast-apply"
May 26 01:43:16.858453 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858126    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="ui"
May 26 01:43:16.858453 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858137    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="registry"
May 26 01:43:16.858453 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858143    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="online"
May 26 01:43:16.858453 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.858150    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d135787f-b986-4300-b2a4-4abbdfcc293d" containerName="offline"
May 26 01:43:16.862718 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.862700    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:16.864706 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.864684    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 01:43:16.864838 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.864723    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 01:43:16.864838 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.864691    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 01:43:16.864952 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.864887    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-knwrj\""
May 26 01:43:16.865008 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.864953    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 01:43:16.865008 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.865001    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 01:43:16.865106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.865000    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 01:43:16.871379 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.871358    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"]
May 26 01:43:16.924532 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.924494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e33c65b2-36f9-4879-88b1-88a5322aa576-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:16.924724 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.924548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:16.924724 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.924576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:16.924724 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.924632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e33c65b2-36f9-4879-88b1-88a5322aa576-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:16.924724 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.924668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:16.924724 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:16.924696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25hp\" (UniqueName: \"kubernetes.io/projected/e33c65b2-36f9-4879-88b1-88a5322aa576-kube-api-access-b25hp\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.026044 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.026012    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e33c65b2-36f9-4879-88b1-88a5322aa576-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.026240 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.026055    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.026240 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.026077    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.026240 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.026106    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e33c65b2-36f9-4879-88b1-88a5322aa576-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.026240 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.026132    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.026240 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.026172    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b25hp\" (UniqueName: \"kubernetes.io/projected/e33c65b2-36f9-4879-88b1-88a5322aa576-kube-api-access-b25hp\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.026579 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:43:17.026288    2579 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 01:43:17.026579 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:43:17.026381    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-ui-tls podName:e33c65b2-36f9-4879-88b1-88a5322aa576 nodeName:}" failed. No retries permitted until 2026-05-26 01:43:17.526361469 +0000 UTC m=+1937.853145758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-ui-tls") pod "feast-simple-feast-remote-setup-5cff94746b-k8wnv" (UID: "e33c65b2-36f9-4879-88b1-88a5322aa576") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 01:43:17.026579 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.026475    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e33c65b2-36f9-4879-88b1-88a5322aa576-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.026906 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.026884    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e33c65b2-36f9-4879-88b1-88a5322aa576-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.028911 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.028886    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.028980 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.028946    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.033903 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.033880    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25hp\" (UniqueName: \"kubernetes.io/projected/e33c65b2-36f9-4879-88b1-88a5322aa576-kube-api-access-b25hp\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.530322 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.530271    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.532817 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.532794    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-k8wnv\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.773419 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.773372    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:17.908395 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:17.908367    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"]
May 26 01:43:17.910895 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:43:17.910861    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode33c65b2_36f9_4879_88b1_88a5322aa576.slice/crio-934bc9c139bdfcd0d367e45a1481ff29f0511b7108834a2c06e34e3d23e93336 WatchSource:0}: Error finding container 934bc9c139bdfcd0d367e45a1481ff29f0511b7108834a2c06e34e3d23e93336: Status 404 returned error can't find the container with id 934bc9c139bdfcd0d367e45a1481ff29f0511b7108834a2c06e34e3d23e93336
May 26 01:43:18.236708 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:18.236607    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerStarted","Data":"bbdc4bf555774fa842f7968ce94a4ae36c743101c92ef15ebac1fddec83ea944"}
May 26 01:43:18.236708 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:18.236657    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerStarted","Data":"934bc9c139bdfcd0d367e45a1481ff29f0511b7108834a2c06e34e3d23e93336"}
May 26 01:43:23.255648 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:23.255606    2579 generic.go:358] "Generic (PLEG): container finished" podID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerID="bbdc4bf555774fa842f7968ce94a4ae36c743101c92ef15ebac1fddec83ea944" exitCode=0
May 26 01:43:23.256123 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:23.255663    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerDied","Data":"bbdc4bf555774fa842f7968ce94a4ae36c743101c92ef15ebac1fddec83ea944"}
May 26 01:43:24.261104 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:24.261066    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerStarted","Data":"fc50310a0e05a4c110d82ddd65e4eef5a2a6de0dd515fb172cbadef9e55be083"}
May 26 01:43:29.279015 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:29.278981    2579 generic.go:358] "Generic (PLEG): container finished" podID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerID="fc50310a0e05a4c110d82ddd65e4eef5a2a6de0dd515fb172cbadef9e55be083" exitCode=0
May 26 01:43:29.279396 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:29.279054    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerDied","Data":"fc50310a0e05a4c110d82ddd65e4eef5a2a6de0dd515fb172cbadef9e55be083"}
May 26 01:43:30.286558 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:30.286522    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerStarted","Data":"932bc5581aaf5cb5398f8041d426bf51ba98805d39a7985735cb2ba0d93c130f"}
May 26 01:43:30.287043 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:30.286568    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerStarted","Data":"9826b2464039206a38c9bfeedc1a020ee6ae47ba99e9997a1a8efeb33f18e8e0"}
May 26 01:43:30.287043 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:30.286580    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerStarted","Data":"3b453f836334fe2d0d01a42cb992b131bf6821c4c500886a96ae5fb098583a73"}
May 26 01:43:30.309324 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:30.309271    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podStartSLOduration=14.309252456 podStartE2EDuration="14.309252456s" podCreationTimestamp="2026-05-26 01:43:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:43:30.307116276 +0000 UTC m=+1950.633900581" watchObservedRunningTime="2026-05-26 01:43:30.309252456 +0000 UTC m=+1950.636036781"
May 26 01:43:32.773872 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:32.773818    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:32.773872 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:32.773875    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:32.774583 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:32.773890    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:32.775841 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:32.775804    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
May 26 01:43:32.775995 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:32.775873    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
May 26 01:43:32.775995 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:32.775804    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused"
May 26 01:43:35.775638 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:35.775608    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:35.776009 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:35.775733    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:35.776229 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:35.776184    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:35.776229 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:35.776215    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:35.776417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:35.776344    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:35.776539 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:35.776520    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:35.779617 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:35.779596    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:36.309397 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:36.309367    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:43:36.312589 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:43:36.312560    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:44:38.256594 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:38.256554    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"]
May 26 01:44:38.257692 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:38.257639    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="online" containerID="cri-o://3b453f836334fe2d0d01a42cb992b131bf6821c4c500886a96ae5fb098583a73" gracePeriod=30
May 26 01:44:38.257831 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:38.257684    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="ui" containerID="cri-o://932bc5581aaf5cb5398f8041d426bf51ba98805d39a7985735cb2ba0d93c130f" gracePeriod=30
May 26 01:44:38.257831 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:38.257714    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="offline" containerID="cri-o://9826b2464039206a38c9bfeedc1a020ee6ae47ba99e9997a1a8efeb33f18e8e0" gracePeriod=30
May 26 01:44:38.411552 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:38.411517    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"]
May 26 01:44:38.411923 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:38.411890    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="registry" containerID="cri-o://24e97e42dcaf8d8c635fcf7de35fd173caef2cab748579689862762fef5891a0" gracePeriod=30
May 26 01:44:38.412065 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:38.412017    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="offline" containerID="cri-o://9e147f0c895831ec6c7f42c1bffda32e89fade0028f8cd82572d9c67ed988687" gracePeriod=30
May 26 01:44:38.412160 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:38.412040    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="online" containerID="cri-o://7ca85d3b51e559ed3173e0bfd66406b619833c962c8a9783ed15e5481b854083" gracePeriod=30
May 26 01:44:38.412283 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:38.412259    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="ui" containerID="cri-o://c0d8a4010d1aba21c1271e983a1fa65f85d058114a480895f6c06f7f80a1789b" gracePeriod=30
May 26 01:44:39.501207 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:39.501111    2579 generic.go:358] "Generic (PLEG): container finished" podID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerID="c0d8a4010d1aba21c1271e983a1fa65f85d058114a480895f6c06f7f80a1789b" exitCode=0
May 26 01:44:39.501207 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:39.501140    2579 generic.go:358] "Generic (PLEG): container finished" podID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerID="7ca85d3b51e559ed3173e0bfd66406b619833c962c8a9783ed15e5481b854083" exitCode=0
May 26 01:44:39.501207 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:39.501189    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerDied","Data":"c0d8a4010d1aba21c1271e983a1fa65f85d058114a480895f6c06f7f80a1789b"}
May 26 01:44:39.501712 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:39.501231    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerDied","Data":"7ca85d3b51e559ed3173e0bfd66406b619833c962c8a9783ed15e5481b854083"}
May 26 01:44:39.503477 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:39.503459    2579 generic.go:358] "Generic (PLEG): container finished" podID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerID="932bc5581aaf5cb5398f8041d426bf51ba98805d39a7985735cb2ba0d93c130f" exitCode=0
May 26 01:44:39.503535 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:39.503478    2579 generic.go:358] "Generic (PLEG): container finished" podID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerID="3b453f836334fe2d0d01a42cb992b131bf6821c4c500886a96ae5fb098583a73" exitCode=0
May 26 01:44:39.503535 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:39.503518    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerDied","Data":"932bc5581aaf5cb5398f8041d426bf51ba98805d39a7985735cb2ba0d93c130f"}
May 26 01:44:39.503599 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:39.503537    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerDied","Data":"3b453f836334fe2d0d01a42cb992b131bf6821c4c500886a96ae5fb098583a73"}
May 26 01:44:45.020832 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:45.020774    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
May 26 01:44:45.040646 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:45.040605    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
May 26 01:44:45.776551 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:45.776504    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
May 26 01:44:46.310556 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:46.310510    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
May 26 01:44:55.020543 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:55.020491    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
May 26 01:44:55.040239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:55.040204    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
May 26 01:44:55.777131 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:55.777086    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
May 26 01:44:56.310502 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:44:56.310445    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
May 26 01:45:05.020631 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:05.020580    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
May 26 01:45:05.021096 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:05.020713    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:45:05.040251 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:05.040216    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
May 26 01:45:05.040339 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:05.040330    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:45:05.776667 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:05.776620    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
May 26 01:45:05.776851 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:05.776789    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:45:06.310488 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:06.310443    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
May 26 01:45:06.310858 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:06.310581    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:45:08.594961 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:08.594861    2579 generic.go:358] "Generic (PLEG): container finished" podID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerID="9e147f0c895831ec6c7f42c1bffda32e89fade0028f8cd82572d9c67ed988687" exitCode=137
May 26 01:45:08.594961 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:08.594893    2579 generic.go:358] "Generic (PLEG): container finished" podID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerID="24e97e42dcaf8d8c635fcf7de35fd173caef2cab748579689862762fef5891a0" exitCode=137
May 26 01:45:08.594961 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:08.594927    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerDied","Data":"9e147f0c895831ec6c7f42c1bffda32e89fade0028f8cd82572d9c67ed988687"}
May 26 01:45:08.594961 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:08.594961    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerDied","Data":"24e97e42dcaf8d8c635fcf7de35fd173caef2cab748579689862762fef5891a0"}
May 26 01:45:08.597313 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:08.597288    2579 generic.go:358] "Generic (PLEG): container finished" podID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerID="9826b2464039206a38c9bfeedc1a020ee6ae47ba99e9997a1a8efeb33f18e8e0" exitCode=137
May 26 01:45:08.597471 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:08.597360    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerDied","Data":"9826b2464039206a38c9bfeedc1a020ee6ae47ba99e9997a1a8efeb33f18e8e0"}
May 26 01:45:08.909039 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:08.909014    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:45:09.019917 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.019886    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b25hp\" (UniqueName: \"kubernetes.io/projected/e33c65b2-36f9-4879-88b1-88a5322aa576-kube-api-access-b25hp\") pod \"e33c65b2-36f9-4879-88b1-88a5322aa576\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") "
May 26 01:45:09.020091 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.019952    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e33c65b2-36f9-4879-88b1-88a5322aa576-feast-data\") pod \"e33c65b2-36f9-4879-88b1-88a5322aa576\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") "
May 26 01:45:09.020091 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.019981    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-online-tls\") pod \"e33c65b2-36f9-4879-88b1-88a5322aa576\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") "
May 26 01:45:09.020091 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.020008    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e33c65b2-36f9-4879-88b1-88a5322aa576-registry-tls\") pod \"e33c65b2-36f9-4879-88b1-88a5322aa576\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") "
May 26 01:45:09.020091 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.020024    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-ui-tls\") pod \"e33c65b2-36f9-4879-88b1-88a5322aa576\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") "
May 26 01:45:09.020091 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.020047    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-offline-tls\") pod \"e33c65b2-36f9-4879-88b1-88a5322aa576\" (UID: \"e33c65b2-36f9-4879-88b1-88a5322aa576\") "
May 26 01:45:09.020504 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.020471    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e33c65b2-36f9-4879-88b1-88a5322aa576-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e33c65b2-36f9-4879-88b1-88a5322aa576" (UID: "e33c65b2-36f9-4879-88b1-88a5322aa576"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 01:45:09.020647 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.020621    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e33c65b2-36f9-4879-88b1-88a5322aa576-feast-data" (OuterVolumeSpecName: "feast-data") pod "e33c65b2-36f9-4879-88b1-88a5322aa576" (UID: "e33c65b2-36f9-4879-88b1-88a5322aa576"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 01:45:09.022655 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.022626    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-online-tls" (OuterVolumeSpecName: "online-tls") pod "e33c65b2-36f9-4879-88b1-88a5322aa576" (UID: "e33c65b2-36f9-4879-88b1-88a5322aa576"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:45:09.022655 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.022653    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e33c65b2-36f9-4879-88b1-88a5322aa576" (UID: "e33c65b2-36f9-4879-88b1-88a5322aa576"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:45:09.022857 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.022815    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e33c65b2-36f9-4879-88b1-88a5322aa576-kube-api-access-b25hp" (OuterVolumeSpecName: "kube-api-access-b25hp") pod "e33c65b2-36f9-4879-88b1-88a5322aa576" (UID: "e33c65b2-36f9-4879-88b1-88a5322aa576"). InnerVolumeSpecName "kube-api-access-b25hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 01:45:09.022986 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.022964    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e33c65b2-36f9-4879-88b1-88a5322aa576" (UID: "e33c65b2-36f9-4879-88b1-88a5322aa576"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:45:09.063063 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.063035    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:45:09.121123 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121089    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-online-tls\") pod \"0b99ef30-92bd-41f1-a61a-1362dd07227c\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") "
May 26 01:45:09.121374 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121136    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85f44\" (UniqueName: \"kubernetes.io/projected/0b99ef30-92bd-41f1-a61a-1362dd07227c-kube-api-access-85f44\") pod \"0b99ef30-92bd-41f1-a61a-1362dd07227c\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") "
May 26 01:45:09.121374 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121201    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls\") pod \"0b99ef30-92bd-41f1-a61a-1362dd07227c\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") "
May 26 01:45:09.121374 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121247    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b99ef30-92bd-41f1-a61a-1362dd07227c-feast-data\") pod \"0b99ef30-92bd-41f1-a61a-1362dd07227c\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") "
May 26 01:45:09.121374 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121350    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-registry-tls\") pod \"0b99ef30-92bd-41f1-a61a-1362dd07227c\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") "
May 26 01:45:09.121612 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121437    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-offline-tls\") pod \"0b99ef30-92bd-41f1-a61a-1362dd07227c\" (UID: \"0b99ef30-92bd-41f1-a61a-1362dd07227c\") "
May 26 01:45:09.121743 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121722    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-online-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.121808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121752    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e33c65b2-36f9-4879-88b1-88a5322aa576-registry-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.121808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121769    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-ui-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.121808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121783    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e33c65b2-36f9-4879-88b1-88a5322aa576-offline-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.121808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121796    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b25hp\" (UniqueName: \"kubernetes.io/projected/e33c65b2-36f9-4879-88b1-88a5322aa576-kube-api-access-b25hp\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.121808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121794    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b99ef30-92bd-41f1-a61a-1362dd07227c-feast-data" (OuterVolumeSpecName: "feast-data") pod "0b99ef30-92bd-41f1-a61a-1362dd07227c" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 01:45:09.122047 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.121810    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e33c65b2-36f9-4879-88b1-88a5322aa576-feast-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.123574 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.123547    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-online-tls" (OuterVolumeSpecName: "online-tls") pod "0b99ef30-92bd-41f1-a61a-1362dd07227c" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:45:09.123707 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.123572    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b99ef30-92bd-41f1-a61a-1362dd07227c-kube-api-access-85f44" (OuterVolumeSpecName: "kube-api-access-85f44") pod "0b99ef30-92bd-41f1-a61a-1362dd07227c" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c"). InnerVolumeSpecName "kube-api-access-85f44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 01:45:09.123707 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.123677    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0b99ef30-92bd-41f1-a61a-1362dd07227c" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:45:09.123967 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.123947    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0b99ef30-92bd-41f1-a61a-1362dd07227c" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:45:09.124029 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.124011    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0b99ef30-92bd-41f1-a61a-1362dd07227c" (UID: "0b99ef30-92bd-41f1-a61a-1362dd07227c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:45:09.222292 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.222193    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-ui-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.222292 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.222241    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b99ef30-92bd-41f1-a61a-1362dd07227c-feast-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.222292 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.222253    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-registry-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.222292 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.222262    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-offline-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.222292 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.222278    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b99ef30-92bd-41f1-a61a-1362dd07227c-online-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.222292 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.222287    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85f44\" (UniqueName: \"kubernetes.io/projected/0b99ef30-92bd-41f1-a61a-1362dd07227c-kube-api-access-85f44\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:45:09.605030 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.604992    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4" event={"ID":"0b99ef30-92bd-41f1-a61a-1362dd07227c","Type":"ContainerDied","Data":"8d59eda6c6d3f4252ade0ccda0b1e565d8ad08846b3a9d849a8f57542fe4d795"}
May 26 01:45:09.605511 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.605046    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"
May 26 01:45:09.605511 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.605053    2579 scope.go:117] "RemoveContainer" containerID="c0d8a4010d1aba21c1271e983a1fa65f85d058114a480895f6c06f7f80a1789b"
May 26 01:45:09.608381 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.608349    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv" event={"ID":"e33c65b2-36f9-4879-88b1-88a5322aa576","Type":"ContainerDied","Data":"934bc9c139bdfcd0d367e45a1481ff29f0511b7108834a2c06e34e3d23e93336"}
May 26 01:45:09.608550 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.608424    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"
May 26 01:45:09.616135 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.616114    2579 scope.go:117] "RemoveContainer" containerID="9e147f0c895831ec6c7f42c1bffda32e89fade0028f8cd82572d9c67ed988687"
May 26 01:45:09.623918 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.623899    2579 scope.go:117] "RemoveContainer" containerID="7ca85d3b51e559ed3173e0bfd66406b619833c962c8a9783ed15e5481b854083"
May 26 01:45:09.627359 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.627332    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"]
May 26 01:45:09.630041 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.630019    2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-v2ks4"]
May 26 01:45:09.633172 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.633152    2579 scope.go:117] "RemoveContainer" containerID="24e97e42dcaf8d8c635fcf7de35fd173caef2cab748579689862762fef5891a0"
May 26 01:45:09.640498 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.640471    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"]
May 26 01:45:09.641211 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.641198    2579 scope.go:117] "RemoveContainer" containerID="9779a0b2d28d831aee33e64a6a21231738992e72a52b6f908e4d121163c08428"
May 26 01:45:09.645236 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.645209    2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-k8wnv"]
May 26 01:45:09.649994 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.649975    2579 scope.go:117] "RemoveContainer" containerID="caa8fb7f194d5f68e1a3b37aa8387c86d15c134d57f18eb17c725ad40acc11f3"
May 26 01:45:09.657663 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.657643    2579 scope.go:117] "RemoveContainer" containerID="932bc5581aaf5cb5398f8041d426bf51ba98805d39a7985735cb2ba0d93c130f"
May 26 01:45:09.665296 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.665273    2579 scope.go:117] "RemoveContainer" containerID="9826b2464039206a38c9bfeedc1a020ee6ae47ba99e9997a1a8efeb33f18e8e0"
May 26 01:45:09.672510 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.672493    2579 scope.go:117] "RemoveContainer" containerID="3b453f836334fe2d0d01a42cb992b131bf6821c4c500886a96ae5fb098583a73"
May 26 01:45:09.679482 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.679462    2579 scope.go:117] "RemoveContainer" containerID="fc50310a0e05a4c110d82ddd65e4eef5a2a6de0dd515fb172cbadef9e55be083"
May 26 01:45:09.686996 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:09.686979    2579 scope.go:117] "RemoveContainer" containerID="bbdc4bf555774fa842f7968ce94a4ae36c743101c92ef15ebac1fddec83ea944"
May 26 01:45:10.323924 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:10.323891    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" path="/var/lib/kubelet/pods/0b99ef30-92bd-41f1-a61a-1362dd07227c/volumes"
May 26 01:45:10.324524 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:10.324510    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" path="/var/lib/kubelet/pods/e33c65b2-36f9-4879-88b1-88a5322aa576/volumes"
May 26 01:45:48.837146 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837110    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"]
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837452    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="online"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837466    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="online"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837476    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="feast-init"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837482    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="feast-init"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837493    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="offline"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837498    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="offline"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837508    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="online"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837513    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="online"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837520    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="feast-apply"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837525    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="feast-apply"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837534    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="ui"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837539    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="ui"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837545    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="registry"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837550    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="registry"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837557    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="feast-apply"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837561    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="feast-apply"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837566    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="offline"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837571    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="offline"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837577    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="ui"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837586    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="ui"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837596    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="feast-init"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837603    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="feast-init"
May 26 01:45:48.837649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837660    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="registry"
May 26 01:45:48.838378 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837670    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="offline"
May 26 01:45:48.838378 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837677    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="ui"
May 26 01:45:48.838378 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837684    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="offline"
May 26 01:45:48.838378 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837690    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="online"
May 26 01:45:48.838378 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837696    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b99ef30-92bd-41f1-a61a-1362dd07227c" containerName="ui"
May 26 01:45:48.838378 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.837702    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="e33c65b2-36f9-4879-88b1-88a5322aa576" containerName="online"
May 26 01:45:48.841529 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.841502    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.844035 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.843966    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 01:45:48.844035 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.843985    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 01:45:48.844035 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.844010    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 01:45:48.844295 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.844069    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 01:45:48.844295 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.843966    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 01:45:48.844295 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.843995    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-lsd2w\""
May 26 01:45:48.844295 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.843994    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 01:45:48.853022 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.852992    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"]
May 26 01:45:48.857073 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.857038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.857202 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.857074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx9b7\" (UniqueName: \"kubernetes.io/projected/df859a84-0d3e-4a37-8624-fb5365225a7d-kube-api-access-cx9b7\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.857202 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.857156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.857292 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.857276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.857338 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.857329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.857383 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.857370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/df859a84-0d3e-4a37-8624-fb5365225a7d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.957942 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.957897    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.958128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.957962    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.958128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.957987    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.958128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.958013    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/df859a84-0d3e-4a37-8624-fb5365225a7d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.958128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.958036    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.958128 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:45:48.958037    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 26 01:45:48.958128 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:45:48.958096    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 01:45:48.958128 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:45:48.958128    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-offline-tls podName:df859a84-0d3e-4a37-8624-fb5365225a7d nodeName:}" failed. No retries permitted until 2026-05-26 01:45:49.4581043 +0000 UTC m=+2089.784888599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-jbvx6" (UID: "df859a84-0d3e-4a37-8624-fb5365225a7d") : secret "feast-simple-feast-setup-offline-tls" not found
May 26 01:45:48.958521 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:45:48.958146    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 01:45:48.958521 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:45:48.958172    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-online-tls podName:df859a84-0d3e-4a37-8624-fb5365225a7d nodeName:}" failed. No retries permitted until 2026-05-26 01:45:49.458154945 +0000 UTC m=+2089.784939227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-online-tls") pod "feast-simple-feast-setup-664fcfcc58-jbvx6" (UID: "df859a84-0d3e-4a37-8624-fb5365225a7d") : secret "feast-simple-feast-setup-online-tls" not found
May 26 01:45:48.958521 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.958197    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cx9b7\" (UniqueName: \"kubernetes.io/projected/df859a84-0d3e-4a37-8624-fb5365225a7d-kube-api-access-cx9b7\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.958521 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:45:48.958212    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-ui-tls podName:df859a84-0d3e-4a37-8624-fb5365225a7d nodeName:}" failed. No retries permitted until 2026-05-26 01:45:49.458199617 +0000 UTC m=+2089.784983902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-jbvx6" (UID: "df859a84-0d3e-4a37-8624-fb5365225a7d") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 01:45:48.958673 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.958532    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/df859a84-0d3e-4a37-8624-fb5365225a7d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.960779 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.960753    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:48.968488 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:48.968458    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx9b7\" (UniqueName: \"kubernetes.io/projected/df859a84-0d3e-4a37-8624-fb5365225a7d-kube-api-access-cx9b7\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:49.462599 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:49.462536    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:49.462599 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:49.462599    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:49.462845 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:49.462643    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:49.465235 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:49.465204    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:49.465363 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:49.465255    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:49.465363 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:49.465346    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jbvx6\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:49.760372 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:49.760330    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:45:49.931829 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:49.931744    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"]
May 26 01:45:49.934549 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:45:49.934518    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf859a84_0d3e_4a37_8624_fb5365225a7d.slice/crio-13f5fa299ab716df4cd77d39e674a86f8ddbbb8ed77574572e71007b8fc9787c WatchSource:0}: Error finding container 13f5fa299ab716df4cd77d39e674a86f8ddbbb8ed77574572e71007b8fc9787c: Status 404 returned error can't find the container with id 13f5fa299ab716df4cd77d39e674a86f8ddbbb8ed77574572e71007b8fc9787c
May 26 01:45:49.936310 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:49.936288    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 01:45:50.744386 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:50.744348    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerStarted","Data":"203220f7f7aec9ac5ef383749717c22fe4aea46aafe6ee1a5ca0e2227d6a8682"}
May 26 01:45:50.744593 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:50.744396    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerStarted","Data":"13f5fa299ab716df4cd77d39e674a86f8ddbbb8ed77574572e71007b8fc9787c"}
May 26 01:45:55.761072 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:55.761032    2579 generic.go:358] "Generic (PLEG): container finished" podID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerID="203220f7f7aec9ac5ef383749717c22fe4aea46aafe6ee1a5ca0e2227d6a8682" exitCode=0
May 26 01:45:55.761491 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:55.761075    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerDied","Data":"203220f7f7aec9ac5ef383749717c22fe4aea46aafe6ee1a5ca0e2227d6a8682"}
May 26 01:45:56.767917 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:45:56.767878    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerStarted","Data":"50b0d70c316e2ec34cd23d3d0f5f367f74208e039afa1bc723294748fdf92543"}
May 26 01:46:01.784016 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:01.783977    2579 generic.go:358] "Generic (PLEG): container finished" podID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerID="50b0d70c316e2ec34cd23d3d0f5f367f74208e039afa1bc723294748fdf92543" exitCode=0
May 26 01:46:01.784392 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:01.784039    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerDied","Data":"50b0d70c316e2ec34cd23d3d0f5f367f74208e039afa1bc723294748fdf92543"}
May 26 01:46:02.791808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:02.791761    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerStarted","Data":"8e215eace748f5186ff32b64cfedf1ba15cc9d3c5cce481aa5198b5ce5a0eaf4"}
May 26 01:46:02.792283 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:02.791821    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerStarted","Data":"8494979b55c30651da643ecc1fc47f2529e538c167bb53cbb89951e3b0004871"}
May 26 01:46:02.792283 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:02.791839    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerStarted","Data":"eeeffab1a4fdf38866328026bf6ec6485eadd71fbf966dc12a0590f69c92f877"}
May 26 01:46:02.792283 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:02.791851    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerStarted","Data":"0a6dd09b556c7460d80a6ebd90ea7df3cdfe63e6631fb2c78874e6d4b45e86df"}
May 26 01:46:02.814931 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:02.814857    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podStartSLOduration=14.814835732 podStartE2EDuration="14.814835732s" podCreationTimestamp="2026-05-26 01:45:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:46:02.812284257 +0000 UTC m=+2103.139068602" watchObservedRunningTime="2026-05-26 01:46:02.814835732 +0000 UTC m=+2103.141620037"
May 26 01:46:04.760917 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:04.760874    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:04.761517 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:04.761484    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:04.761517 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:04.761513    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:04.761711 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:04.761526    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:04.763086 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:04.763048    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
May 26 01:46:04.763186 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:04.763070    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 01:46:04.763186 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:04.763156    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused"
May 26 01:46:04.763186 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:04.763159    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 26 01:46:07.762045 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.762012    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.762526 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.762135    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.762526 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.762375    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.762814 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.762791    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.762943 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.762820    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.762943 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.762835    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.763054 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.762958    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.763054 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.763016    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.763346 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.763329    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.766660 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.766641    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.812437 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.812388    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:46:07.815499 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:46:07.815473    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:47:08.799278 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:08.799239    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"]
May 26 01:47:08.800387 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:08.800349    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="registry" containerID="cri-o://0a6dd09b556c7460d80a6ebd90ea7df3cdfe63e6631fb2c78874e6d4b45e86df" gracePeriod=30
May 26 01:47:08.800643 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:08.800617    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="online" containerID="cri-o://eeeffab1a4fdf38866328026bf6ec6485eadd71fbf966dc12a0590f69c92f877" gracePeriod=30
May 26 01:47:08.801505 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:08.800640    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="offline" containerID="cri-o://8494979b55c30651da643ecc1fc47f2529e538c167bb53cbb89951e3b0004871" gracePeriod=30
May 26 01:47:08.801505 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:08.800699    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="ui" containerID="cri-o://8e215eace748f5186ff32b64cfedf1ba15cc9d3c5cce481aa5198b5ce5a0eaf4" gracePeriod=30
May 26 01:47:09.166075 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.165986    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"]
May 26 01:47:09.170341 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.170315    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.172237 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.172213    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-j55sj\""
May 26 01:47:09.180661 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.180633    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"]
May 26 01:47:09.247232 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.247192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.247232 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.247238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.247492 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.247268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.247492 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.247290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.247492 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.247368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.247492 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.247423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5twxl\" (UniqueName: \"kubernetes.io/projected/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-kube-api-access-5twxl\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.348592 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.348552    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.348592 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.348596    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.348819 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.348651    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.348819 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.348684    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.348819 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.348733    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.348819 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.348761    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5twxl\" (UniqueName: \"kubernetes.io/projected/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-kube-api-access-5twxl\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.349165 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.349142    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.351417 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.351363    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.351547 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.351432    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.351547 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.351517    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.351822 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.351800    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.355969 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.355943    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5twxl\" (UniqueName: \"kubernetes.io/projected/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-kube-api-access-5twxl\") pod \"feast-simple-feast-setup-664fcfcc58-j8gpb\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.482555 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.482448    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:09.630852 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:09.630786    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"]
May 26 01:47:09.633498 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:47:09.633458    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod084ca8e4_05f4_4cf7_82aa_977acac0c4b8.slice/crio-0d05e6265ce6a7efed9820de2f8658f8b70cfeb7bb2213c42e440b0e4cec6766 WatchSource:0}: Error finding container 0d05e6265ce6a7efed9820de2f8658f8b70cfeb7bb2213c42e440b0e4cec6766: Status 404 returned error can't find the container with id 0d05e6265ce6a7efed9820de2f8658f8b70cfeb7bb2213c42e440b0e4cec6766
May 26 01:47:10.003489 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:10.003444    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerStarted","Data":"736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8"}
May 26 01:47:10.003489 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:10.003490    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerStarted","Data":"0d05e6265ce6a7efed9820de2f8658f8b70cfeb7bb2213c42e440b0e4cec6766"}
May 26 01:47:10.006349 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:10.006319    2579 generic.go:358] "Generic (PLEG): container finished" podID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerID="8e215eace748f5186ff32b64cfedf1ba15cc9d3c5cce481aa5198b5ce5a0eaf4" exitCode=0
May 26 01:47:10.006349 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:10.006346    2579 generic.go:358] "Generic (PLEG): container finished" podID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerID="eeeffab1a4fdf38866328026bf6ec6485eadd71fbf966dc12a0590f69c92f877" exitCode=0
May 26 01:47:10.006642 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:10.006356    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerDied","Data":"8e215eace748f5186ff32b64cfedf1ba15cc9d3c5cce481aa5198b5ce5a0eaf4"}
May 26 01:47:10.006642 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:10.006457    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerDied","Data":"eeeffab1a4fdf38866328026bf6ec6485eadd71fbf966dc12a0590f69c92f877"}
May 26 01:47:15.021890 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:15.021849    2579 generic.go:358] "Generic (PLEG): container finished" podID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerID="736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8" exitCode=0
May 26 01:47:15.022281 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:15.021925    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerDied","Data":"736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8"}
May 26 01:47:16.026885 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:16.026850    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerStarted","Data":"93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0"}
May 26 01:47:17.763051 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:17.762999    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 01:47:17.813647 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:17.813599    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 26 01:47:21.042921 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:21.042889    2579 generic.go:358] "Generic (PLEG): container finished" podID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerID="93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0" exitCode=0
May 26 01:47:21.042921 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:21.042932    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerDied","Data":"93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0"}
May 26 01:47:22.050364 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:22.050320    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerStarted","Data":"5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36"}
May 26 01:47:22.050885 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:22.050373    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerStarted","Data":"6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67"}
May 26 01:47:22.050885 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:22.050388    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerStarted","Data":"68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6"}
May 26 01:47:22.050885 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:22.050435    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerStarted","Data":"94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d"}
May 26 01:47:22.071069 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:22.070994    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podStartSLOduration=13.070972559 podStartE2EDuration="13.070972559s" podCreationTimestamp="2026-05-26 01:47:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:47:22.070422039 +0000 UTC m=+2182.397206341" watchObservedRunningTime="2026-05-26 01:47:22.070972559 +0000 UTC m=+2182.397756876"
May 26 01:47:24.482570 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:24.482521    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:24.483093 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:24.482580    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:24.483093 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:24.482597    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:24.483093 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:24.482818    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:24.484978 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:24.484943    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused"
May 26 01:47:24.485223 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:24.484953    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 26 01:47:24.485443 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:24.485045    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 26 01:47:24.485559 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:24.485098    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused"
May 26 01:47:27.484360 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.484329    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.484824 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.484545    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.484824 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.484669    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.485106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.485042    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.485106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.485070    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.485106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.485081    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.485333 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.485294    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.485488 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.485469    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.485540 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.485515    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.489088 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.489070    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:27.763594 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.763547    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 01:47:27.812795 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:27.812750    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 26 01:47:28.083727 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:28.083626    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:28.086784 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:28.086761    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:47:37.763271 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:37.763219    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 01:47:37.763844 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:37.763397    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:47:37.813152 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:37.813109    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 26 01:47:37.813326 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:37.813227    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:47:39.120760 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.120676    2579 generic.go:358] "Generic (PLEG): container finished" podID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerID="8494979b55c30651da643ecc1fc47f2529e538c167bb53cbb89951e3b0004871" exitCode=137
May 26 01:47:39.120760 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.120702    2579 generic.go:358] "Generic (PLEG): container finished" podID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerID="0a6dd09b556c7460d80a6ebd90ea7df3cdfe63e6631fb2c78874e6d4b45e86df" exitCode=137
May 26 01:47:39.121135 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.120752    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerDied","Data":"8494979b55c30651da643ecc1fc47f2529e538c167bb53cbb89951e3b0004871"}
May 26 01:47:39.121135 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.120787    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerDied","Data":"0a6dd09b556c7460d80a6ebd90ea7df3cdfe63e6631fb2c78874e6d4b45e86df"}
May 26 01:47:39.452167 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.452139    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:47:39.631373 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.631329    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-registry-tls\") pod \"df859a84-0d3e-4a37-8624-fb5365225a7d\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") "
May 26 01:47:39.631373 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.631377    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-offline-tls\") pod \"df859a84-0d3e-4a37-8624-fb5365225a7d\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") "
May 26 01:47:39.631653 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.631431    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/df859a84-0d3e-4a37-8624-fb5365225a7d-feast-data\") pod \"df859a84-0d3e-4a37-8624-fb5365225a7d\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") "
May 26 01:47:39.631653 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.631472    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-online-tls\") pod \"df859a84-0d3e-4a37-8624-fb5365225a7d\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") "
May 26 01:47:39.631653 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.631617    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-ui-tls\") pod \"df859a84-0d3e-4a37-8624-fb5365225a7d\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") "
May 26 01:47:39.631830 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.631678    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx9b7\" (UniqueName: \"kubernetes.io/projected/df859a84-0d3e-4a37-8624-fb5365225a7d-kube-api-access-cx9b7\") pod \"df859a84-0d3e-4a37-8624-fb5365225a7d\" (UID: \"df859a84-0d3e-4a37-8624-fb5365225a7d\") "
May 26 01:47:39.632054 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.632019    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df859a84-0d3e-4a37-8624-fb5365225a7d-feast-data" (OuterVolumeSpecName: "feast-data") pod "df859a84-0d3e-4a37-8624-fb5365225a7d" (UID: "df859a84-0d3e-4a37-8624-fb5365225a7d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 01:47:39.633787 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.633755    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "df859a84-0d3e-4a37-8624-fb5365225a7d" (UID: "df859a84-0d3e-4a37-8624-fb5365225a7d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:47:39.634248 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.634174    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "df859a84-0d3e-4a37-8624-fb5365225a7d" (UID: "df859a84-0d3e-4a37-8624-fb5365225a7d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:47:39.634248 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.634240    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "df859a84-0d3e-4a37-8624-fb5365225a7d" (UID: "df859a84-0d3e-4a37-8624-fb5365225a7d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:47:39.634372 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.634306    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-online-tls" (OuterVolumeSpecName: "online-tls") pod "df859a84-0d3e-4a37-8624-fb5365225a7d" (UID: "df859a84-0d3e-4a37-8624-fb5365225a7d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:47:39.634372 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.634318    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df859a84-0d3e-4a37-8624-fb5365225a7d-kube-api-access-cx9b7" (OuterVolumeSpecName: "kube-api-access-cx9b7") pod "df859a84-0d3e-4a37-8624-fb5365225a7d" (UID: "df859a84-0d3e-4a37-8624-fb5365225a7d"). InnerVolumeSpecName "kube-api-access-cx9b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 01:47:39.732677 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.732588    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-registry-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:47:39.732677 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.732622    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-offline-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:47:39.732677 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.732631    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/df859a84-0d3e-4a37-8624-fb5365225a7d-feast-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:47:39.732677 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.732639    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-online-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:47:39.732677 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.732649    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/df859a84-0d3e-4a37-8624-fb5365225a7d-ui-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:47:39.732677 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:39.732657    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx9b7\" (UniqueName: \"kubernetes.io/projected/df859a84-0d3e-4a37-8624-fb5365225a7d-kube-api-access-cx9b7\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:47:40.126643 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.126609    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"
May 26 01:47:40.126643 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.126618    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6" event={"ID":"df859a84-0d3e-4a37-8624-fb5365225a7d","Type":"ContainerDied","Data":"13f5fa299ab716df4cd77d39e674a86f8ddbbb8ed77574572e71007b8fc9787c"}
May 26 01:47:40.127200 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.126666    2579 scope.go:117] "RemoveContainer" containerID="8e215eace748f5186ff32b64cfedf1ba15cc9d3c5cce481aa5198b5ce5a0eaf4"
May 26 01:47:40.135453 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.135433    2579 scope.go:117] "RemoveContainer" containerID="8494979b55c30651da643ecc1fc47f2529e538c167bb53cbb89951e3b0004871"
May 26 01:47:40.143076 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.143047    2579 scope.go:117] "RemoveContainer" containerID="eeeffab1a4fdf38866328026bf6ec6485eadd71fbf966dc12a0590f69c92f877"
May 26 01:47:40.148966 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.148940    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"]
May 26 01:47:40.151842 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.151818    2579 scope.go:117] "RemoveContainer" containerID="0a6dd09b556c7460d80a6ebd90ea7df3cdfe63e6631fb2c78874e6d4b45e86df"
May 26 01:47:40.153809 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.153784    2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jbvx6"]
May 26 01:47:40.159255 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.159237    2579 scope.go:117] "RemoveContainer" containerID="50b0d70c316e2ec34cd23d3d0f5f367f74208e039afa1bc723294748fdf92543"
May 26 01:47:40.166078 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.166061    2579 scope.go:117] "RemoveContainer" containerID="203220f7f7aec9ac5ef383749717c22fe4aea46aafe6ee1a5ca0e2227d6a8682"
May 26 01:47:40.324018 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:47:40.323985    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" path="/var/lib/kubelet/pods/df859a84-0d3e-4a37-8624-fb5365225a7d/volumes"
May 26 01:48:30.487203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487116    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"]
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487460    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="online"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487474    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="online"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487485    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="feast-apply"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487491    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="feast-apply"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487498    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="feast-init"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487503    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="feast-init"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487511    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="ui"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487516    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="ui"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487525    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="offline"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487530    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="offline"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487538    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="registry"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487543    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="registry"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487591    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="registry"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487601    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="online"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487607    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="ui"
May 26 01:48:30.487725 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.487614    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="df859a84-0d3e-4a37-8624-fb5365225a7d" containerName="offline"
May 26 01:48:30.490789 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.490770    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.493179 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.493144    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 01:48:30.493343 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.493179    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 01:48:30.493343 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.493188    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 01:48:30.493343 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.493144    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 01:48:30.493343 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.493147    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-lmntr\""
May 26 01:48:30.493568 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.493553    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 01:48:30.493602 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.493586    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 01:48:30.500808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.500780    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"]
May 26 01:48:30.576710 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.576665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.576954 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.576729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.576954 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.576755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2922812c-7311-48ce-825b-9200e5579038-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.576954 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.576779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c5f8\" (UniqueName: \"kubernetes.io/projected/2922812c-7311-48ce-825b-9200e5579038-kube-api-access-5c5f8\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.576954 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.576904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2922812c-7311-48ce-825b-9200e5579038-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.577199 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.576951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.677344 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.677311    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2922812c-7311-48ce-825b-9200e5579038-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.677576 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.677353    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.677576 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.677371    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.677576 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.677421    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.677576 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.677458    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2922812c-7311-48ce-825b-9200e5579038-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.677576 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:48:30.677485    2579 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 26 01:48:30.677576 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.677484    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5c5f8\" (UniqueName: \"kubernetes.io/projected/2922812c-7311-48ce-825b-9200e5579038-kube-api-access-5c5f8\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.677576 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:48:30.677567    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-online-tls podName:2922812c-7311-48ce-825b-9200e5579038 nodeName:}" failed. No retries permitted until 2026-05-26 01:48:31.177544731 +0000 UTC m=+2251.504329012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-l9wqc" (UID: "2922812c-7311-48ce-825b-9200e5579038") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 26 01:48:30.678026 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.677949    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2922812c-7311-48ce-825b-9200e5579038-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.678104 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.678087    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2922812c-7311-48ce-825b-9200e5579038-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.680709 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.680683    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.680839 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.680686    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:30.688756 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:30.688695    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c5f8\" (UniqueName: \"kubernetes.io/projected/2922812c-7311-48ce-825b-9200e5579038-kube-api-access-5c5f8\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:31.180750 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:31.180711    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:31.183242 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:31.183220    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-l9wqc\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:31.400926 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:31.400883    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:31.545830 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:31.545802    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"]
May 26 01:48:31.548035 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:48:31.548001    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2922812c_7311_48ce_825b_9200e5579038.slice/crio-72cb9b3309b09422f78de97fd4bcc02da5e971fb62b03998dbd2e4064bd70179 WatchSource:0}: Error finding container 72cb9b3309b09422f78de97fd4bcc02da5e971fb62b03998dbd2e4064bd70179: Status 404 returned error can't find the container with id 72cb9b3309b09422f78de97fd4bcc02da5e971fb62b03998dbd2e4064bd70179
May 26 01:48:32.282196 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:32.282155    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerStarted","Data":"59c509cbdcdbea50172ae8a98b5787bc080251a036024e10b55c3713c41ca331"}
May 26 01:48:32.282196 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:32.282195    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerStarted","Data":"72cb9b3309b09422f78de97fd4bcc02da5e971fb62b03998dbd2e4064bd70179"}
May 26 01:48:36.297106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:36.297067    2579 generic.go:358] "Generic (PLEG): container finished" podID="2922812c-7311-48ce-825b-9200e5579038" containerID="59c509cbdcdbea50172ae8a98b5787bc080251a036024e10b55c3713c41ca331" exitCode=0
May 26 01:48:36.297551 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:36.297126    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerDied","Data":"59c509cbdcdbea50172ae8a98b5787bc080251a036024e10b55c3713c41ca331"}
May 26 01:48:37.301540 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:37.301504    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerStarted","Data":"bec4139583c95cfd3ee5b6aedba9f0c23bb6325486ddc7eedacb44a8750a9fd0"}
May 26 01:48:42.319362 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:42.319325    2579 generic.go:358] "Generic (PLEG): container finished" podID="2922812c-7311-48ce-825b-9200e5579038" containerID="bec4139583c95cfd3ee5b6aedba9f0c23bb6325486ddc7eedacb44a8750a9fd0" exitCode=0
May 26 01:48:42.322657 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:42.322632    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerDied","Data":"bec4139583c95cfd3ee5b6aedba9f0c23bb6325486ddc7eedacb44a8750a9fd0"}
May 26 01:48:43.325614 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.325572    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerStarted","Data":"cafcd90bc813390bbe50c779727eaceb47d0f4f7dc3c98097004c0fb0e4231ed"}
May 26 01:48:43.326018 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.325630    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerStarted","Data":"90f90280ae976b38126e85eb19c29af4e47813341accdae372015f8ed11931aa"}
May 26 01:48:43.326018 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.325647    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerStarted","Data":"26d6549ffa92b8e1ab7af1f8b282ab08a2128af7e4aadf1f633201ba03150305"}
May 26 01:48:43.347487 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.347397    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podStartSLOduration=13.347379686 podStartE2EDuration="13.347379686s" podCreationTimestamp="2026-05-26 01:48:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:48:43.344767012 +0000 UTC m=+2263.671551352" watchObservedRunningTime="2026-05-26 01:48:43.347379686 +0000 UTC m=+2263.674164038"
May 26 01:48:43.401691 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.401646    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:43.401885 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.401709    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:43.401885 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.401726    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:43.403152 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.402990    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused"
May 26 01:48:43.403152 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.403019    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
May 26 01:48:43.403152 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:43.403031    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
May 26 01:48:46.401415 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:46.401362    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused"
May 26 01:48:46.401932 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:46.401452    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
May 26 01:48:46.401932 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:46.401370    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
May 26 01:48:49.402558 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:49.402523    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:49.403037 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:49.402661    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:49.403110 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:49.403091    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:49.403166 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:49.403128    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:49.403497 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:49.403478    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:49.403570 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:49.403519    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:49.406980 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:49.406960    2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:50.349274 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:50.349243    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:48:50.352311 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:48:50.352290    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:49:51.490533 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:51.490426    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"]
May 26 01:49:51.491106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:51.490881    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="online" containerID="cri-o://26d6549ffa92b8e1ab7af1f8b282ab08a2128af7e4aadf1f633201ba03150305" gracePeriod=30
May 26 01:49:51.491106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:51.490977    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="ui" containerID="cri-o://cafcd90bc813390bbe50c779727eaceb47d0f4f7dc3c98097004c0fb0e4231ed" gracePeriod=30
May 26 01:49:51.491106 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:51.491026    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="offline" containerID="cri-o://90f90280ae976b38126e85eb19c29af4e47813341accdae372015f8ed11931aa" gracePeriod=30
May 26 01:49:51.643813 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:51.643774    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"]
May 26 01:49:51.644275 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:51.644241    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="registry" containerID="cri-o://94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d" gracePeriod=30
May 26 01:49:51.644536 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:51.644289    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="offline" containerID="cri-o://6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67" gracePeriod=30
May 26 01:49:51.644648 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:51.644294    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="ui" containerID="cri-o://5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36" gracePeriod=30
May 26 01:49:51.644648 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:51.644303    2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="online" containerID="cri-o://68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6" gracePeriod=30
May 26 01:49:52.538234 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:52.538185    2579 generic.go:358] "Generic (PLEG): container finished" podID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerID="5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36" exitCode=0
May 26 01:49:52.538234 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:52.538229    2579 generic.go:358] "Generic (PLEG): container finished" podID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerID="68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6" exitCode=0
May 26 01:49:52.538687 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:52.538259    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerDied","Data":"5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36"}
May 26 01:49:52.538687 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:52.538302    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerDied","Data":"68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6"}
May 26 01:49:52.541003 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:52.540975    2579 generic.go:358] "Generic (PLEG): container finished" podID="2922812c-7311-48ce-825b-9200e5579038" containerID="cafcd90bc813390bbe50c779727eaceb47d0f4f7dc3c98097004c0fb0e4231ed" exitCode=0
May 26 01:49:52.541003 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:52.540999    2579 generic.go:358] "Generic (PLEG): container finished" podID="2922812c-7311-48ce-825b-9200e5579038" containerID="26d6549ffa92b8e1ab7af1f8b282ab08a2128af7e4aadf1f633201ba03150305" exitCode=0
May 26 01:49:52.541179 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:52.541049    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerDied","Data":"cafcd90bc813390bbe50c779727eaceb47d0f4f7dc3c98097004c0fb0e4231ed"}
May 26 01:49:52.541179 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:52.541089    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerDied","Data":"26d6549ffa92b8e1ab7af1f8b282ab08a2128af7e4aadf1f633201ba03150305"}
May 26 01:49:57.485387 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:57.485329    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 26 01:49:58.084493 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:58.084435    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 26 01:49:59.403700 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:49:59.403656    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
May 26 01:50:00.350318 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:00.350270    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
May 26 01:50:07.485976 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:07.485923    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 26 01:50:08.083889 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:08.083848    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 26 01:50:09.403919 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:09.403866    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
May 26 01:50:10.349610 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:10.349571    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
May 26 01:50:17.485742 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:17.485690    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 26 01:50:17.486228 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:17.485840    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:50:18.084815 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:18.084766    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 26 01:50:18.085001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:18.084958    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:50:19.404156 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:19.404106    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
May 26 01:50:19.404626 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:19.404240    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:50:20.350120 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:20.350071    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
May 26 01:50:20.350343 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:20.350242    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:50:21.631478 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:21.631446    2579 generic.go:358] "Generic (PLEG): container finished" podID="2922812c-7311-48ce-825b-9200e5579038" containerID="90f90280ae976b38126e85eb19c29af4e47813341accdae372015f8ed11931aa" exitCode=137
May 26 01:50:21.631845 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:21.631491    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerDied","Data":"90f90280ae976b38126e85eb19c29af4e47813341accdae372015f8ed11931aa"}
May 26 01:50:22.141857 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.141827    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:50:22.246265 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.246235    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-ui-tls\") pod \"2922812c-7311-48ce-825b-9200e5579038\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") "
May 26 01:50:22.246463 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.246279    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2922812c-7311-48ce-825b-9200e5579038-registry-tls\") pod \"2922812c-7311-48ce-825b-9200e5579038\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") "
May 26 01:50:22.246463 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.246300    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2922812c-7311-48ce-825b-9200e5579038-feast-data\") pod \"2922812c-7311-48ce-825b-9200e5579038\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") "
May 26 01:50:22.246463 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.246326    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-offline-tls\") pod \"2922812c-7311-48ce-825b-9200e5579038\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") "
May 26 01:50:22.246463 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.246430    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-online-tls\") pod \"2922812c-7311-48ce-825b-9200e5579038\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") "
May 26 01:50:22.246698 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.246473    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c5f8\" (UniqueName: \"kubernetes.io/projected/2922812c-7311-48ce-825b-9200e5579038-kube-api-access-5c5f8\") pod \"2922812c-7311-48ce-825b-9200e5579038\" (UID: \"2922812c-7311-48ce-825b-9200e5579038\") "
May 26 01:50:22.246698 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.246685    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2922812c-7311-48ce-825b-9200e5579038-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2922812c-7311-48ce-825b-9200e5579038" (UID: "2922812c-7311-48ce-825b-9200e5579038"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 01:50:22.246849 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.246818    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2922812c-7311-48ce-825b-9200e5579038-feast-data" (OuterVolumeSpecName: "feast-data") pod "2922812c-7311-48ce-825b-9200e5579038" (UID: "2922812c-7311-48ce-825b-9200e5579038"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 01:50:22.248945 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.248914    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2922812c-7311-48ce-825b-9200e5579038-kube-api-access-5c5f8" (OuterVolumeSpecName: "kube-api-access-5c5f8") pod "2922812c-7311-48ce-825b-9200e5579038" (UID: "2922812c-7311-48ce-825b-9200e5579038"). InnerVolumeSpecName "kube-api-access-5c5f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 01:50:22.249058 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.248972    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2922812c-7311-48ce-825b-9200e5579038" (UID: "2922812c-7311-48ce-825b-9200e5579038"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:50:22.249058 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.249002    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-online-tls" (OuterVolumeSpecName: "online-tls") pod "2922812c-7311-48ce-825b-9200e5579038" (UID: "2922812c-7311-48ce-825b-9200e5579038"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:50:22.249058 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.249013    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2922812c-7311-48ce-825b-9200e5579038" (UID: "2922812c-7311-48ce-825b-9200e5579038"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:50:22.290565 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.290541    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:50:22.348001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.347972    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-online-tls\") pod \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") "
May 26 01:50:22.348001 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348002    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-registry-tls\") pod \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") "
May 26 01:50:22.348184 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348035    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-ui-tls\") pod \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") "
May 26 01:50:22.348184 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348068    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5twxl\" (UniqueName: \"kubernetes.io/projected/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-kube-api-access-5twxl\") pod \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") "
May 26 01:50:22.348184 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348091    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-feast-data\") pod \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") "
May 26 01:50:22.348184 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348117    2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-offline-tls\") pod \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\" (UID: \"084ca8e4-05f4-4cf7-82aa-977acac0c4b8\") "
May 26 01:50:22.348373 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348319    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-online-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.348373 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348339    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c5f8\" (UniqueName: \"kubernetes.io/projected/2922812c-7311-48ce-825b-9200e5579038-kube-api-access-5c5f8\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.348373 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348353    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-ui-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.348373 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348366    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2922812c-7311-48ce-825b-9200e5579038-registry-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.348600 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348381    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2922812c-7311-48ce-825b-9200e5579038-feast-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.348600 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348396    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2922812c-7311-48ce-825b-9200e5579038-offline-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.348735 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.348703    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-feast-data" (OuterVolumeSpecName: "feast-data") pod "084ca8e4-05f4-4cf7-82aa-977acac0c4b8" (UID: "084ca8e4-05f4-4cf7-82aa-977acac0c4b8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 01:50:22.350769 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.350729    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "084ca8e4-05f4-4cf7-82aa-977acac0c4b8" (UID: "084ca8e4-05f4-4cf7-82aa-977acac0c4b8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:50:22.350769 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.350748    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-online-tls" (OuterVolumeSpecName: "online-tls") pod "084ca8e4-05f4-4cf7-82aa-977acac0c4b8" (UID: "084ca8e4-05f4-4cf7-82aa-977acac0c4b8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:50:22.350956 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.350939    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-kube-api-access-5twxl" (OuterVolumeSpecName: "kube-api-access-5twxl") pod "084ca8e4-05f4-4cf7-82aa-977acac0c4b8" (UID: "084ca8e4-05f4-4cf7-82aa-977acac0c4b8"). InnerVolumeSpecName "kube-api-access-5twxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 01:50:22.351047 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.351028    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "084ca8e4-05f4-4cf7-82aa-977acac0c4b8" (UID: "084ca8e4-05f4-4cf7-82aa-977acac0c4b8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:50:22.359729 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.359701    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "084ca8e4-05f4-4cf7-82aa-977acac0c4b8" (UID: "084ca8e4-05f4-4cf7-82aa-977acac0c4b8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 01:50:22.449290 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.449253    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-ui-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.449290 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.449283    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5twxl\" (UniqueName: \"kubernetes.io/projected/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-kube-api-access-5twxl\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.449290 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.449297    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-feast-data\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.449555 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.449306    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-offline-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.449555 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.449313    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-online-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.449555 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.449321    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/084ca8e4-05f4-4cf7-82aa-977acac0c4b8-registry-tls\") on node \"ip-10-0-143-139.ec2.internal\" DevicePath \"\""
May 26 01:50:22.638821 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.638717    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc" event={"ID":"2922812c-7311-48ce-825b-9200e5579038","Type":"ContainerDied","Data":"72cb9b3309b09422f78de97fd4bcc02da5e971fb62b03998dbd2e4064bd70179"}
May 26 01:50:22.638821 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.638724    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"
May 26 01:50:22.639324 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.638770    2579 scope.go:117] "RemoveContainer" containerID="cafcd90bc813390bbe50c779727eaceb47d0f4f7dc3c98097004c0fb0e4231ed"
May 26 01:50:22.641789 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.641762    2579 generic.go:358] "Generic (PLEG): container finished" podID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerID="6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67" exitCode=137
May 26 01:50:22.641789 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.641787    2579 generic.go:358] "Generic (PLEG): container finished" podID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerID="94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d" exitCode=137
May 26 01:50:22.641995 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.641789    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerDied","Data":"6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67"}
May 26 01:50:22.641995 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.641818    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerDied","Data":"94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d"}
May 26 01:50:22.641995 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.641834    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb" event={"ID":"084ca8e4-05f4-4cf7-82aa-977acac0c4b8","Type":"ContainerDied","Data":"0d05e6265ce6a7efed9820de2f8658f8b70cfeb7bb2213c42e440b0e4cec6766"}
May 26 01:50:22.641995 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.641856    2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"
May 26 01:50:22.648124 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.648105    2579 scope.go:117] "RemoveContainer" containerID="90f90280ae976b38126e85eb19c29af4e47813341accdae372015f8ed11931aa"
May 26 01:50:22.660718 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.660690    2579 scope.go:117] "RemoveContainer" containerID="26d6549ffa92b8e1ab7af1f8b282ab08a2128af7e4aadf1f633201ba03150305"
May 26 01:50:22.660962 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.660939    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"]
May 26 01:50:22.665022 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.664991    2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-l9wqc"]
May 26 01:50:22.669076 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.669055    2579 scope.go:117] "RemoveContainer" containerID="bec4139583c95cfd3ee5b6aedba9f0c23bb6325486ddc7eedacb44a8750a9fd0"
May 26 01:50:22.673336 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.673313    2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"]
May 26 01:50:22.677777 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.677752    2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-j8gpb"]
May 26 01:50:22.678197 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.678180    2579 scope.go:117] "RemoveContainer" containerID="59c509cbdcdbea50172ae8a98b5787bc080251a036024e10b55c3713c41ca331"
May 26 01:50:22.684955 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.684936    2579 scope.go:117] "RemoveContainer" containerID="5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36"
May 26 01:50:22.691816 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.691803    2579 scope.go:117] "RemoveContainer" containerID="6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67"
May 26 01:50:22.698232 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.698208    2579 scope.go:117] "RemoveContainer" containerID="68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6"
May 26 01:50:22.704899 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.704883    2579 scope.go:117] "RemoveContainer" containerID="94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d"
May 26 01:50:22.711927 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.711909    2579 scope.go:117] "RemoveContainer" containerID="93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0"
May 26 01:50:22.718801 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.718782    2579 scope.go:117] "RemoveContainer" containerID="736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8"
May 26 01:50:22.725463 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.725445    2579 scope.go:117] "RemoveContainer" containerID="5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36"
May 26 01:50:22.725711 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:50:22.725690    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36\": container with ID starting with 5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36 not found: ID does not exist" containerID="5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36"
May 26 01:50:22.725760 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.725722    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36"} err="failed to get container status \"5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36\": rpc error: code = NotFound desc = could not find container \"5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36\": container with ID starting with 5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36 not found: ID does not exist"
May 26 01:50:22.725760 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.725740    2579 scope.go:117] "RemoveContainer" containerID="6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67"
May 26 01:50:22.725966 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:50:22.725944    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67\": container with ID starting with 6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67 not found: ID does not exist" containerID="6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67"
May 26 01:50:22.726036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.725976    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67"} err="failed to get container status \"6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67\": rpc error: code = NotFound desc = could not find container \"6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67\": container with ID starting with 6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67 not found: ID does not exist"
May 26 01:50:22.726036 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.726000    2579 scope.go:117] "RemoveContainer" containerID="68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6"
May 26 01:50:22.726264 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:50:22.726248    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6\": container with ID starting with 68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6 not found: ID does not exist" containerID="68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6"
May 26 01:50:22.726304 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.726277    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6"} err="failed to get container status \"68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6\": rpc error: code = NotFound desc = could not find container \"68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6\": container with ID starting with 68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6 not found: ID does not exist"
May 26 01:50:22.726304 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.726292    2579 scope.go:117] "RemoveContainer" containerID="94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d"
May 26 01:50:22.726555 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:50:22.726536    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d\": container with ID starting with 94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d not found: ID does not exist" containerID="94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d"
May 26 01:50:22.726602 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.726562    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d"} err="failed to get container status \"94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d\": rpc error: code = NotFound desc = could not find container \"94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d\": container with ID starting with 94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d not found: ID does not exist"
May 26 01:50:22.726602 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.726579    2579 scope.go:117] "RemoveContainer" containerID="93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0"
May 26 01:50:22.726782 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:50:22.726767    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0\": container with ID starting with 93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0 not found: ID does not exist" containerID="93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0"
May 26 01:50:22.726817 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.726786    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0"} err="failed to get container status \"93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0\": rpc error: code = NotFound desc = could not find container \"93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0\": container with ID starting with 93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0 not found: ID does not exist"
May 26 01:50:22.726817 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.726798    2579 scope.go:117] "RemoveContainer" containerID="736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8"
May 26 01:50:22.726982 ip-10-0-143-139 kubenswrapper[2579]: E0526 01:50:22.726963    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8\": container with ID starting with 736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8 not found: ID does not exist" containerID="736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8"
May 26 01:50:22.727071 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.726982    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8"} err="failed to get container status \"736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8\": rpc error: code = NotFound desc = could not find container \"736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8\": container with ID starting with 736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8 not found: ID does not exist"
May 26 01:50:22.727071 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.726995    2579 scope.go:117] "RemoveContainer" containerID="5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36"
May 26 01:50:22.727211 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.727196    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36"} err="failed to get container status \"5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36\": rpc error: code = NotFound desc = could not find container \"5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36\": container with ID starting with 5354305c696b5f528c7be599172fc39ac17d28864a6011422209fbff92d2ca36 not found: ID does not exist"
May 26 01:50:22.727259 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.727211    2579 scope.go:117] "RemoveContainer" containerID="6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67"
May 26 01:50:22.727396 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.727374    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67"} err="failed to get container status \"6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67\": rpc error: code = NotFound desc = could not find container \"6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67\": container with ID starting with 6d40f0999881446b65bfb8355fecf0f3f2b398896c92378a9b937179543bdd67 not found: ID does not exist"
May 26 01:50:22.727489 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.727463    2579 scope.go:117] "RemoveContainer" containerID="68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6"
May 26 01:50:22.727689 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.727672    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6"} err="failed to get container status \"68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6\": rpc error: code = NotFound desc = could not find container \"68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6\": container with ID starting with 68cecc3f9e09cd9fc06c07ac6987e83fea17a0bc8a2aee293557003d0d5d3cf6 not found: ID does not exist"
May 26 01:50:22.727751 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.727690    2579 scope.go:117] "RemoveContainer" containerID="94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d"
May 26 01:50:22.727897 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.727881    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d"} err="failed to get container status \"94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d\": rpc error: code = NotFound desc = could not find container \"94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d\": container with ID starting with 94b223bbf8c66a791e4fd4057eb9c8cafbf8f0c016df81c9d000b93b483a302d not found: ID does not exist"
May 26 01:50:22.727950 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.727898    2579 scope.go:117] "RemoveContainer" containerID="93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0"
May 26 01:50:22.728081 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.728065    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0"} err="failed to get container status \"93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0\": rpc error: code = NotFound desc = could not find container \"93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0\": container with ID starting with 93289b431aeceaeadba96c13f3739eb054faeac86d531d573616aa4168f285a0 not found: ID does not exist"
May 26 01:50:22.728146 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.728084    2579 scope.go:117] "RemoveContainer" containerID="736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8"
May 26 01:50:22.728298 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:22.728280    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8"} err="failed to get container status \"736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8\": rpc error: code = NotFound desc = could not find container \"736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8\": container with ID starting with 736a3d4c870efd9dcd73223ea897f53665ad9203ef9a1448009ec49d905cd9b8 not found: ID does not exist"
May 26 01:50:24.323995 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:24.323962    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" path="/var/lib/kubelet/pods/084ca8e4-05f4-4cf7-82aa-977acac0c4b8/volumes"
May 26 01:50:24.324581 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:50:24.324567    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2922812c-7311-48ce-825b-9200e5579038" path="/var/lib/kubelet/pods/2922812c-7311-48ce-825b-9200e5579038/volumes"
May 26 01:51:00.836880 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:00.836846    2579 ???:1] "http: TLS handshake error from 10.0.140.41:37930: EOF"
May 26 01:51:00.841532 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:00.841504    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-64985_050a97ee-1a5c-4e38-9382-c7cc3d5c17c1/global-pull-secret-syncer/0.log"
May 26 01:51:00.978128 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:00.978087    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-56gzh_bc44f6dd-8313-4041-8194-258e506678e6/konnectivity-agent/0.log"
May 26 01:51:01.107823 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:01.107753    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-139.ec2.internal_9660ea6fd56285e0df024d588ae3caaf/haproxy/0.log"
May 26 01:51:03.864370 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:03.864337    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-qrcjb_2740f4f5-893f-4bf1-91c1-03c8cf871110/cluster-monitoring-operator/0.log"
May 26 01:51:03.898107 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:03.898071    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gxplz_005b638b-378b-4bb5-a36b-3a08d7e0d96a/kube-state-metrics/0.log"
May 26 01:51:03.924495 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:03.924460    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gxplz_005b638b-378b-4bb5-a36b-3a08d7e0d96a/kube-rbac-proxy-main/0.log"
May 26 01:51:03.955577 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:03.955549    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gxplz_005b638b-378b-4bb5-a36b-3a08d7e0d96a/kube-rbac-proxy-self/0.log"
May 26 01:51:03.992539 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:03.992508    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d684c644f-svhkm_5b2e59dc-a8d9-442f-bca7-77fad68834d8/metrics-server/0.log"
May 26 01:51:04.022185 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.022159    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-4pspn_9f3cfa09-bfc4-4906-bb31-d0ac50144a6b/monitoring-plugin/0.log"
May 26 01:51:04.156046 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.156026    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lftbq_93365189-4412-48d5-b996-f58f42b1bd69/node-exporter/0.log"
May 26 01:51:04.178920 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.178894    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lftbq_93365189-4412-48d5-b996-f58f42b1bd69/kube-rbac-proxy/0.log"
May 26 01:51:04.199164 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.199142    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lftbq_93365189-4412-48d5-b996-f58f42b1bd69/init-textfile/0.log"
May 26 01:51:04.324668 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.324643    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vgpkd_ba697fbf-0939-475c-a0e9-38db05d0f5b5/kube-rbac-proxy-main/0.log"
May 26 01:51:04.352178 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.352153    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vgpkd_ba697fbf-0939-475c-a0e9-38db05d0f5b5/kube-rbac-proxy-self/0.log"
May 26 01:51:04.373221 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.373195    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vgpkd_ba697fbf-0939-475c-a0e9-38db05d0f5b5/openshift-state-metrics/0.log"
May 26 01:51:04.408799 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.408729    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1183e876-117c-4eed-b5ca-cddebb2ce39a/prometheus/0.log"
May 26 01:51:04.430955 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.430925    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1183e876-117c-4eed-b5ca-cddebb2ce39a/config-reloader/0.log"
May 26 01:51:04.471558 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.471528    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1183e876-117c-4eed-b5ca-cddebb2ce39a/thanos-sidecar/0.log"
May 26 01:51:04.503707 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.503687    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1183e876-117c-4eed-b5ca-cddebb2ce39a/kube-rbac-proxy-web/0.log"
May 26 01:51:04.528381 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.528360    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1183e876-117c-4eed-b5ca-cddebb2ce39a/kube-rbac-proxy/0.log"
May 26 01:51:04.549581 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.549556    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1183e876-117c-4eed-b5ca-cddebb2ce39a/kube-rbac-proxy-thanos/0.log"
May 26 01:51:04.571929 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.571906    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1183e876-117c-4eed-b5ca-cddebb2ce39a/init-config-reloader/0.log"
May 26 01:51:04.646801 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:04.646773    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-6rf6z_5e28659b-f83a-49e0-84c5-ff69da9829a4/prometheus-operator-admission-webhook/0.log"
May 26 01:51:07.107015 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.106935    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-8rghc_d7c17da1-875b-4e74-8635-34c466ee4720/volume-data-source-validator/0.log"
May 26 01:51:07.446798 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.446724    2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"]
May 26 01:51:07.447021 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447009    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="feast-apply"
May 26 01:51:07.447065 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447023    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="feast-apply"
May 26 01:51:07.447065 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447033    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="offline"
May 26 01:51:07.447065 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447039    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="offline"
May 26 01:51:07.447065 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447049    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="online"
May 26 01:51:07.447065 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447054    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="online"
May 26 01:51:07.447065 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447063    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="feast-init"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447068    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="feast-init"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447074    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="offline"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447079    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="offline"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447087    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="feast-apply"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447092    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="feast-apply"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447097    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="ui"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447102    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="ui"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447110    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="registry"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447116    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="registry"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447125    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="ui"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447129    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="ui"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447135    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="feast-init"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447140    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="feast-init"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447148    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="online"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447153    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="online"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447199    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="ui"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447206    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="online"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447212    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="registry"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447219    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="offline"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447226    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="ui"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447231    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="084ca8e4-05f4-4cf7-82aa-977acac0c4b8" containerName="online"
May 26 01:51:07.447239 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.447237    2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="2922812c-7311-48ce-825b-9200e5579038" containerName="offline"
May 26 01:51:07.451621 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.451603    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.453542 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.453517    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rg56t\"/\"kube-root-ca.crt\""
May 26 01:51:07.454108 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.454091    2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rg56t\"/\"default-dockercfg-4xshw\""
May 26 01:51:07.454203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.454121    2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rg56t\"/\"openshift-service-ca.crt\""
May 26 01:51:07.456329 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.456299    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"]
May 26 01:51:07.543487 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.543440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-podres\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.543686 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.543546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-sys\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.543686 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.543596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-proc\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.543686 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.543625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-lib-modules\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.543686 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.543653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqcff\" (UniqueName: \"kubernetes.io/projected/a2b94b3a-6b76-4acf-9fe6-b449015d618d-kube-api-access-sqcff\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.644675 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.644637    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-proc\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.644675 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.644681    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-lib-modules\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.644841 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.644701    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqcff\" (UniqueName: \"kubernetes.io/projected/a2b94b3a-6b76-4acf-9fe6-b449015d618d-kube-api-access-sqcff\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.644841 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.644762    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-podres\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.644841 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.644829    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-lib-modules\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.644841 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.644839    2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-sys\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.644956 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.644839    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-podres\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.644956 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.644770    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-proc\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.644956 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.644882    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2b94b3a-6b76-4acf-9fe6-b449015d618d-sys\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.652060 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.652040    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqcff\" (UniqueName: \"kubernetes.io/projected/a2b94b3a-6b76-4acf-9fe6-b449015d618d-kube-api-access-sqcff\") pod \"perf-node-gather-daemonset-s6ngt\" (UID: \"a2b94b3a-6b76-4acf-9fe6-b449015d618d\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.762227 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.762192    2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:07.790480 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.790448    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xglqs_5dcd02f6-2068-461e-8883-96f827dd4691/dns/0.log"
May 26 01:51:07.807906 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.807881    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xglqs_5dcd02f6-2068-461e-8883-96f827dd4691/kube-rbac-proxy/0.log"
May 26 01:51:07.851068 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.851031    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kqzkc_b6f4bd4e-c26c-4dc3-ab89-7edc53b9a240/dns-node-resolver/0.log"
May 26 01:51:07.901474 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.901444    2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"]
May 26 01:51:07.903931 ip-10-0-143-139 kubenswrapper[2579]: W0526 01:51:07.903899    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda2b94b3a_6b76_4acf_9fe6_b449015d618d.slice/crio-ec75e9000bf360465f672aba8992e85122aaab86d67b6793dbbad121d7ccee14 WatchSource:0}: Error finding container ec75e9000bf360465f672aba8992e85122aaab86d67b6793dbbad121d7ccee14: Status 404 returned error can't find the container with id ec75e9000bf360465f672aba8992e85122aaab86d67b6793dbbad121d7ccee14
May 26 01:51:07.905378 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:07.905357    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 01:51:08.246238 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:08.246155    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78c5dc89d7-nfqfw_11583618-6c12-4489-8665-40ce2927c5d6/registry/0.log"
May 26 01:51:08.264469 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:08.264443    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4jtfg_f84f5a2b-39c6-4e9e-bf59-5a4b2510d3c6/node-ca/0.log"
May 26 01:51:08.785786 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:08.785746    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt" event={"ID":"a2b94b3a-6b76-4acf-9fe6-b449015d618d","Type":"ContainerStarted","Data":"1afb0e36bd367ccc39dd0cbb86ca9412dceb6635d8faf77b3c9cde1ab2766a21"}
May 26 01:51:08.785786 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:08.785785    2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt" event={"ID":"a2b94b3a-6b76-4acf-9fe6-b449015d618d","Type":"ContainerStarted","Data":"ec75e9000bf360465f672aba8992e85122aaab86d67b6793dbbad121d7ccee14"}
May 26 01:51:08.786002 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:08.785854    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:08.805113 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:08.805059    2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt" podStartSLOduration=1.8050385389999999 podStartE2EDuration="1.805038539s" podCreationTimestamp="2026-05-26 01:51:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:51:08.80331393 +0000 UTC m=+2409.130098226" watchObservedRunningTime="2026-05-26 01:51:08.805038539 +0000 UTC m=+2409.131822843"
May 26 01:51:08.967320 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:08.967296    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59d86d6648-kqmts_bd9911d2-77ab-41fb-9ca7-c8053c30ad49/router/0.log"
May 26 01:51:09.266252 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:09.266197    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pk67n_ec9edbf7-a34a-487c-98f0-3a17c2de9b84/serve-healthcheck-canary/0.log"
May 26 01:51:09.589900 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:09.589814    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-vp2rx_af1d9615-119c-431b-8f6b-de0a108db247/insights-operator/0.log"
May 26 01:51:09.590537 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:09.590519    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-vp2rx_af1d9615-119c-431b-8f6b-de0a108db247/insights-operator/1.log"
May 26 01:51:09.666061 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:09.666031    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jvsss_741455fb-67de-4982-9d8b-c542cba5f289/kube-rbac-proxy/0.log"
May 26 01:51:09.683458 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:09.683430    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jvsss_741455fb-67de-4982-9d8b-c542cba5f289/exporter/0.log"
May 26 01:51:09.701014 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:09.700983    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jvsss_741455fb-67de-4982-9d8b-c542cba5f289/extractor/0.log"
May 26 01:51:14.551102 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:14.551022    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-247n4_85906cfe-5556-403a-bfb1-aa1df8402461/kube-multus/0.log"
May 26 01:51:14.571724 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:14.571703    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmhwz_abcd5f49-10f9-40e9-a066-075120793513/kube-multus-additional-cni-plugins/0.log"
May 26 01:51:14.589099 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:14.589066    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmhwz_abcd5f49-10f9-40e9-a066-075120793513/egress-router-binary-copy/0.log"
May 26 01:51:14.606336 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:14.606306    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmhwz_abcd5f49-10f9-40e9-a066-075120793513/cni-plugins/0.log"
May 26 01:51:14.623765 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:14.623733    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmhwz_abcd5f49-10f9-40e9-a066-075120793513/bond-cni-plugin/0.log"
May 26 01:51:14.640495 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:14.640468    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmhwz_abcd5f49-10f9-40e9-a066-075120793513/routeoverride-cni/0.log"
May 26 01:51:14.658245 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:14.658212    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmhwz_abcd5f49-10f9-40e9-a066-075120793513/whereabouts-cni-bincopy/0.log"
May 26 01:51:14.675465 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:14.675441    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmhwz_abcd5f49-10f9-40e9-a066-075120793513/whereabouts-cni/0.log"
May 26 01:51:14.799564 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:14.799535    2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-s6ngt"
May 26 01:51:15.051526 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:15.051496    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bc4s7_dae0945b-ed4e-4987-92bd-65482bf722e4/network-metrics-daemon/0.log"
May 26 01:51:15.067808 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:15.067782    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bc4s7_dae0945b-ed4e-4987-92bd-65482bf722e4/kube-rbac-proxy/0.log"
May 26 01:51:15.803459 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:15.803427    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2584_533eaf3f-97d8-4c51-a094-1a7fe5ef9a01/ovn-controller/0.log"
May 26 01:51:15.834203 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:15.834174    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2584_533eaf3f-97d8-4c51-a094-1a7fe5ef9a01/ovn-acl-logging/0.log"
May 26 01:51:15.850377 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:15.850354    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2584_533eaf3f-97d8-4c51-a094-1a7fe5ef9a01/kube-rbac-proxy-node/0.log"
May 26 01:51:15.869047 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:15.869022    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2584_533eaf3f-97d8-4c51-a094-1a7fe5ef9a01/kube-rbac-proxy-ovn-metrics/0.log"
May 26 01:51:15.884017 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:15.883987    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2584_533eaf3f-97d8-4c51-a094-1a7fe5ef9a01/northd/0.log"
May 26 01:51:15.903223 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:15.903195    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2584_533eaf3f-97d8-4c51-a094-1a7fe5ef9a01/nbdb/0.log"
May 26 01:51:15.920346 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:15.920319    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2584_533eaf3f-97d8-4c51-a094-1a7fe5ef9a01/sbdb/0.log"
May 26 01:51:16.008649 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:16.008614    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2584_533eaf3f-97d8-4c51-a094-1a7fe5ef9a01/ovnkube-controller/0.log"
May 26 01:51:17.528638 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:17.528598    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2vxd8_8cd69c33-3cd7-49b9-a6ac-fbcb013c8303/network-check-target-container/0.log"
May 26 01:51:18.370462 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:18.370438    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ck5lm_807fa39d-d488-431c-8d1f-2778e4119009/iptables-alerter/0.log"
May 26 01:51:18.953108 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:18.953028    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4hx5l_776d35a0-6b5c-472c-8876-266451b05bb9/tuned/0.log"
May 26 01:51:21.981744 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:21.981714    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hbqk8_004e88b8-2de8-46da-8565-fa5d3004a202/csi-driver/0.log"
May 26 01:51:21.998843 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:21.998821    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hbqk8_004e88b8-2de8-46da-8565-fa5d3004a202/csi-node-driver-registrar/0.log"
May 26 01:51:22.015586 ip-10-0-143-139 kubenswrapper[2579]: I0526 01:51:22.015563    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hbqk8_004e88b8-2de8-46da-8565-fa5d3004a202/csi-liveness-probe/0.log"