May 26 15:15:11.064480 ip-10-0-142-253 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 15:15:11.064494 ip-10-0-142-253 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 15:15:11.064502 ip-10-0-142-253 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 15:15:11.064815 ip-10-0-142-253 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 15:15:22.273443 ip-10-0-142-253 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 15:15:22.273456 ip-10-0-142-253 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 172f3087ee6649caa76eb47252a7950f --
May 26 15:17:41.347005 ip-10-0-142-253 systemd[1]: Starting Kubernetes Kubelet...
May 26 15:17:41.851703 ip-10-0-142-253 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 15:17:41.851703 ip-10-0-142-253 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 15:17:41.851703 ip-10-0-142-253 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 15:17:41.851703 ip-10-0-142-253 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 15:17:41.851703 ip-10-0-142-253 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 15:17:41.853432 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.853361    2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 15:17:41.859198 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859178    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.859198 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859196    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.859198 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859201    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859204    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859208    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859211    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859214    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859217    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859220    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859222    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859225    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859228    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859230    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859233    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859235    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859238    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859241    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859243    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859246    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859248    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859251    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859253    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.859329 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859256    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859259    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859262    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859265    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859267    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859270    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859273    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859275    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859278    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859281    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859283    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859286    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859288    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859291    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859294    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859297    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859300    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859302    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859305    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859308    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.859814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859310    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859313    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859315    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859318    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859320    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859323    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859326    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859329    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859332    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859335    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859337    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859340    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859343    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859346    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859348    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859351    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859354    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859356    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859359    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859362    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.860285 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859364    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859367    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859370    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859373    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859376    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859378    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859381    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859384    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859386    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859389    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859391    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859394    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859396    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859399    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859401    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859404    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859408    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859412    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859416    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.860791 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859419    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859422    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859425    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859428    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859430    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859801    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859806    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859810    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859812    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859815    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859818    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859822    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859825    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859828    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859830    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859833    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859836    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859838    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859841    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.861259 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859844    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859848    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859852    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859855    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859858    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859860    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859863    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859865    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859868    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859871    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859874    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859877    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859879    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859882    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859885    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859887    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859890    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859892    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859895    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859897    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.861761 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859900    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859903    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859905    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859908    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859911    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859913    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859916    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859918    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859921    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859923    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859926    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859928    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859932    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859935    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859937    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859940    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859942    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859945    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859947    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.862330 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859950    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859952    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859955    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859957    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859962    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859965    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859968    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859971    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859973    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859976    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859978    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859981    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859984    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859986    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859990    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859993    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859995    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.859998    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860000    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860003    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.862821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860005    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860008    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860010    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860013    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860015    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860019    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860021    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860024    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860026    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860028    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860031    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860033    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860036    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860111    2557 flags.go:64] FLAG: --address="0.0.0.0"
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860118    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860124    2557 flags.go:64] FLAG: --anonymous-auth="true"
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860128    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860133    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860136    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860141    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860145    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 15:17:41.863317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860148    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860151    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860154    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860158    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860161    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860164    2557 flags.go:64] FLAG: --cgroup-root=""
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860167    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860170    2557 flags.go:64] FLAG: --client-ca-file=""
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860173    2557 flags.go:64] FLAG: --cloud-config=""
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860176    2557 flags.go:64] FLAG: --cloud-provider="external"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860179    2557 flags.go:64] FLAG: --cluster-dns="[]"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860183    2557 flags.go:64] FLAG: --cluster-domain=""
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860186    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860189    2557 flags.go:64] FLAG: --config-dir=""
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860192    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860195    2557 flags.go:64] FLAG: --container-log-max-files="5"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860199    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860202    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860205    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860208    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860211    2557 flags.go:64] FLAG: --contention-profiling="false"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860214    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860217    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860220    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860223    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 15:17:41.863835 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860228    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860231    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860233    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860236    2557 flags.go:64] FLAG: --enable-load-reader="false"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860240    2557 flags.go:64] FLAG: --enable-server="true"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860243    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860246    2557 flags.go:64] FLAG: --event-burst="100"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860249    2557 flags.go:64] FLAG: --event-qps="50"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860252    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860255    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860258    2557 flags.go:64] FLAG: --eviction-hard=""
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860266    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860269    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860272    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860275    2557 flags.go:64] FLAG: --eviction-soft=""
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860278    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860281    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860284    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860287    2557 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860291    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860294    2557 flags.go:64] FLAG: --fail-swap-on="true"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860297    2557 flags.go:64] FLAG: --feature-gates=""
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860301    2557 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860304    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860307    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 15:17:41.864430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860310    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860313    2557 flags.go:64] FLAG: --healthz-port="10248"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860316    2557 flags.go:64] FLAG: --help="false"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860319    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-142-253.ec2.internal"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860322    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860325    2557 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860328    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860331    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860334    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860337    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860340    2557 flags.go:64] FLAG: --image-service-endpoint=""
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860342    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860346    2557 flags.go:64] FLAG: --kube-api-burst="100"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860349    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860352    2557 flags.go:64] FLAG: --kube-api-qps="50"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860355    2557 flags.go:64] FLAG: --kube-reserved=""
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860358    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860360    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860364    2557 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860367    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860370    2557 flags.go:64] FLAG: --lock-file=""
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860373    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860376    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860379    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 15:17:41.865048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860384    2557 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860387    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860390    2557 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860392    2557 flags.go:64] FLAG: --logging-format="text"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860395    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860398    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860401    2557 flags.go:64] FLAG: --manifest-url=""
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860404    2557 flags.go:64] FLAG: --manifest-url-header=""
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860408    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860411    2557 flags.go:64] FLAG: --max-open-files="1000000"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860415    2557 flags.go:64] FLAG: --max-pods="110"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860418    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860421    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860424    2557 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860427    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860430    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860432    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860435    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860442    2557 flags.go:64] FLAG: --node-status-max-images="50"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860446    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860449    2557 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860452    2557 flags.go:64] FLAG: --pod-cidr=""
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860455    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 15:17:41.865628 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860460    2557 flags.go:64] FLAG: --pod-manifest-path=""
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860463    2557 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860466    2557 flags.go:64] FLAG: --pods-per-core="0"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860469    2557 flags.go:64] FLAG: --port="10250"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860472    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860475    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01111043df90b8cab"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860478    2557 flags.go:64] FLAG: --qos-reserved=""
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860481    2557 flags.go:64] FLAG: --read-only-port="10255"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860484    2557 flags.go:64] FLAG: --register-node="true"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860487    2557 flags.go:64] FLAG: --register-schedulable="true"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860490    2557 flags.go:64] FLAG: --register-with-taints=""
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860494    2557 flags.go:64] FLAG: --registry-burst="10"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860496    2557 flags.go:64] FLAG: --registry-qps="5"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860499    2557 flags.go:64] FLAG: --reserved-cpus=""
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860502    2557 flags.go:64] FLAG: --reserved-memory=""
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860506    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860509    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860511    2557 flags.go:64] FLAG: --rotate-certificates="false"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860514    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860517    2557 flags.go:64] FLAG: --runonce="false"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860520    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860523    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860526    2557 flags.go:64] FLAG: --seccomp-default="false"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860529    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860532    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860535    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 15:17:41.866188 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860538    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860541    2557 flags.go:64] FLAG: --storage-driver-password="root"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860546    2557 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860549    2557 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860552    2557 flags.go:64] FLAG: --storage-driver-user="root"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860555    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860559    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860562    2557 flags.go:64] FLAG: --system-cgroups=""
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860565    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860570    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860572    2557 flags.go:64] FLAG: --tls-cert-file=""
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860575    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860579    2557 flags.go:64] FLAG: --tls-min-version=""
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860582    2557 flags.go:64] FLAG: --tls-private-key-file=""
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860585    2557 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860588    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860590    2557 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860593    2557 flags.go:64] FLAG: --v="2"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860597    2557 flags.go:64] FLAG: --version="false"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860601    2557 flags.go:64] FLAG: --vmodule=""
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860605    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.860608    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860693    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860696    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.866894 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860699    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860702    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860705    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860708    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860710    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860713    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860716    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860719    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860722    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860724    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860728    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860731    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860733    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860736    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860752    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860754    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860757    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860759    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860762    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860765    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.867467 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860767    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860770    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860773    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860775    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860778    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860780    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860782    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860785    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860787    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860790    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860793    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860795    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860798    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860800    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860803    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860806    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860808    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860811    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860813    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860816    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.867979 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860818    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860821    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860826    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860828    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860831    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860833    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860836    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860839    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860842    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860844    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860847    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860850    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860852    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860855    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860857    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860860    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860862    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860865    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860867    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860870    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.868465 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860872    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860894    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860898    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860901    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860904    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860908    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860910    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860913    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860917    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860921    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860925    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860928    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860931    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860934    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860939    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860942    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860945    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860947    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860950    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.868983 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860953    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860956    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860958    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860961    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.860964    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.861775    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.867835    2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.867850    2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867896    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867900    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867903    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867906    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867909    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867912    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867915    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.869460 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867917    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867921    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867926    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867929    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867932    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867936    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867939    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867942    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867946    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867949    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867952    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867955    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867957    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867960    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867963    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867966    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867968    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867971    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867975    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.869852 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867977    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867980    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867983    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867985    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867988    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867992    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867995    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.867998    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868000    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868003    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868006    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868008    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868011    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868013    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868016    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868019    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868021    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868024    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868026    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868029    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.870347 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868031    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868034    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868036    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868039    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868041    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868043    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868046    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868048    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868051    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868054    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868056    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868059    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868063    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868066    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868068    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868070    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868073    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868077    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868080    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868082    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.870861 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868085    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868087    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868090    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868093    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868096    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868098    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868101    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868103    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868106    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868108    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868111    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868113    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868116    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868118    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868121    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868123    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868126    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868128    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868131    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.871339 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868133    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.868138    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868228    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868232    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868235    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868238    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868242    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868244    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868247    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868250    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868252    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868255    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868258    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868261    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868263    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:17:41.871816 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868266    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868268    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868271    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868273    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868275    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868278    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868280    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868283    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868286    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868288    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868291    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868293    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868296    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868298    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868301    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868303    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868306    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868308    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868310    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868313    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:17:41.872199 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868316    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868318    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868321    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868323    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868326    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868329    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868331    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868334    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868337    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868356    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868359    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868363    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868367    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868370    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868373    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868375    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868378    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868381    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868383    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:17:41.872680 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868386    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868390    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868393    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868396    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868399    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868402    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868405    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868408    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868410    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868412    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868415    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868417    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868420    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868422    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868425    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868427    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868429    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868432    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868435    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868438    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:17:41.873156 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868440    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868443    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868445    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868448    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868451    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868453    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868455    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868458    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868461    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868464    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868467    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868469    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868472    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:41.868475    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.868480    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 15:17:41.873643 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.869254    2557 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 15:17:41.874174 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.871448    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 15:17:41.874174 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.872549    2557 server.go:1019] "Starting client certificate rotation"
May 26 15:17:41.874174 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.872643    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 15:17:41.874174 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.872679    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 15:17:41.901467 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.901448    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 15:17:41.902498 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.902482    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 15:17:41.921321 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.921305    2557 log.go:25] "Validated CRI v1 runtime API"
May 26 15:17:41.927251 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.927235    2557 log.go:25] "Validated CRI v1 image API"
May 26 15:17:41.928581 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.928564    2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 15:17:41.930988 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.930970    2557 fs.go:135] Filesystem UUIDs: map[15b1f581-9dbe-4194-8b94-5c470b5c871c:/dev/nvme0n1p4 16029279-1039-49c6-a788-fd2be255d870:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 26 15:17:41.931056 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.930987    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 15:17:41.935076 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.934968    2557 manager.go:217] Machine: {Timestamp:2026-05-26 15:17:41.934478761 +0000 UTC m=+0.455022218 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090913 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26c06bbe5231d25d948547755ff5b4 SystemUUID:ec26c06b-be52-31d2-5d94-8547755ff5b4 BootID:172f3087-ee66-49ca-a76e-b47252a7950f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:07:ef:e3:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:07:ef:e3:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:1d:9c:7d:97:14 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 15:17:41.935978 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.935967    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 15:17:41.936052 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.936040    2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 15:17:41.939698 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.939671    2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 15:17:41.939847 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.939701    2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 15:17:41.939898 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.939856    2557 topology_manager.go:138] "Creating topology manager with none policy"
May 26 15:17:41.939898 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.939865    2557 container_manager_linux.go:306] "Creating device plugin manager"
May 26 15:17:41.939898 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.939872    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 15:17:41.940651 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.940628    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 15:17:41.940808 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.940797    2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 15:17:41.942790 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.942779    2557 state_mem.go:36] "Initialized new in-memory state store"
May 26 15:17:41.942925 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.942916    2557 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 15:17:41.945508 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.945496    2557 kubelet.go:491] "Attempting to sync node with API server"
May 26 15:17:41.945577 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.945511    2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 15:17:41.945577 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.945523    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 15:17:41.945577 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.945532    2557 kubelet.go:397] "Adding apiserver pod source"
May 26 15:17:41.945577 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.945540    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 15:17:41.946734 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.946721    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 15:17:41.946788 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.946756    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 15:17:41.950204 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.950188    2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 15:17:41.952566 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.952553    2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 15:17:41.956771 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956732    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 15:17:41.956850 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956779    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 15:17:41.956850 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956789    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 15:17:41.956850 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956797    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 15:17:41.956850 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956811    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 15:17:41.956850 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956819    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 15:17:41.956850 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956830    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 15:17:41.956850 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956839    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 15:17:41.957054 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956860    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 15:17:41.957054 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956869    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 15:17:41.957054 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956881    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 15:17:41.957054 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.956891    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 15:17:41.958135 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.958103    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 15:17:41.958204 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.958191    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 15:17:41.958965 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:41.958919    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 15:17:41.959061 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:41.958976    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 15:17:41.961561 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.961545    2557 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 15:17:41.961723 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.961711    2557 server.go:1295] "Started kubelet"
May 26 15:17:41.961837 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.961799    2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 15:17:41.961879 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.961865    2557 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 15:17:41.962452 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.961940    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 15:17:41.962580 ip-10-0-142-253 systemd[1]: Started Kubernetes Kubelet.
May 26 15:17:41.963421 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.963343    2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 15:17:41.965693 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.965671    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tzn9s"
May 26 15:17:41.966488 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.966471    2557 server.go:317] "Adding debug handlers to kubelet server"
May 26 15:17:41.971156 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.971140    2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 15:17:41.972370 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:41.971208    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-253.ec2.internal.18b3268c5861cc2d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-253.ec2.internal,UID:ip-10-0-142-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-253.ec2.internal,},FirstTimestamp:2026-05-26 15:17:41.961559085 +0000 UTC m=+0.482102550,LastTimestamp:2026-05-26 15:17:41.961559085 +0000 UTC m=+0.482102550,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-253.ec2.internal,}"
May 26 15:17:41.972800 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.972789    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 15:17:41.972864 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.972817    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 15:17:41.972864 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:41.972827    2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 15:17:41.972864 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.972858    2557 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 15:17:41.972864 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.972866    2557 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 15:17:41.973066 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.973012    2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 15:17:41.973116 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.973078    2557 reconstruct.go:97] "Volume reconstruction finished"
May 26 15:17:41.973116 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.973086    2557 reconciler.go:26] "Reconciler: start to sync state"
May 26 15:17:41.973911 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.973892    2557 factory.go:55] Registering systemd factory
May 26 15:17:41.973911 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.973910    2557 factory.go:223] Registration of the systemd container factory successfully
May 26 15:17:41.974088 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.974075    2557 factory.go:153] Registering CRI-O factory
May 26 15:17:41.974137 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.974090    2557 factory.go:223] Registration of the crio container factory successfully
May 26 15:17:41.974170 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.974142    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 15:17:41.974170 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.974160    2557 factory.go:103] Registering Raw factory
May 26 15:17:41.974245 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.974200    2557 manager.go:1196] Started watching for new ooms in manager
May 26 15:17:41.974245 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:41.974232    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:41.974605 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.974589    2557 manager.go:319] Starting recovery of all containers
May 26 15:17:41.977898 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.976676    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tzn9s"
May 26 15:17:41.978662 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:41.978640    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 15:17:41.979313 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:41.979288    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 15:17:41.985217 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.985110    2557 manager.go:324] Recovery completed
May 26 15:17:41.986558 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:41.986499    2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 26 15:17:41.990099 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.990080    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:41.992343 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.992327    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:41.992408 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.992358    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:41.992408 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.992369    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:41.992855 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.992839    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 15:17:41.992855 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.992856    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 15:17:41.992944 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.992872    2557 state_mem.go:36] "Initialized new in-memory state store"
May 26 15:17:41.996731 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.996720    2557 policy_none.go:49] "None policy: Start"
May 26 15:17:41.996812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.996749    2557 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 15:17:41.996812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:41.996760    2557 state_mem.go:35] "Initializing new in-memory state store"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.036679    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.037786    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.037801    2557 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.037815    2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.037821    2557 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.037858    2557 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.038452    2557 manager.go:341] "Starting Device Plugin manager"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.038483    2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.038495    2557 server.go:85] "Starting device plugin registration server"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.038706    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.038718    2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.038862    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.038929    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.038937    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.039363    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.039397    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.051920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.040593    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:42.138319 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.138264    2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal"]
May 26 15:17:42.138400 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.138337    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:42.138919 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.138904    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:42.139196 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.139170    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:42.139244 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.139211    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:42.139244 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.139228    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:42.139533 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.139517    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:42.139599 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.139549    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:42.139599 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.139566    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:42.139599 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.139586    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-253.ec2.internal"
May 26 15:17:42.140966 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.140954    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:42.141084 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.141073    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.141115 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.141096    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:42.141756 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.141724    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:42.141843 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.141767    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:42.141843 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.141778    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:42.141843 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.141731    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:42.141843 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.141827    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:42.141843 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.141836    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:42.143452 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.143438    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.143495 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.143463    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:17:42.144259 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.144244    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:17:42.144342 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.144275    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:17:42.144342 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.144291    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeHasSufficientPID"
May 26 15:17:42.148226 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.148210    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-253.ec2.internal"
May 26 15:17:42.148319 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.148233    2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-253.ec2.internal\": node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.167128 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.167107    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.168349 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.168333    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-253.ec2.internal\" not found" node="ip-10-0-142-253.ec2.internal"
May 26 15:17:42.172472 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.172457    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-253.ec2.internal\" not found" node="ip-10-0-142-253.ec2.internal"
May 26 15:17:42.174574 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.174558    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa61d0e097185e7128b713c33d70a7d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal\" (UID: \"fa61d0e097185e7128b713c33d70a7d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.174637 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.174581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa61d0e097185e7128b713c33d70a7d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal\" (UID: \"fa61d0e097185e7128b713c33d70a7d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.174637 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.174599    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5114a2ba826e8e29effd27b13629957-config\") pod \"kube-apiserver-proxy-ip-10-0-142-253.ec2.internal\" (UID: \"d5114a2ba826e8e29effd27b13629957\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.267811 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.267789    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.275615 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.275597    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa61d0e097185e7128b713c33d70a7d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal\" (UID: \"fa61d0e097185e7128b713c33d70a7d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.275684 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.275624    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa61d0e097185e7128b713c33d70a7d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal\" (UID: \"fa61d0e097185e7128b713c33d70a7d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.275684 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.275639    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5114a2ba826e8e29effd27b13629957-config\") pod \"kube-apiserver-proxy-ip-10-0-142-253.ec2.internal\" (UID: \"d5114a2ba826e8e29effd27b13629957\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.275684 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.275678    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5114a2ba826e8e29effd27b13629957-config\") pod \"kube-apiserver-proxy-ip-10-0-142-253.ec2.internal\" (UID: \"d5114a2ba826e8e29effd27b13629957\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.275823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.275716    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa61d0e097185e7128b713c33d70a7d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal\" (UID: \"fa61d0e097185e7128b713c33d70a7d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.275823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.275721    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa61d0e097185e7128b713c33d70a7d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal\" (UID: \"fa61d0e097185e7128b713c33d70a7d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.368754 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.368724    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.469475 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.469418    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.471575 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.471561    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.475255 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.475240    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal"
May 26 15:17:42.570470 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.570438    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.670939 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.670909    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.771412 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.771370    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.871984 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.871960    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.873072 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.873060    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 15:17:42.873215 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.873192    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 15:17:42.972041 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:42.972010    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:42.973256 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.973243    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 15:17:42.978901 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.978871    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 15:12:41 +0000 UTC" deadline="2028-02-22 00:46:38.467874704 +0000 UTC"
May 26 15:17:42.978957 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:42.978901    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15273h28m55.488976913s"
May 26 15:17:43.008064 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.008047    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 15:17:43.048834 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:43.048804    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa61d0e097185e7128b713c33d70a7d5.slice/crio-db5669275f05b9e29dd80629e72379a656e0b2f715fbd02b5c78d271a0b437cb WatchSource:0}: Error finding container db5669275f05b9e29dd80629e72379a656e0b2f715fbd02b5c78d271a0b437cb: Status 404 returned error can't find the container with id db5669275f05b9e29dd80629e72379a656e0b2f715fbd02b5c78d271a0b437cb
May 26 15:17:43.049391 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:43.049371    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5114a2ba826e8e29effd27b13629957.slice/crio-a01d518809fc1b56d4c3e18c9473fe3dade837e1e118949d4344636a1fd644d3 WatchSource:0}: Error finding container a01d518809fc1b56d4c3e18c9473fe3dade837e1e118949d4344636a1fd644d3: Status 404 returned error can't find the container with id a01d518809fc1b56d4c3e18c9473fe3dade837e1e118949d4344636a1fd644d3
May 26 15:17:43.053325 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.053310    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:17:43.060598 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.060580    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:43.068608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.068592    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sl7cb"
May 26 15:17:43.072289 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:43.072273    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:43.088142 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.088122    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sl7cb"
May 26 15:17:43.094115 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.094092    2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:43.172378 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:43.172352    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:43.272729 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:43.272707    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:43.373284 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:43.373196    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:43.473951 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:43.473919    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-253.ec2.internal\" not found"
May 26 15:17:43.514621 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.514594    2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:43.573815 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.573783    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal"
May 26 15:17:43.584404 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.584380    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 15:17:43.585872 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.585668    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal"
May 26 15:17:43.596288 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.596268    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 15:17:43.829602 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.829514    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:17:43.946840 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.946812    2557 apiserver.go:52] "Watching apiserver"
May 26 15:17:43.955538 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.955514    2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 15:17:43.955884 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.955859    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-hp7rv","kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal","openshift-image-registry/node-ca-dz5k2","openshift-multus/multus-additional-cni-plugins-5vsgv","openshift-multus/multus-sgdld","openshift-multus/network-metrics-daemon-vf787","openshift-network-operator/iptables-alerter-n24gc","openshift-ovn-kubernetes/ovnkube-node-fmxcw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk","openshift-cluster-node-tuning-operator/tuned-svzd6","openshift-dns/node-resolver-lxdbs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal","openshift-network-diagnostics/network-check-target-cdppb"]
May 26 15:17:43.960340 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.960321    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:43.960542 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.960519    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:43.962614 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.962594    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:43.963016 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.962941    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 15:17:43.963016 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.962967    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 15:17:43.963176 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.963028    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 15:17:43.963231 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.963192    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j2vbf\""
May 26 15:17:43.963282 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.963247    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 15:17:43.963335 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.963299    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 15:17:43.963335 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.963308    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-92tlg\""
May 26 15:17:43.963426 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.963360    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 15:17:43.964767 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.964749    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sgdld"
May 26 15:17:43.965606 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.965589    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 15:17:43.965713 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.965679    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 15:17:43.965823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.965809    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 15:17:43.965976 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.965922    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-86wn7\""
May 26 15:17:43.966087 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.965986    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 15:17:43.966087 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.965993    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 15:17:43.966956 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.966936    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:43.967046 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:43.967028    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:17:43.967218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.967201    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 15:17:43.967380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.967367    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ktl85\""
May 26 15:17:43.969402 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.969380    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:17:43.971642 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.971623    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.972071 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.971855    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 15:17:43.972071 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.971934    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-krkmf\""
May 26 15:17:43.972207 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.972192    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 15:17:43.973869 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.973837    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:43.974322 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.974302    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 15:17:43.974456 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.974434    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 15:17:43.974630 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.974609    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 15:17:43.975132 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.975114    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 15:17:43.975432 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.975413    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 15:17:43.975517 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.975463    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 15:17:43.976048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.976027    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fhcnw\""
May 26 15:17:43.977051 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.976339    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.977051 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.976518    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 15:17:43.977051 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.976890    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 15:17:43.977614 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.977579    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nc9zz\""
May 26 15:17:43.978977 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.978920    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 15:17:43.980105 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.980083    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:43.980203 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.980114    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9d9mq\""
May 26 15:17:43.980203 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.980135    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 15:17:43.980576 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.980558    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 15:17:43.982133 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982115    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99c60328-df56-42c0-9f63-0f302076398e-ovn-node-metrics-cert\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.982226 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982150    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-system-cni-dir\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:43.982226 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982176    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-run-multus-certs\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.982226 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-sys-fs\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:43.982380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4b8t\" (UniqueName: \"kubernetes.io/projected/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-kube-api-access-f4b8t\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:43.982380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-run\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.982380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982275    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-host\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.982380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982300    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmxd\" (UniqueName: \"kubernetes.io/projected/3bc43d23-582e-4a39-a80f-4760a45af3f7-kube-api-access-6fmxd\") pod \"node-ca-dz5k2\" (UID: \"3bc43d23-582e-4a39-a80f-4760a45af3f7\") " pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:43.982380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982325    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-device-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:43.982380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982349    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-sysctl-d\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982400    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dm7gv\""
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982428    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-os-release\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982442    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982454    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-registration-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-sys\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:43.982495    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982503    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-systemd-units\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982524    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d40ef27c-c495-489f-9c91-18af598d484c-tmp\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e69ab1d5-19da-495e-a87b-261216525ef7-agent-certs\") pod \"konnectivity-agent-hp7rv\" (UID: \"e69ab1d5-19da-495e-a87b-261216525ef7\") " pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-cni-netd\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982602    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-socket-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:43.982635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982623    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-sysctl-conf\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhn46\" (UniqueName: \"kubernetes.io/projected/9288c0c9-d24c-4932-be3a-584f39a6df8f-kube-api-access-bhn46\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982669    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w67t2\" (UniqueName: \"kubernetes.io/projected/f4a11aa6-ff7c-4d15-9423-1965544d2d25-kube-api-access-w67t2\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982705    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9288c0c9-d24c-4932-be3a-584f39a6df8f-cni-binary-copy\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982767    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-hostroot\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982809    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-var-lib-kubelet\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982853    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-var-lib-kubelet\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982878    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-etc-kubernetes\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-run-systemd\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-etc-openvswitch\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99c60328-df56-42c0-9f63-0f302076398e-ovnkube-script-lib\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.982992    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983005    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-cnibin\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983034    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-run-k8s-cni-cncf-io\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983069    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-kubelet\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983108    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-run-ovn-kubernetes\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.983229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99c60328-df56-42c0-9f63-0f302076398e-env-overrides\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983170    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-lib-modules\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983180    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983203    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d40ef27c-c495-489f-9c91-18af598d484c-etc-tuned\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-var-lib-cni-multus\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983260    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-conf-dir\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983284    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-run-openvswitch\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-run-ovn\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983392    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99c60328-df56-42c0-9f63-0f302076398e-ovnkube-config\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-kubernetes\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4a11aa6-ff7c-4d15-9423-1965544d2d25-cni-binary-copy\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983486    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4a11aa6-ff7c-4d15-9423-1965544d2d25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983539    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-socket-dir-parent\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983583    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ef54bc6-23d1-4ada-8bbf-680876a1245a-host-slash\") pod \"iptables-alerter-n24gc\" (UID: \"8ef54bc6-23d1-4ada-8bbf-680876a1245a\") " pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983603    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-sysconfig\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.983980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983630    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4a11aa6-ff7c-4d15-9423-1965544d2d25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-cnibin\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983685    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ef54bc6-23d1-4ada-8bbf-680876a1245a-iptables-alerter-script\") pod \"iptables-alerter-n24gc\" (UID: \"8ef54bc6-23d1-4ada-8bbf-680876a1245a\") " pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983713    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e69ab1d5-19da-495e-a87b-261216525ef7-konnectivity-ca\") pod \"konnectivity-agent-hp7rv\" (UID: \"e69ab1d5-19da-495e-a87b-261216525ef7\") " pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-var-lib-openvswitch\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983778    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmlmm\" (UniqueName: \"kubernetes.io/projected/99c60328-df56-42c0-9f63-0f302076398e-kube-api-access-kmlmm\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-modprobe-d\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-systemd\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983862    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-node-log\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983874    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-log-socket\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983898    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-cni-bin\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-os-release\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.983977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-run-netns\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fjqn\" (UniqueName: \"kubernetes.io/projected/d40ef27c-c495-489f-9c91-18af598d484c-kube-api-access-2fjqn\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-system-cni-dir\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984078    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-var-lib-cni-bin\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.984494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984097    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-daemon-config\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.985201 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984111    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggsfx\" (UniqueName: \"kubernetes.io/projected/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-kube-api-access-ggsfx\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:43.985201 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984126    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bc43d23-582e-4a39-a80f-4760a45af3f7-host\") pod \"node-ca-dz5k2\" (UID: \"3bc43d23-582e-4a39-a80f-4760a45af3f7\") " pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:43.985201 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984146    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.985201 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984161    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-cni-dir\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:43.985201 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984174    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55n5s\" (UniqueName: \"kubernetes.io/projected/8ef54bc6-23d1-4ada-8bbf-680876a1245a-kube-api-access-55n5s\") pod \"iptables-alerter-n24gc\" (UID: \"8ef54bc6-23d1-4ada-8bbf-680876a1245a\") " pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:43.985201 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984189    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3bc43d23-582e-4a39-a80f-4760a45af3f7-serviceca\") pod \"node-ca-dz5k2\" (UID: \"3bc43d23-582e-4a39-a80f-4760a45af3f7\") " pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:43.985201 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984232    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-slash\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:43.985201 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:43.984252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-run-netns\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.041957 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.041924    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal" event={"ID":"d5114a2ba826e8e29effd27b13629957","Type":"ContainerStarted","Data":"a01d518809fc1b56d4c3e18c9473fe3dade837e1e118949d4344636a1fd644d3"}
May 26 15:17:44.043026 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.043000    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal" event={"ID":"fa61d0e097185e7128b713c33d70a7d5","Type":"ContainerStarted","Data":"db5669275f05b9e29dd80629e72379a656e0b2f715fbd02b5c78d271a0b437cb"}
May 26 15:17:44.073970 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.073946    2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 15:17:44.084546 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084489    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-os-release\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.084546 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084519    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-registration-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.084706 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084561    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-sys\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.084706 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084586    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-registration-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.084706 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084599    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-systemd-units\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.084706 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084625    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d40ef27c-c495-489f-9c91-18af598d484c-tmp\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.084706 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084661    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-sys\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.084706 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084657    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca96af9f-d16f-4d3b-869c-2853e67592b0-hosts-file\") pod \"node-resolver-lxdbs\" (UID: \"ca96af9f-d16f-4d3b-869c-2853e67592b0\") " pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.084963 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084708    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e69ab1d5-19da-495e-a87b-261216525ef7-agent-certs\") pod \"konnectivity-agent-hp7rv\" (UID: \"e69ab1d5-19da-495e-a87b-261216525ef7\") " pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:17:44.084963 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084711    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-systemd-units\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.084963 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084721    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-os-release\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.084963 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084756    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-cni-netd\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.084963 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084783    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-socket-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.084963 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084897    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-sysctl-conf\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.084963 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084945    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-cni-netd\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.084963 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptnc9\" (UniqueName: \"kubernetes.io/projected/ca96af9f-d16f-4d3b-869c-2853e67592b0-kube-api-access-ptnc9\") pod \"node-resolver-lxdbs\" (UID: \"ca96af9f-d16f-4d3b-869c-2853e67592b0\") " pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.085218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.084987    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bhn46\" (UniqueName: \"kubernetes.io/projected/9288c0c9-d24c-4932-be3a-584f39a6df8f-kube-api-access-bhn46\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.085218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085014    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w67t2\" (UniqueName: \"kubernetes.io/projected/f4a11aa6-ff7c-4d15-9423-1965544d2d25-kube-api-access-w67t2\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.085218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085064    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9288c0c9-d24c-4932-be3a-584f39a6df8f-cni-binary-copy\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.085218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085063    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-sysctl-conf\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.085218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085067    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-socket-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.085218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085172    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 15:17:44.085447 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085336    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-hostroot\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.085447 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085384    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-var-lib-kubelet\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.085447 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085433    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-var-lib-kubelet\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.085586 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085461    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-etc-kubernetes\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.085586 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085476    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-hostroot\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.085586 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085481    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-var-lib-kubelet\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.085586 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085483    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-run-systemd\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.085586 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085515    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-var-lib-kubelet\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.085586 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085520    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-etc-kubernetes\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.085586 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085540    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-etc-openvswitch\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.085938 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.085919    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-run-systemd\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.086029 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086014    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99c60328-df56-42c0-9f63-0f302076398e-ovnkube-script-lib\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.086092 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086046    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9288c0c9-d24c-4932-be3a-584f39a6df8f-cni-binary-copy\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.086092 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086060    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.086187 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086116    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-cnibin\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.086187 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086136    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-etc-openvswitch\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.086187 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086149    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-run-k8s-cni-cncf-io\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.086304 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086196    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-kubelet\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.086304 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086234    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-cnibin\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.086381 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086302    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-run-ovn-kubernetes\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.086381 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086229    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-run-ovn-kubernetes\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.086381 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086314    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-run-k8s-cni-cncf-io\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.086381 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086352    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99c60328-df56-42c0-9f63-0f302076398e-env-overrides\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.086381 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086372    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-kubelet\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.086610 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086441    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.086610 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086463    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-lib-modules\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.086610 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086503    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d40ef27c-c495-489f-9c91-18af598d484c-etc-tuned\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.086610 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086597    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-var-lib-cni-multus\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.086826 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086679    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-conf-dir\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.086826 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086735    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-lib-modules\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.086920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086846    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:44.086920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086862    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99c60328-df56-42c0-9f63-0f302076398e-env-overrides\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.086920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086898    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-var-lib-cni-multus\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.087104 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086933    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-run-openvswitch\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.087104 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086980    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-run-ovn\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.087104 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.086984    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-run-openvswitch\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.087104 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087019    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-conf-dir\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.087104 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087038    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-run-ovn\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.087104 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087086    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99c60328-df56-42c0-9f63-0f302076398e-ovnkube-config\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.087104 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087091    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99c60328-df56-42c0-9f63-0f302076398e-ovnkube-script-lib\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.087383 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.087117    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:44.087383 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087154    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-kubernetes\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.087383 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.087200    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs podName:fe9ab1f8-642f-42d3-a2ec-ae4613691a2b nodeName:}" failed. No retries permitted until 2026-05-26 15:17:44.587164189 +0000 UTC m=+3.107707647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs") pod "network-metrics-daemon-vf787" (UID: "fe9ab1f8-642f-42d3-a2ec-ae4613691a2b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:44.087651 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087627    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99c60328-df56-42c0-9f63-0f302076398e-ovnkube-config\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.087713 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087640    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-kubernetes\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.087713 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087680    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4a11aa6-ff7c-4d15-9423-1965544d2d25-cni-binary-copy\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.087839 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087717    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.087839 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.087769    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4a11aa6-ff7c-4d15-9423-1965544d2d25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.088521 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088497    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.088606 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088548    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4a11aa6-ff7c-4d15-9423-1965544d2d25-cni-binary-copy\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.088606 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088555    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-socket-dir-parent\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.088709 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088608    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ef54bc6-23d1-4ada-8bbf-680876a1245a-host-slash\") pod \"iptables-alerter-n24gc\" (UID: \"8ef54bc6-23d1-4ada-8bbf-680876a1245a\") " pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:44.088709 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088647    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-sysconfig\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.088832 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088711    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca96af9f-d16f-4d3b-869c-2853e67592b0-tmp-dir\") pod \"node-resolver-lxdbs\" (UID: \"ca96af9f-d16f-4d3b-869c-2853e67592b0\") " pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.088832 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088763    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4a11aa6-ff7c-4d15-9423-1965544d2d25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.088832 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088817    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-cnibin\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.088978 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088852    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ef54bc6-23d1-4ada-8bbf-680876a1245a-iptables-alerter-script\") pod \"iptables-alerter-n24gc\" (UID: \"8ef54bc6-23d1-4ada-8bbf-680876a1245a\") " pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:44.088978 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088920    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e69ab1d5-19da-495e-a87b-261216525ef7-konnectivity-ca\") pod \"konnectivity-agent-hp7rv\" (UID: \"e69ab1d5-19da-495e-a87b-261216525ef7\") " pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:17:44.089076 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.088951    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-var-lib-openvswitch\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.089076 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089009    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmlmm\" (UniqueName: \"kubernetes.io/projected/99c60328-df56-42c0-9f63-0f302076398e-kube-api-access-kmlmm\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.089193 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089165    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-modprobe-d\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.089266 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089252    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-systemd\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.089320 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089288    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-node-log\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.089375 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089314    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-log-socket\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.089429 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089378    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-cni-bin\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.089429 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089395    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:12:43 +0000 UTC" deadline="2028-01-02 23:01:56.078605381 +0000 UTC"
May 26 15:17:44.089429 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089422    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14071h44m11.98918768s"
May 26 15:17:44.089429 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089424    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-os-release\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.089613 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089458    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-run-netns\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.089613 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089513    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fjqn\" (UniqueName: \"kubernetes.io/projected/d40ef27c-c495-489f-9c91-18af598d484c-kube-api-access-2fjqn\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.089613 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089568    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-var-lib-openvswitch\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.089783 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089628    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-system-cni-dir\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.089783 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089652    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-socket-dir-parent\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.089783 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089663    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-var-lib-cni-bin\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.089783 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089678    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d40ef27c-c495-489f-9c91-18af598d484c-tmp\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.089783 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089697    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ef54bc6-23d1-4ada-8bbf-680876a1245a-host-slash\") pod \"iptables-alerter-n24gc\" (UID: \"8ef54bc6-23d1-4ada-8bbf-680876a1245a\") " pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:44.089783 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089698    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-daemon-config\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.089783 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089759    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggsfx\" (UniqueName: \"kubernetes.io/projected/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-kube-api-access-ggsfx\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089798    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bc43d23-582e-4a39-a80f-4760a45af3f7-host\") pod \"node-ca-dz5k2\" (UID: \"3bc43d23-582e-4a39-a80f-4760a45af3f7\") " pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089830    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089858    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-cni-dir\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089873    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4a11aa6-ff7c-4d15-9423-1965544d2d25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089890    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55n5s\" (UniqueName: \"kubernetes.io/projected/8ef54bc6-23d1-4ada-8bbf-680876a1245a-kube-api-access-55n5s\") pod \"iptables-alerter-n24gc\" (UID: \"8ef54bc6-23d1-4ada-8bbf-680876a1245a\") " pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089941    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3bc43d23-582e-4a39-a80f-4760a45af3f7-serviceca\") pod \"node-ca-dz5k2\" (UID: \"3bc43d23-582e-4a39-a80f-4760a45af3f7\") " pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089969    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bc43d23-582e-4a39-a80f-4760a45af3f7-host\") pod \"node-ca-dz5k2\" (UID: \"3bc43d23-582e-4a39-a80f-4760a45af3f7\") " pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.089972    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-slash\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090048    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-cni-dir\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090058    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-run-netns\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.090122 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090113    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-run-netns\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090229    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4a11aa6-ff7c-4d15-9423-1965544d2d25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090301    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-sysconfig\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090351    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99c60328-df56-42c0-9f63-0f302076398e-ovn-node-metrics-cert\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090354    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e69ab1d5-19da-495e-a87b-261216525ef7-konnectivity-ca\") pod \"konnectivity-agent-hp7rv\" (UID: \"e69ab1d5-19da-495e-a87b-261216525ef7\") " pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090387    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-system-cni-dir\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090420    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-run-multus-certs\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090432    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-cnibin\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090453    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-sys-fs\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090463    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3bc43d23-582e-4a39-a80f-4760a45af3f7-serviceca\") pod \"node-ca-dz5k2\" (UID: \"3bc43d23-582e-4a39-a80f-4760a45af3f7\") " pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090488    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4b8t\" (UniqueName: \"kubernetes.io/projected/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-kube-api-access-f4b8t\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090513    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-run\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090542    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-host\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090543    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-slash\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090577    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-run-multus-certs\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.090608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090583    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090618    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-sys-fs\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090637    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-run\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090671    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-host\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090723    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-host-cni-bin\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090916    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmxd\" (UniqueName: \"kubernetes.io/projected/3bc43d23-582e-4a39-a80f-4760a45af3f7-kube-api-access-6fmxd\") pod \"node-ca-dz5k2\" (UID: \"3bc43d23-582e-4a39-a80f-4760a45af3f7\") " pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090942    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-device-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.090998    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091012    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-system-cni-dir\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091017    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ef54bc6-23d1-4ada-8bbf-680876a1245a-iptables-alerter-script\") pod \"iptables-alerter-n24gc\" (UID: \"8ef54bc6-23d1-4ada-8bbf-680876a1245a\") " pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091037    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-sysctl-d\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091098    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-modprobe-d\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091104    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4a11aa6-ff7c-4d15-9423-1965544d2d25-os-release\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091128    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-node-log\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091128    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-device-dir\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091164    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-run-netns\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.091306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091180    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-systemd\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.092102 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091183    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.092102 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091285    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-system-cni-dir\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.092102 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091271    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d40ef27c-c495-489f-9c91-18af598d484c-etc-sysctl-d\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.092102 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091335    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99c60328-df56-42c0-9f63-0f302076398e-log-socket\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.092102 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.091351    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9288c0c9-d24c-4932-be3a-584f39a6df8f-host-var-lib-cni-bin\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.092966 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.092935    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9288c0c9-d24c-4932-be3a-584f39a6df8f-multus-daemon-config\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.093094 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.093011    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d40ef27c-c495-489f-9c91-18af598d484c-etc-tuned\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.093796 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.093775    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e69ab1d5-19da-495e-a87b-261216525ef7-agent-certs\") pod \"konnectivity-agent-hp7rv\" (UID: \"e69ab1d5-19da-495e-a87b-261216525ef7\") " pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:17:44.094511 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.094486    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99c60328-df56-42c0-9f63-0f302076398e-ovn-node-metrics-cert\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.095832 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.095813    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w67t2\" (UniqueName: \"kubernetes.io/projected/f4a11aa6-ff7c-4d15-9423-1965544d2d25-kube-api-access-w67t2\") pod \"multus-additional-cni-plugins-5vsgv\" (UID: \"f4a11aa6-ff7c-4d15-9423-1965544d2d25\") " pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.095970 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.095951    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhn46\" (UniqueName: \"kubernetes.io/projected/9288c0c9-d24c-4932-be3a-584f39a6df8f-kube-api-access-bhn46\") pod \"multus-sgdld\" (UID: \"9288c0c9-d24c-4932-be3a-584f39a6df8f\") " pod="openshift-multus/multus-sgdld"
May 26 15:17:44.105013 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.104990    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4b8t\" (UniqueName: \"kubernetes.io/projected/b12fd7f2-87d9-464a-b5b6-677dbb60fde4-kube-api-access-f4b8t\") pod \"aws-ebs-csi-driver-node-jkbxk\" (UID: \"b12fd7f2-87d9-464a-b5b6-677dbb60fde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.107051 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.107027    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55n5s\" (UniqueName: \"kubernetes.io/projected/8ef54bc6-23d1-4ada-8bbf-680876a1245a-kube-api-access-55n5s\") pod \"iptables-alerter-n24gc\" (UID: \"8ef54bc6-23d1-4ada-8bbf-680876a1245a\") " pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:44.107513 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.107479    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmxd\" (UniqueName: \"kubernetes.io/projected/3bc43d23-582e-4a39-a80f-4760a45af3f7-kube-api-access-6fmxd\") pod \"node-ca-dz5k2\" (UID: \"3bc43d23-582e-4a39-a80f-4760a45af3f7\") " pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:44.107671 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.107643    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fjqn\" (UniqueName: \"kubernetes.io/projected/d40ef27c-c495-489f-9c91-18af598d484c-kube-api-access-2fjqn\") pod \"tuned-svzd6\" (UID: \"d40ef27c-c495-489f-9c91-18af598d484c\") " pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.109491 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.109461    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggsfx\" (UniqueName: \"kubernetes.io/projected/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-kube-api-access-ggsfx\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:44.110034 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.110001    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmlmm\" (UniqueName: \"kubernetes.io/projected/99c60328-df56-42c0-9f63-0f302076398e-kube-api-access-kmlmm\") pod \"ovnkube-node-fmxcw\" (UID: \"99c60328-df56-42c0-9f63-0f302076398e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.191596 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.191571    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptnc9\" (UniqueName: \"kubernetes.io/projected/ca96af9f-d16f-4d3b-869c-2853e67592b0-kube-api-access-ptnc9\") pod \"node-resolver-lxdbs\" (UID: \"ca96af9f-d16f-4d3b-869c-2853e67592b0\") " pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.191760 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.191622    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca96af9f-d16f-4d3b-869c-2853e67592b0-tmp-dir\") pod \"node-resolver-lxdbs\" (UID: \"ca96af9f-d16f-4d3b-869c-2853e67592b0\") " pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.191760 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.191652    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:44.191760 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.191670    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca96af9f-d16f-4d3b-869c-2853e67592b0-hosts-file\") pod \"node-resolver-lxdbs\" (UID: \"ca96af9f-d16f-4d3b-869c-2853e67592b0\") " pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.191923 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.191805    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ca96af9f-d16f-4d3b-869c-2853e67592b0-hosts-file\") pod \"node-resolver-lxdbs\" (UID: \"ca96af9f-d16f-4d3b-869c-2853e67592b0\") " pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.192018 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.191997    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca96af9f-d16f-4d3b-869c-2853e67592b0-tmp-dir\") pod \"node-resolver-lxdbs\" (UID: \"ca96af9f-d16f-4d3b-869c-2853e67592b0\") " pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.199500 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.199481    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:44.199500 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.199502    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:44.199652 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.199516    2557 projected.go:194] Error preparing data for projected volume kube-api-access-c2tgl for pod openshift-network-diagnostics/network-check-target-cdppb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:44.199652 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.199612    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl podName:95d379c6-e653-4033-af3e-f485d7fac20a nodeName:}" failed. No retries permitted until 2026-05-26 15:17:44.699596694 +0000 UTC m=+3.220140138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c2tgl" (UniqueName: "kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl") pod "network-check-target-cdppb" (UID: "95d379c6-e653-4033-af3e-f485d7fac20a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:44.201674 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.201648    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptnc9\" (UniqueName: \"kubernetes.io/projected/ca96af9f-d16f-4d3b-869c-2853e67592b0-kube-api-access-ptnc9\") pod \"node-resolver-lxdbs\" (UID: \"ca96af9f-d16f-4d3b-869c-2853e67592b0\") " pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.271810 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.271773    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n24gc"
May 26 15:17:44.281582 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.281554    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dz5k2"
May 26 15:17:44.291001 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.290985    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5vsgv"
May 26 15:17:44.295632 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.295609    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sgdld"
May 26 15:17:44.302155 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.302138    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:17:44.308696 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.308676    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:17:44.315283 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.315263    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk"
May 26 15:17:44.321809 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.321788    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-svzd6"
May 26 15:17:44.326308 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.326292    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lxdbs"
May 26 15:17:44.582954 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:44.582924    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69ab1d5_19da_495e_a87b_261216525ef7.slice/crio-4753308f405d18bf3c7bd4420810634fa8684f4006caf672114ce32bc1203f86 WatchSource:0}: Error finding container 4753308f405d18bf3c7bd4420810634fa8684f4006caf672114ce32bc1203f86: Status 404 returned error can't find the container with id 4753308f405d18bf3c7bd4420810634fa8684f4006caf672114ce32bc1203f86
May 26 15:17:44.585103 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:44.585059    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd40ef27c_c495_489f_9c91_18af598d484c.slice/crio-f5148f79638c5020106a43cbec94ecfd1eb3d3cea2a5cb2392a815ef4050d6d5 WatchSource:0}: Error finding container f5148f79638c5020106a43cbec94ecfd1eb3d3cea2a5cb2392a815ef4050d6d5: Status 404 returned error can't find the container with id f5148f79638c5020106a43cbec94ecfd1eb3d3cea2a5cb2392a815ef4050d6d5
May 26 15:17:44.585998 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:44.585941    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc43d23_582e_4a39_a80f_4760a45af3f7.slice/crio-a19c0634b85995257b85b359b50b09fcdada5f85f773d5d0b0b921e485c1b5d8 WatchSource:0}: Error finding container a19c0634b85995257b85b359b50b09fcdada5f85f773d5d0b0b921e485c1b5d8: Status 404 returned error can't find the container with id a19c0634b85995257b85b359b50b09fcdada5f85f773d5d0b0b921e485c1b5d8
May 26 15:17:44.589436 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:44.589418    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12fd7f2_87d9_464a_b5b6_677dbb60fde4.slice/crio-4a3df44495e3d9b70601594dc32e7311399e0ed76b1a98af9b6aa29530576b8f WatchSource:0}: Error finding container 4a3df44495e3d9b70601594dc32e7311399e0ed76b1a98af9b6aa29530576b8f: Status 404 returned error can't find the container with id 4a3df44495e3d9b70601594dc32e7311399e0ed76b1a98af9b6aa29530576b8f
May 26 15:17:44.590307 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:44.590234    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca96af9f_d16f_4d3b_869c_2853e67592b0.slice/crio-51b00388d65d5dbaddce897cf497dbada0ba169cdde57a0f9e4a9dca8601daec WatchSource:0}: Error finding container 51b00388d65d5dbaddce897cf497dbada0ba169cdde57a0f9e4a9dca8601daec: Status 404 returned error can't find the container with id 51b00388d65d5dbaddce897cf497dbada0ba169cdde57a0f9e4a9dca8601daec
May 26 15:17:44.591367 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:44.591148    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef54bc6_23d1_4ada_8bbf_680876a1245a.slice/crio-8b94ca4803b965a150e2e56c37d7c58c304e855aa6fccec47eea12b8bdb9b3a1 WatchSource:0}: Error finding container 8b94ca4803b965a150e2e56c37d7c58c304e855aa6fccec47eea12b8bdb9b3a1: Status 404 returned error can't find the container with id 8b94ca4803b965a150e2e56c37d7c58c304e855aa6fccec47eea12b8bdb9b3a1
May 26 15:17:44.592278 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:44.592251    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9288c0c9_d24c_4932_be3a_584f39a6df8f.slice/crio-cd85c0676cf51143d7b91dd3e151ef181dcb3e28a3b8c363accb3dc1c8cb2e36 WatchSource:0}: Error finding container cd85c0676cf51143d7b91dd3e151ef181dcb3e28a3b8c363accb3dc1c8cb2e36: Status 404 returned error can't find the container with id cd85c0676cf51143d7b91dd3e151ef181dcb3e28a3b8c363accb3dc1c8cb2e36
May 26 15:17:44.592841 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:44.592813    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c60328_df56_42c0_9f63_0f302076398e.slice/crio-d16a704e57275e4fadad4d209a943cec8e9ce7dbb1e1bee65d4903b6ebb9d4f3 WatchSource:0}: Error finding container d16a704e57275e4fadad4d209a943cec8e9ce7dbb1e1bee65d4903b6ebb9d4f3: Status 404 returned error can't find the container with id d16a704e57275e4fadad4d209a943cec8e9ce7dbb1e1bee65d4903b6ebb9d4f3
May 26 15:17:44.593926 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.593902    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:44.594074 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.594044    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:44.594143 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.594105    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs podName:fe9ab1f8-642f-42d3-a2ec-ae4613691a2b nodeName:}" failed. No retries permitted until 2026-05-26 15:17:45.594082686 +0000 UTC m=+4.114626161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs") pod "network-metrics-daemon-vf787" (UID: "fe9ab1f8-642f-42d3-a2ec-ae4613691a2b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:44.594651 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:17:44.594489    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a11aa6_ff7c_4d15_9423_1965544d2d25.slice/crio-bb50c885118f7f10383b6fa288a5c915f4d6757b5217e5fe2e7a26208ccbbe95 WatchSource:0}: Error finding container bb50c885118f7f10383b6fa288a5c915f4d6757b5217e5fe2e7a26208ccbbe95: Status 404 returned error can't find the container with id bb50c885118f7f10383b6fa288a5c915f4d6757b5217e5fe2e7a26208ccbbe95
May 26 15:17:44.796254 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:44.796091    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:44.796254 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.796243    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:44.796254 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.796262    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:44.796431 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.796271    2557 projected.go:194] Error preparing data for projected volume kube-api-access-c2tgl for pod openshift-network-diagnostics/network-check-target-cdppb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:44.796431 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:44.796322    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl podName:95d379c6-e653-4033-af3e-f485d7fac20a nodeName:}" failed. No retries permitted until 2026-05-26 15:17:45.796306213 +0000 UTC m=+4.316849676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2tgl" (UniqueName: "kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl") pod "network-check-target-cdppb" (UID: "95d379c6-e653-4033-af3e-f485d7fac20a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:45.038180 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.038149    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:45.038716 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:45.038293    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:17:45.062068 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.062035    2557 generic.go:358] "Generic (PLEG): container finished" podID="fa61d0e097185e7128b713c33d70a7d5" containerID="e9101d4092b3bbedc8d2815575016600f9ea2ac91fda8789d9d2422430f5d42c" exitCode=0
May 26 15:17:45.062208 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.062122    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal" event={"ID":"fa61d0e097185e7128b713c33d70a7d5","Type":"ContainerDied","Data":"e9101d4092b3bbedc8d2815575016600f9ea2ac91fda8789d9d2422430f5d42c"}
May 26 15:17:45.071365 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.071298    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerStarted","Data":"d16a704e57275e4fadad4d209a943cec8e9ce7dbb1e1bee65d4903b6ebb9d4f3"}
May 26 15:17:45.083097 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.083047    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sgdld" event={"ID":"9288c0c9-d24c-4932-be3a-584f39a6df8f","Type":"ContainerStarted","Data":"cd85c0676cf51143d7b91dd3e151ef181dcb3e28a3b8c363accb3dc1c8cb2e36"}
May 26 15:17:45.105064 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.090211    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:12:43 +0000 UTC" deadline="2027-11-27 06:25:33.94617177 +0000 UTC"
May 26 15:17:45.105064 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.090236    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13191h7m48.855938805s"
May 26 15:17:45.105064 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.090548    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk" event={"ID":"b12fd7f2-87d9-464a-b5b6-677dbb60fde4","Type":"ContainerStarted","Data":"4a3df44495e3d9b70601594dc32e7311399e0ed76b1a98af9b6aa29530576b8f"}
May 26 15:17:45.105064 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.095694    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dz5k2" event={"ID":"3bc43d23-582e-4a39-a80f-4760a45af3f7","Type":"ContainerStarted","Data":"a19c0634b85995257b85b359b50b09fcdada5f85f773d5d0b0b921e485c1b5d8"}
May 26 15:17:45.110226 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.110178    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hp7rv" event={"ID":"e69ab1d5-19da-495e-a87b-261216525ef7","Type":"ContainerStarted","Data":"4753308f405d18bf3c7bd4420810634fa8684f4006caf672114ce32bc1203f86"}
May 26 15:17:45.118420 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.118381    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal" event={"ID":"d5114a2ba826e8e29effd27b13629957","Type":"ContainerStarted","Data":"3e2c25f82e6df8f55dd19bdb79710bbc0547902598f2e16eb455d6fa3560cc0d"}
May 26 15:17:45.139593 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.139557    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" event={"ID":"f4a11aa6-ff7c-4d15-9423-1965544d2d25","Type":"ContainerStarted","Data":"bb50c885118f7f10383b6fa288a5c915f4d6757b5217e5fe2e7a26208ccbbe95"}
May 26 15:17:45.153809 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.153778    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n24gc" event={"ID":"8ef54bc6-23d1-4ada-8bbf-680876a1245a","Type":"ContainerStarted","Data":"8b94ca4803b965a150e2e56c37d7c58c304e855aa6fccec47eea12b8bdb9b3a1"}
May 26 15:17:45.182952 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.182920    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lxdbs" event={"ID":"ca96af9f-d16f-4d3b-869c-2853e67592b0","Type":"ContainerStarted","Data":"51b00388d65d5dbaddce897cf497dbada0ba169cdde57a0f9e4a9dca8601daec"}
May 26 15:17:45.196205 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.196109    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-svzd6" event={"ID":"d40ef27c-c495-489f-9c91-18af598d484c","Type":"ContainerStarted","Data":"f5148f79638c5020106a43cbec94ecfd1eb3d3cea2a5cb2392a815ef4050d6d5"}
May 26 15:17:45.603579 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.602974    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:45.603579 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:45.603114    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:45.603579 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:45.603179    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs podName:fe9ab1f8-642f-42d3-a2ec-ae4613691a2b nodeName:}" failed. No retries permitted until 2026-05-26 15:17:47.603159623 +0000 UTC m=+6.123703073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs") pod "network-metrics-daemon-vf787" (UID: "fe9ab1f8-642f-42d3-a2ec-ae4613691a2b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:45.804197 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:45.804159    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:45.804397 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:45.804328    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:45.804397 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:45.804348    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:45.804397 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:45.804361    2557 projected.go:194] Error preparing data for projected volume kube-api-access-c2tgl for pod openshift-network-diagnostics/network-check-target-cdppb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:45.804550 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:45.804420    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl podName:95d379c6-e653-4033-af3e-f485d7fac20a nodeName:}" failed. No retries permitted until 2026-05-26 15:17:47.804400352 +0000 UTC m=+6.324943804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2tgl" (UniqueName: "kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl") pod "network-check-target-cdppb" (UID: "95d379c6-e653-4033-af3e-f485d7fac20a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:46.039209 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:46.038670    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:46.039209 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:46.038810    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:17:46.212952 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:46.212897    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal" event={"ID":"fa61d0e097185e7128b713c33d70a7d5","Type":"ContainerStarted","Data":"a1123813f7da6c1b58f42a8adcd1645ee99e96fd0864417575db94f2a1e61542"}
May 26 15:17:46.227080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:46.225857    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-253.ec2.internal" podStartSLOduration=3.22584035 podStartE2EDuration="3.22584035s" podCreationTimestamp="2026-05-26 15:17:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:17:45.141320095 +0000 UTC m=+3.661863563" watchObservedRunningTime="2026-05-26 15:17:46.22584035 +0000 UTC m=+4.746383817"
May 26 15:17:47.038493 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:47.038463    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:47.038659 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:47.038597    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:17:47.616642 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:47.616606    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:47.617093 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:47.616768    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:47.617093 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:47.616836    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs podName:fe9ab1f8-642f-42d3-a2ec-ae4613691a2b nodeName:}" failed. No retries permitted until 2026-05-26 15:17:51.616818553 +0000 UTC m=+10.137361996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs") pod "network-metrics-daemon-vf787" (UID: "fe9ab1f8-642f-42d3-a2ec-ae4613691a2b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:47.818143 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:47.818048    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:47.818324 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:47.818198    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:47.818324 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:47.818217    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:47.818324 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:47.818231    2557 projected.go:194] Error preparing data for projected volume kube-api-access-c2tgl for pod openshift-network-diagnostics/network-check-target-cdppb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:47.818324 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:47.818301    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl podName:95d379c6-e653-4033-af3e-f485d7fac20a nodeName:}" failed. No retries permitted until 2026-05-26 15:17:51.818279605 +0000 UTC m=+10.338823060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2tgl" (UniqueName: "kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl") pod "network-check-target-cdppb" (UID: "95d379c6-e653-4033-af3e-f485d7fac20a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:48.038663 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:48.038560    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:48.038839 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:48.038719    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:17:49.038617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:49.038586    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:49.039143 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:49.038731    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:17:50.038457 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:50.038376    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:50.038601 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:50.038511    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:17:51.038687 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:51.038633    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:51.039093 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:51.038871    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:17:51.647762 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:51.647709    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:51.647945 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:51.647867    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:51.648010 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:51.647958    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs podName:fe9ab1f8-642f-42d3-a2ec-ae4613691a2b nodeName:}" failed. No retries permitted until 2026-05-26 15:17:59.647924377 +0000 UTC m=+18.168467836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs") pod "network-metrics-daemon-vf787" (UID: "fe9ab1f8-642f-42d3-a2ec-ae4613691a2b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:51.849539 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:51.849501    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:51.849719 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:51.849683    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:51.849719 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:51.849701    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:51.849719 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:51.849714    2557 projected.go:194] Error preparing data for projected volume kube-api-access-c2tgl for pod openshift-network-diagnostics/network-check-target-cdppb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:51.849938 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:51.849800    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl podName:95d379c6-e653-4033-af3e-f485d7fac20a nodeName:}" failed. No retries permitted until 2026-05-26 15:17:59.849779225 +0000 UTC m=+18.370322675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2tgl" (UniqueName: "kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl") pod "network-check-target-cdppb" (UID: "95d379c6-e653-4033-af3e-f485d7fac20a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:52.041164 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:52.041072    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:52.041589 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:52.041180    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:17:53.038697 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:53.038664    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:53.038943 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:53.038819    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:17:54.038324 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:54.038277    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:54.038731 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:54.038405    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:17:55.038310 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:55.038261    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:55.038559 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:55.038390    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:17:56.038370 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:56.038327    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:56.038554 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:56.038451    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:17:57.038403 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:57.038374    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:57.038829 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:57.038517    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:17:58.038383 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:58.038303    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:58.038526 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:58.038437    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:17:59.038501 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:59.038470    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:59.038660 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:59.038606    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:17:59.710330 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:59.710292    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:17:59.710498 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:59.710449    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:59.710554 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:59.710522    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs podName:fe9ab1f8-642f-42d3-a2ec-ae4613691a2b nodeName:}" failed. No retries permitted until 2026-05-26 15:18:15.710500934 +0000 UTC m=+34.231044382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs") pod "network-metrics-daemon-vf787" (UID: "fe9ab1f8-642f-42d3-a2ec-ae4613691a2b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:17:59.911974 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:17:59.911943    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:17:59.912103 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:59.912058    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:17:59.912103 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:59.912071    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:17:59.912103 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:59.912079    2557 projected.go:194] Error preparing data for projected volume kube-api-access-c2tgl for pod openshift-network-diagnostics/network-check-target-cdppb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:17:59.912224 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:17:59.912138    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl podName:95d379c6-e653-4033-af3e-f485d7fac20a nodeName:}" failed. No retries permitted until 2026-05-26 15:18:15.912122317 +0000 UTC m=+34.432665767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2tgl" (UniqueName: "kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl") pod "network-check-target-cdppb" (UID: "95d379c6-e653-4033-af3e-f485d7fac20a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:18:00.038412 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:00.038335    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:00.038544 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:00.038437    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:18:01.038596 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:01.038564    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:01.039057 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:01.038672    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:18:02.039108 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:02.039080    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:02.039481 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:02.039195    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:18:02.243540 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:02.243507    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dz5k2" event={"ID":"3bc43d23-582e-4a39-a80f-4760a45af3f7","Type":"ContainerStarted","Data":"93d584e13c72d5aaefef0fc3e08ddcb104edc7ceb9d7ab5cdc0066e254b5acff"}
May 26 15:18:02.244940 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:02.244760    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hp7rv" event={"ID":"e69ab1d5-19da-495e-a87b-261216525ef7","Type":"ContainerStarted","Data":"6715b3044a6dbb62135522b02cb364a1c5b123c1e8a4cfe96af37a72ce1e4a4a"}
May 26 15:18:02.246184 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:02.246148    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" event={"ID":"f4a11aa6-ff7c-4d15-9423-1965544d2d25","Type":"ContainerStarted","Data":"af519b3e5dcd7518b654bb393ba9cc1bb813b802717c019223190fde697a4b78"}
May 26 15:18:02.271315 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:02.271263    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-253.ec2.internal" podStartSLOduration=19.271246692 podStartE2EDuration="19.271246692s" podCreationTimestamp="2026-05-26 15:17:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:17:46.227057168 +0000 UTC m=+4.747600631" watchObservedRunningTime="2026-05-26 15:18:02.271246692 +0000 UTC m=+20.791790163"
May 26 15:18:02.310954 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:02.310906    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hp7rv" podStartSLOduration=2.980364957 podStartE2EDuration="20.310892632s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.585482933 +0000 UTC m=+3.106026377" lastFinishedPulling="2026-05-26 15:18:01.91601059 +0000 UTC m=+20.436554052" observedRunningTime="2026-05-26 15:18:02.310602017 +0000 UTC m=+20.831145484" watchObservedRunningTime="2026-05-26 15:18:02.310892632 +0000 UTC m=+20.831436098"
May 26 15:18:02.311072 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:02.311012    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dz5k2" podStartSLOduration=2.983159552 podStartE2EDuration="20.311005834s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.588165204 +0000 UTC m=+3.108708648" lastFinishedPulling="2026-05-26 15:18:01.916011487 +0000 UTC m=+20.436554930" observedRunningTime="2026-05-26 15:18:02.293131387 +0000 UTC m=+20.813674855" watchObservedRunningTime="2026-05-26 15:18:02.311005834 +0000 UTC m=+20.831549314"
May 26 15:18:03.038997 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.038835    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:03.039146 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:03.039117    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:18:03.249383 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.249357    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:18:03.249685 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.249665    2557 generic.go:358] "Generic (PLEG): container finished" podID="99c60328-df56-42c0-9f63-0f302076398e" containerID="d82702e9b1d0026bb55f7eaf3aa9c641e668184ae0c2057c7f4835fe6c57850c" exitCode=1
May 26 15:18:03.249785 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.249725    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerStarted","Data":"bdbcc45a2af576f779d4489558a83a0df45933cb03509611951407ddd215e0b4"}
May 26 15:18:03.249785 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.249765    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerStarted","Data":"b04b1ccf0c90feabe9e8040dc294b6e31b1941d53458fda56ccd28bd45fe5420"}
May 26 15:18:03.249785 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.249776    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerStarted","Data":"5c14d5bf17d23102474ad5f74881a90297882cc43bc0bb8eceb51ebdab48b2fe"}
May 26 15:18:03.249785 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.249784    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerStarted","Data":"1123d6d74d46ec0308f198f2059ab1f0de42620733d3a730df22fdca0049d571"}
May 26 15:18:03.249927 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.249797    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerDied","Data":"d82702e9b1d0026bb55f7eaf3aa9c641e668184ae0c2057c7f4835fe6c57850c"}
May 26 15:18:03.249927 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.249811    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerStarted","Data":"c461f70275ab49853fe111b14fd87d4d65fb7ba661f949f098fd94450ebbfd22"}
May 26 15:18:03.250869 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.250845    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sgdld" event={"ID":"9288c0c9-d24c-4932-be3a-584f39a6df8f","Type":"ContainerStarted","Data":"77fa81882fd3c15adb310c23e7b5441a8c9ca1fd3ebf378025c5f5d8dc695987"}
May 26 15:18:03.251992 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.251971    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk" event={"ID":"b12fd7f2-87d9-464a-b5b6-677dbb60fde4","Type":"ContainerStarted","Data":"25d87545a347218e8228fb33acb988480b2b0c0a772d43157216c0d2a16173a5"}
May 26 15:18:03.253158 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.253138    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4a11aa6-ff7c-4d15-9423-1965544d2d25" containerID="af519b3e5dcd7518b654bb393ba9cc1bb813b802717c019223190fde697a4b78" exitCode=0
May 26 15:18:03.253256 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.253202    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" event={"ID":"f4a11aa6-ff7c-4d15-9423-1965544d2d25","Type":"ContainerDied","Data":"af519b3e5dcd7518b654bb393ba9cc1bb813b802717c019223190fde697a4b78"}
May 26 15:18:03.254501 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.254402    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n24gc" event={"ID":"8ef54bc6-23d1-4ada-8bbf-680876a1245a","Type":"ContainerStarted","Data":"f9424e84059e20ce43f79e2c2e9fdeeb2d1596c27019f6e36cb76f0cdc23147c"}
May 26 15:18:03.255755 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.255654    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lxdbs" event={"ID":"ca96af9f-d16f-4d3b-869c-2853e67592b0","Type":"ContainerStarted","Data":"01960f94b936cee89119ff9beae1ff8263beef9ec85957db1371824659a85fda"}
May 26 15:18:03.256921 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.256901    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-svzd6" event={"ID":"d40ef27c-c495-489f-9c91-18af598d484c","Type":"ContainerStarted","Data":"2e20bd1b5e7d24569ae43c8bea79720e33781f2a048a03757d0c7a248ac23bbc"}
May 26 15:18:03.269372 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.269326    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-sgdld" podStartSLOduration=3.865563598 podStartE2EDuration="21.269315974s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.594042408 +0000 UTC m=+3.114585851" lastFinishedPulling="2026-05-26 15:18:01.997794768 +0000 UTC m=+20.518338227" observedRunningTime="2026-05-26 15:18:03.269129361 +0000 UTC m=+21.789672827" watchObservedRunningTime="2026-05-26 15:18:03.269315974 +0000 UTC m=+21.789859440"
May 26 15:18:03.286901 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.286869    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-svzd6" podStartSLOduration=3.646769279 podStartE2EDuration="21.286858278s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.587108272 +0000 UTC m=+3.107651731" lastFinishedPulling="2026-05-26 15:18:02.22719728 +0000 UTC m=+20.747740730" observedRunningTime="2026-05-26 15:18:03.286435308 +0000 UTC m=+21.806978774" watchObservedRunningTime="2026-05-26 15:18:03.286858278 +0000 UTC m=+21.807401744"
May 26 15:18:03.301630 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.301569    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-lxdbs" podStartSLOduration=3.934295503 podStartE2EDuration="21.301560956s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.591813015 +0000 UTC m=+3.112356474" lastFinishedPulling="2026-05-26 15:18:01.959078478 +0000 UTC m=+20.479621927" observedRunningTime="2026-05-26 15:18:03.301372469 +0000 UTC m=+21.821915931" watchObservedRunningTime="2026-05-26 15:18:03.301560956 +0000 UTC m=+21.822104421"
May 26 15:18:03.316599 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.316563    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n24gc" podStartSLOduration=3.993822399 podStartE2EDuration="21.316554674s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.593315461 +0000 UTC m=+3.113858907" lastFinishedPulling="2026-05-26 15:18:01.916047735 +0000 UTC m=+20.436591182" observedRunningTime="2026-05-26 15:18:03.31637649 +0000 UTC m=+21.836919955" watchObservedRunningTime="2026-05-26 15:18:03.316554674 +0000 UTC m=+21.837098140"
May 26 15:18:03.607119 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:03.607095    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 15:18:04.038295 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:04.038229    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:04.038470 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:04.038332    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:18:04.049973 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:04.049895    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T15:18:03.607115071Z","UUID":"f85e41aa-7b0f-4ede-8d5f-56357d1125ec","Handler":null,"Name":"","Endpoint":""}
May 26 15:18:04.051268 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:04.051248    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 15:18:04.051268 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:04.051271    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 15:18:04.261071 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:04.261031    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk" event={"ID":"b12fd7f2-87d9-464a-b5b6-677dbb60fde4","Type":"ContainerStarted","Data":"4f6409ad72d5fdfa220be00781d394ce577baf17567769dceeace0f0efe645c6"}
May 26 15:18:05.039104 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:05.038917    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:05.039252 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:05.039212    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:18:05.265445 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:05.265372    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:18:05.266008 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:05.265979    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerStarted","Data":"99120be19fa7a39fe4ed9b9e10a677ddde5dda2b63d30ea5152be0a4669417aa"}
May 26 15:18:05.268002 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:05.267971    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk" event={"ID":"b12fd7f2-87d9-464a-b5b6-677dbb60fde4","Type":"ContainerStarted","Data":"0dd51db0189d1e7e1a1a1079a4184b24c1a8b17a88a11161adfe55605b61921c"}
May 26 15:18:05.287773 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:05.287712    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkbxk" podStartSLOduration=3.05515907 podStartE2EDuration="23.287695506s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.591479817 +0000 UTC m=+3.112023266" lastFinishedPulling="2026-05-26 15:18:04.824016259 +0000 UTC m=+23.344559702" observedRunningTime="2026-05-26 15:18:05.287361569 +0000 UTC m=+23.807905035" watchObservedRunningTime="2026-05-26 15:18:05.287695506 +0000 UTC m=+23.808238973"
May 26 15:18:06.038678 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:06.038651    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:06.038853 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:06.038753    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:18:07.002386 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:07.002357    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:18:07.003047 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:07.003029    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:18:07.038697 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:07.038671    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:07.038838 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:07.038810    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:18:07.271610 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:07.271535    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:18:07.272053 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:07.272036    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hp7rv"
May 26 15:18:08.038354 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:08.038327    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:08.038766 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:08.038447    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:18:09.038413 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:09.038258    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:09.038931 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:09.038486    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:18:09.277210 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:09.277189    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:18:09.277514 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:09.277493    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerStarted","Data":"c3ef136f47259a89a9b5d4d885b27b021a000ac70c0009106118bd7fb2ba6ae9"}
May 26 15:18:09.277824 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:09.277805    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:18:09.278012 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:09.277987    2557 scope.go:117] "RemoveContainer" containerID="d82702e9b1d0026bb55f7eaf3aa9c641e668184ae0c2057c7f4835fe6c57850c"
May 26 15:18:09.282277 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:09.282009    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4a11aa6-ff7c-4d15-9423-1965544d2d25" containerID="9036b9fa87adf4dd42d6f697e6df5449b36fa4baf34060f36978c943fc9e5077" exitCode=0
May 26 15:18:09.282277 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:09.282094    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" event={"ID":"f4a11aa6-ff7c-4d15-9423-1965544d2d25","Type":"ContainerDied","Data":"9036b9fa87adf4dd42d6f697e6df5449b36fa4baf34060f36978c943fc9e5077"}
May 26 15:18:09.294625 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:09.294606    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:18:10.038890 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.038860    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:10.039229 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:10.038959    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:18:10.201768 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.201685    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cdppb"]
May 26 15:18:10.204175 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.204153    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vf787"]
May 26 15:18:10.204285 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.204252    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:10.204344 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:10.204328    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:18:10.286682 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.286660    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:18:10.287071 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.287048    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" event={"ID":"99c60328-df56-42c0-9f63-0f302076398e","Type":"ContainerStarted","Data":"db99af4dbe25c3a9f4a951bf292f428b77621acf00237731c6dd73b73e2f54ef"}
May 26 15:18:10.287364 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.287347    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:18:10.287502 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.287475    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:18:10.289035 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.289012    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4a11aa6-ff7c-4d15-9423-1965544d2d25" containerID="404658070e33a59836d5ab2d37eb6824e68c425c57dab8392c6c22f40aaa061e" exitCode=0
May 26 15:18:10.289143 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.289078    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:10.289143 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.289100    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" event={"ID":"f4a11aa6-ff7c-4d15-9423-1965544d2d25","Type":"ContainerDied","Data":"404658070e33a59836d5ab2d37eb6824e68c425c57dab8392c6c22f40aaa061e"}
May 26 15:18:10.289525 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:10.289415    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:18:10.303590 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.303571    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:18:10.334165 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:10.334123    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw" podStartSLOduration=10.636731317 podStartE2EDuration="28.334112608s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.594856544 +0000 UTC m=+3.115399992" lastFinishedPulling="2026-05-26 15:18:02.292237838 +0000 UTC m=+20.812781283" observedRunningTime="2026-05-26 15:18:10.333813345 +0000 UTC m=+28.854356811" watchObservedRunningTime="2026-05-26 15:18:10.334112608 +0000 UTC m=+28.854656073"
May 26 15:18:11.293152 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:11.293003    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4a11aa6-ff7c-4d15-9423-1965544d2d25" containerID="296c9e2e1023e79b39153c62bca6bdf9e5382f7be681017e64e6134eadf32e54" exitCode=0
May 26 15:18:11.293471 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:11.293083    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" event={"ID":"f4a11aa6-ff7c-4d15-9423-1965544d2d25","Type":"ContainerDied","Data":"296c9e2e1023e79b39153c62bca6bdf9e5382f7be681017e64e6134eadf32e54"}
May 26 15:18:12.040167 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:12.040131    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:12.040328 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:12.040264    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:18:12.040328 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:12.040291    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:12.040424 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:12.040403    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:18:14.038028 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:14.037957    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:14.038028 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:14.037974    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:14.038693 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:14.038076    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cdppb" podUID="95d379c6-e653-4033-af3e-f485d7fac20a"
May 26 15:18:14.038693 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:14.038239    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:18:15.725275 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.725238    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:15.725879 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:15.725369    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:18:15.725879 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:15.725432    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs podName:fe9ab1f8-642f-42d3-a2ec-ae4613691a2b nodeName:}" failed. No retries permitted until 2026-05-26 15:18:47.725414897 +0000 UTC m=+66.245958361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs") pod "network-metrics-daemon-vf787" (UID: "fe9ab1f8-642f-42d3-a2ec-ae4613691a2b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:18:15.749497 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.749471    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-253.ec2.internal" event="NodeReady"
May 26 15:18:15.749624 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.749594    2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 15:18:15.820462 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.820435    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-krxk5"]
May 26 15:18:15.836904 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.836877    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8wf52"]
May 26 15:18:15.837048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.837028    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:15.839801 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.839781    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 15:18:15.839948 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.839802    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m8xk4\""
May 26 15:18:15.840490 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.840473    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 15:18:15.840589 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.840502    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 15:18:15.847244 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.847216    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-krxk5"]
May 26 15:18:15.847244 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.847244    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8wf52"]
May 26 15:18:15.847369 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.847349    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wf52"
May 26 15:18:15.850004 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.849870    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 15:18:15.850004 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.849871    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lcntx\""
May 26 15:18:15.850004 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.849902    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 15:18:15.927676 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.927604    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqck9\" (UniqueName: \"kubernetes.io/projected/0629c812-9d09-45fa-9eec-162a272f6b86-kube-api-access-fqck9\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:15.927837 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.927686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqk7c\" (UniqueName: \"kubernetes.io/projected/5fb6d891-20e1-442b-9b19-905bba00a7ad-kube-api-access-fqk7c\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:15.927837 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.927718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0629c812-9d09-45fa-9eec-162a272f6b86-config-volume\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:15.927837 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.927776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:15.927837 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.927805    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:15.927837 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.927827    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0629c812-9d09-45fa-9eec-162a272f6b86-tmp-dir\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:15.928045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:15.927852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:15.928045 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:15.927965    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:18:15.928045 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:15.927982    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:18:15.928045 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:15.927991    2557 projected.go:194] Error preparing data for projected volume kube-api-access-c2tgl for pod openshift-network-diagnostics/network-check-target-cdppb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:18:15.928045 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:15.928046    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl podName:95d379c6-e653-4033-af3e-f485d7fac20a nodeName:}" failed. No retries permitted until 2026-05-26 15:18:47.928029164 +0000 UTC m=+66.448572625 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2tgl" (UniqueName: "kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl") pod "network-check-target-cdppb" (UID: "95d379c6-e653-4033-af3e-f485d7fac20a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:18:16.028990 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.028959    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0629c812-9d09-45fa-9eec-162a272f6b86-config-volume\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:16.028990 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.029003    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:16.029219 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.029036    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0629c812-9d09-45fa-9eec-162a272f6b86-tmp-dir\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:16.029219 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.029053    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:16.029219 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.029078    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqck9\" (UniqueName: \"kubernetes.io/projected/0629c812-9d09-45fa-9eec-162a272f6b86-kube-api-access-fqck9\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:16.029219 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.029148    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqk7c\" (UniqueName: \"kubernetes.io/projected/5fb6d891-20e1-442b-9b19-905bba00a7ad-kube-api-access-fqk7c\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:16.029219 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:16.029195    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:16.029521 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:16.029259    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert podName:5fb6d891-20e1-442b-9b19-905bba00a7ad nodeName:}" failed. No retries permitted until 2026-05-26 15:18:16.529240449 +0000 UTC m=+35.049783895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert") pod "ingress-canary-krxk5" (UID: "5fb6d891-20e1-442b-9b19-905bba00a7ad") : secret "canary-serving-cert" not found
May 26 15:18:16.029521 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:16.029408    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:16.029521 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:16.029451    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls podName:0629c812-9d09-45fa-9eec-162a272f6b86 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:16.529438082 +0000 UTC m=+35.049981528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls") pod "dns-default-8wf52" (UID: "0629c812-9d09-45fa-9eec-162a272f6b86") : secret "dns-default-metrics-tls" not found
May 26 15:18:16.029623 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.029589    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0629c812-9d09-45fa-9eec-162a272f6b86-tmp-dir\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:16.029656 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.029589    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0629c812-9d09-45fa-9eec-162a272f6b86-config-volume\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:16.038551 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.038529    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:16.038705 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.038566    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:16.042431 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.042408    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 15:18:16.043766 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.043734    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 15:18:16.043874 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.043774    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9rgw2\""
May 26 15:18:16.043874 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.043808    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 15:18:16.044074 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.044057    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nc4qx\""
May 26 15:18:16.049954 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.049935    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqk7c\" (UniqueName: \"kubernetes.io/projected/5fb6d891-20e1-442b-9b19-905bba00a7ad-kube-api-access-fqk7c\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:16.050037 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.050002    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqck9\" (UniqueName: \"kubernetes.io/projected/0629c812-9d09-45fa-9eec-162a272f6b86-kube-api-access-fqck9\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:16.532826 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.532797    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:16.532998 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:16.532839    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:16.532998 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:16.532950    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:16.533102 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:16.533010    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls podName:0629c812-9d09-45fa-9eec-162a272f6b86 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:17.532995731 +0000 UTC m=+36.053539174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls") pod "dns-default-8wf52" (UID: "0629c812-9d09-45fa-9eec-162a272f6b86") : secret "dns-default-metrics-tls" not found
May 26 15:18:16.533102 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:16.532953    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:16.533102 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:16.533048    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert podName:5fb6d891-20e1-442b-9b19-905bba00a7ad nodeName:}" failed. No retries permitted until 2026-05-26 15:18:17.533038927 +0000 UTC m=+36.053582379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert") pod "ingress-canary-krxk5" (UID: "5fb6d891-20e1-442b-9b19-905bba00a7ad") : secret "canary-serving-cert" not found
May 26 15:18:17.307671 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:17.307639    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4a11aa6-ff7c-4d15-9423-1965544d2d25" containerID="7baa4e680894af143fb4a5ccb5baf58571d1f22ce6c195fc90970d3e09e4bd77" exitCode=0
May 26 15:18:17.308139 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:17.307682    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" event={"ID":"f4a11aa6-ff7c-4d15-9423-1965544d2d25","Type":"ContainerDied","Data":"7baa4e680894af143fb4a5ccb5baf58571d1f22ce6c195fc90970d3e09e4bd77"}
May 26 15:18:17.540502 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:17.540478    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:17.540598 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:17.540523    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:17.540636 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:17.540615    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:17.540636 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:17.540628    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:17.540694 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:17.540672    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls podName:0629c812-9d09-45fa-9eec-162a272f6b86 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:19.540659331 +0000 UTC m=+38.061202775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls") pod "dns-default-8wf52" (UID: "0629c812-9d09-45fa-9eec-162a272f6b86") : secret "dns-default-metrics-tls" not found
May 26 15:18:17.540694 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:17.540686    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert podName:5fb6d891-20e1-442b-9b19-905bba00a7ad nodeName:}" failed. No retries permitted until 2026-05-26 15:18:19.540680886 +0000 UTC m=+38.061224330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert") pod "ingress-canary-krxk5" (UID: "5fb6d891-20e1-442b-9b19-905bba00a7ad") : secret "canary-serving-cert" not found
May 26 15:18:18.311789 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:18.311758    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4a11aa6-ff7c-4d15-9423-1965544d2d25" containerID="c86e4f1b879b1983a60be3bb684802d3ac03bbf6d724b4e35b9357ef287a5a53" exitCode=0
May 26 15:18:18.312113 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:18.311800    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" event={"ID":"f4a11aa6-ff7c-4d15-9423-1965544d2d25","Type":"ContainerDied","Data":"c86e4f1b879b1983a60be3bb684802d3ac03bbf6d724b4e35b9357ef287a5a53"}
May 26 15:18:19.316540 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:19.316372    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" event={"ID":"f4a11aa6-ff7c-4d15-9423-1965544d2d25","Type":"ContainerStarted","Data":"dbe5ce7f12384b9b460efad0554db49cc211cc8996f7d62d51814757a1a83915"}
May 26 15:18:19.342861 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:19.342819    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5vsgv" podStartSLOduration=4.923466073 podStartE2EDuration="37.342804004s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:17:44.596620701 +0000 UTC m=+3.117164146" lastFinishedPulling="2026-05-26 15:18:17.015958626 +0000 UTC m=+35.536502077" observedRunningTime="2026-05-26 15:18:19.341288861 +0000 UTC m=+37.861832326" watchObservedRunningTime="2026-05-26 15:18:19.342804004 +0000 UTC m=+37.863347470"
May 26 15:18:19.554499 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:19.554473    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:19.554638 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:19.554510    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:19.554638 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:19.554585    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:19.554638 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:19.554598    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:19.554638 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:19.554630    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls podName:0629c812-9d09-45fa-9eec-162a272f6b86 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:23.554617608 +0000 UTC m=+42.075161052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls") pod "dns-default-8wf52" (UID: "0629c812-9d09-45fa-9eec-162a272f6b86") : secret "dns-default-metrics-tls" not found
May 26 15:18:19.554813 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:19.554647    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert podName:5fb6d891-20e1-442b-9b19-905bba00a7ad nodeName:}" failed. No retries permitted until 2026-05-26 15:18:23.554635088 +0000 UTC m=+42.075178533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert") pod "ingress-canary-krxk5" (UID: "5fb6d891-20e1-442b-9b19-905bba00a7ad") : secret "canary-serving-cert" not found
May 26 15:18:23.580999 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:23.580966    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:23.580999 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:23.581006    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:23.581404 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:23.581109    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:23.581404 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:23.581173    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:23.581404 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:23.581185    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert podName:5fb6d891-20e1-442b-9b19-905bba00a7ad nodeName:}" failed. No retries permitted until 2026-05-26 15:18:31.581169503 +0000 UTC m=+50.101712947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert") pod "ingress-canary-krxk5" (UID: "5fb6d891-20e1-442b-9b19-905bba00a7ad") : secret "canary-serving-cert" not found
May 26 15:18:23.581404 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:23.581217    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls podName:0629c812-9d09-45fa-9eec-162a272f6b86 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:31.581204316 +0000 UTC m=+50.101747769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls") pod "dns-default-8wf52" (UID: "0629c812-9d09-45fa-9eec-162a272f6b86") : secret "dns-default-metrics-tls" not found
May 26 15:18:24.447596 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.447563    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2zqtz"]
May 26 15:18:24.449228 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.449212    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.452090 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.452070    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 15:18:24.459589 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.459568    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2zqtz"]
May 26 15:18:24.588345 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.588310    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d92794c3-4f3a-44e4-bdac-96e902e9c040-dbus\") pod \"global-pull-secret-syncer-2zqtz\" (UID: \"d92794c3-4f3a-44e4-bdac-96e902e9c040\") " pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.588607 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.588350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d92794c3-4f3a-44e4-bdac-96e902e9c040-original-pull-secret\") pod \"global-pull-secret-syncer-2zqtz\" (UID: \"d92794c3-4f3a-44e4-bdac-96e902e9c040\") " pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.588607 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.588458    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d92794c3-4f3a-44e4-bdac-96e902e9c040-kubelet-config\") pod \"global-pull-secret-syncer-2zqtz\" (UID: \"d92794c3-4f3a-44e4-bdac-96e902e9c040\") " pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.689634 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.689615    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d92794c3-4f3a-44e4-bdac-96e902e9c040-dbus\") pod \"global-pull-secret-syncer-2zqtz\" (UID: \"d92794c3-4f3a-44e4-bdac-96e902e9c040\") " pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.689695 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.689640    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d92794c3-4f3a-44e4-bdac-96e902e9c040-original-pull-secret\") pod \"global-pull-secret-syncer-2zqtz\" (UID: \"d92794c3-4f3a-44e4-bdac-96e902e9c040\") " pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.689735 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.689721    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d92794c3-4f3a-44e4-bdac-96e902e9c040-kubelet-config\") pod \"global-pull-secret-syncer-2zqtz\" (UID: \"d92794c3-4f3a-44e4-bdac-96e902e9c040\") " pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.689819 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.689805    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d92794c3-4f3a-44e4-bdac-96e902e9c040-kubelet-config\") pod \"global-pull-secret-syncer-2zqtz\" (UID: \"d92794c3-4f3a-44e4-bdac-96e902e9c040\") " pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.689869 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.689856    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d92794c3-4f3a-44e4-bdac-96e902e9c040-dbus\") pod \"global-pull-secret-syncer-2zqtz\" (UID: \"d92794c3-4f3a-44e4-bdac-96e902e9c040\") " pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.692518 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.692501    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d92794c3-4f3a-44e4-bdac-96e902e9c040-original-pull-secret\") pod \"global-pull-secret-syncer-2zqtz\" (UID: \"d92794c3-4f3a-44e4-bdac-96e902e9c040\") " pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.757774 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.757713    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zqtz"
May 26 15:18:24.884785 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:24.884735    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2zqtz"]
May 26 15:18:24.887773 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:18:24.887733    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92794c3_4f3a_44e4_bdac_96e902e9c040.slice/crio-6a633fdbf5a6093fdea6f094a98cdc0bcf95228190461a3839ddddefb407c066 WatchSource:0}: Error finding container 6a633fdbf5a6093fdea6f094a98cdc0bcf95228190461a3839ddddefb407c066: Status 404 returned error can't find the container with id 6a633fdbf5a6093fdea6f094a98cdc0bcf95228190461a3839ddddefb407c066
May 26 15:18:25.328540 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:25.328507    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2zqtz" event={"ID":"d92794c3-4f3a-44e4-bdac-96e902e9c040","Type":"ContainerStarted","Data":"6a633fdbf5a6093fdea6f094a98cdc0bcf95228190461a3839ddddefb407c066"}
May 26 15:18:30.337858 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:30.337785    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2zqtz" event={"ID":"d92794c3-4f3a-44e4-bdac-96e902e9c040","Type":"ContainerStarted","Data":"758c277a56b3f8ba651a1b5abc7f08f5526b9c8f77504f5843484a54815dcd16"}
May 26 15:18:30.355126 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:30.355086    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2zqtz" podStartSLOduration=1.189446707 podStartE2EDuration="6.355073199s" podCreationTimestamp="2026-05-26 15:18:24 +0000 UTC" firstStartedPulling="2026-05-26 15:18:24.88927478 +0000 UTC m=+43.409818238" lastFinishedPulling="2026-05-26 15:18:30.054901282 +0000 UTC m=+48.575444730" observedRunningTime="2026-05-26 15:18:30.354409617 +0000 UTC m=+48.874953084" watchObservedRunningTime="2026-05-26 15:18:30.355073199 +0000 UTC m=+48.875616664"
May 26 15:18:31.532728 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.532701    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"]
May 26 15:18:31.550619 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.550595    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"]
May 26 15:18:31.563822 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.563802    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"]
May 26 15:18:31.563920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.563827    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"]
May 26 15:18:31.563920 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.563902    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.564005 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.563902    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"
May 26 15:18:31.569432 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.569407    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 26 15:18:31.569548 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.569408    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 15:18:31.569548 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.569409    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 26 15:18:31.569548 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.569460    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 15:18:31.569548 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.569460    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 26 15:18:31.569849 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.569829    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 15:18:31.570428 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.570260    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 26 15:18:31.570428 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.570389    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 26 15:18:31.570534 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.570479    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-59466\""
May 26 15:18:31.641213 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.641191    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32ae15e2-d624-4495-bcf0-2f8e91a827e0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm\" (UID: \"32ae15e2-d624-4495-bcf0-2f8e91a827e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"
May 26 15:18:31.641295 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.641227    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:31.641295 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.641252    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:31.641377 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.641296    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-448ln\" (UniqueName: \"kubernetes.io/projected/32ae15e2-d624-4495-bcf0-2f8e91a827e0-kube-api-access-448ln\") pod \"managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm\" (UID: \"32ae15e2-d624-4495-bcf0-2f8e91a827e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"
May 26 15:18:31.641377 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:31.641320    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:31.641377 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:31.641329    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:31.641377 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:31.641358    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls podName:0629c812-9d09-45fa-9eec-162a272f6b86 nodeName:}" failed. No retries permitted until 2026-05-26 15:18:47.641346798 +0000 UTC m=+66.161890242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls") pod "dns-default-8wf52" (UID: "0629c812-9d09-45fa-9eec-162a272f6b86") : secret "dns-default-metrics-tls" not found
May 26 15:18:31.641377 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:31.641377    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert podName:5fb6d891-20e1-442b-9b19-905bba00a7ad nodeName:}" failed. No retries permitted until 2026-05-26 15:18:47.641364788 +0000 UTC m=+66.161908232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert") pod "ingress-canary-krxk5" (UID: "5fb6d891-20e1-442b-9b19-905bba00a7ad") : secret "canary-serving-cert" not found
May 26 15:18:31.741863 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.741844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-ca\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.741985 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.741875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-hub\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.741985 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.741892    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.741985 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.741907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d1f918fb-84e3-4b68-96b9-9df790ac14bc-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.741985 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.741935    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32ae15e2-d624-4495-bcf0-2f8e91a827e0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm\" (UID: \"32ae15e2-d624-4495-bcf0-2f8e91a827e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"
May 26 15:18:31.742186 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.742094    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.742186 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.742143    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8nqr\" (UniqueName: \"kubernetes.io/projected/d1f918fb-84e3-4b68-96b9-9df790ac14bc-kube-api-access-g8nqr\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.742249 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.742183    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-448ln\" (UniqueName: \"kubernetes.io/projected/32ae15e2-d624-4495-bcf0-2f8e91a827e0-kube-api-access-448ln\") pod \"managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm\" (UID: \"32ae15e2-d624-4495-bcf0-2f8e91a827e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"
May 26 15:18:31.744226 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.744207    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32ae15e2-d624-4495-bcf0-2f8e91a827e0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm\" (UID: \"32ae15e2-d624-4495-bcf0-2f8e91a827e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"
May 26 15:18:31.751129 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.751110    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-448ln\" (UniqueName: \"kubernetes.io/projected/32ae15e2-d624-4495-bcf0-2f8e91a827e0-kube-api-access-448ln\") pod \"managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm\" (UID: \"32ae15e2-d624-4495-bcf0-2f8e91a827e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"
May 26 15:18:31.843218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.843197    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-ca\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.843386 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.843275    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-hub\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.843386 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.843302    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.843386 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.843328    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d1f918fb-84e3-4b68-96b9-9df790ac14bc-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.843551 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.843385    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.843551 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.843422    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8nqr\" (UniqueName: \"kubernetes.io/projected/d1f918fb-84e3-4b68-96b9-9df790ac14bc-kube-api-access-g8nqr\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.844148 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.844126    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d1f918fb-84e3-4b68-96b9-9df790ac14bc-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.845535 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.845512    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-ca\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.845637 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.845579    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.846095 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.846075    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-hub\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.846238 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.846217    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d1f918fb-84e3-4b68-96b9-9df790ac14bc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.852059 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.852038    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8nqr\" (UniqueName: \"kubernetes.io/projected/d1f918fb-84e3-4b68-96b9-9df790ac14bc-kube-api-access-g8nqr\") pod \"cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2\" (UID: \"d1f918fb-84e3-4b68-96b9-9df790ac14bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.882191 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.882171    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:18:31.887149 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:31.886847    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"
May 26 15:18:32.010268 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:32.010241    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"]
May 26 15:18:32.013307 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:18:32.013276    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1f918fb_84e3_4b68_96b9_9df790ac14bc.slice/crio-824d1879f1b2da5ccd4f729af6fa87503bc08829e0b5bd13d71c003d36dd1997 WatchSource:0}: Error finding container 824d1879f1b2da5ccd4f729af6fa87503bc08829e0b5bd13d71c003d36dd1997: Status 404 returned error can't find the container with id 824d1879f1b2da5ccd4f729af6fa87503bc08829e0b5bd13d71c003d36dd1997
May 26 15:18:32.020912 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:32.020891    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm"]
May 26 15:18:32.023376 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:18:32.023353    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32ae15e2_d624_4495_bcf0_2f8e91a827e0.slice/crio-132b288676e55d338d3c5b1259a528bdfef1415e4f61ff32ceb9a6bddedae821 WatchSource:0}: Error finding container 132b288676e55d338d3c5b1259a528bdfef1415e4f61ff32ceb9a6bddedae821: Status 404 returned error can't find the container with id 132b288676e55d338d3c5b1259a528bdfef1415e4f61ff32ceb9a6bddedae821
May 26 15:18:32.342500 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:32.342466    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm" event={"ID":"32ae15e2-d624-4495-bcf0-2f8e91a827e0","Type":"ContainerStarted","Data":"132b288676e55d338d3c5b1259a528bdfef1415e4f61ff32ceb9a6bddedae821"}
May 26 15:18:32.343365 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:32.343346    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" event={"ID":"d1f918fb-84e3-4b68-96b9-9df790ac14bc","Type":"ContainerStarted","Data":"824d1879f1b2da5ccd4f729af6fa87503bc08829e0b5bd13d71c003d36dd1997"}
May 26 15:18:37.353785 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:37.353728    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" event={"ID":"d1f918fb-84e3-4b68-96b9-9df790ac14bc","Type":"ContainerStarted","Data":"c6fa265ef3c6ec2ff38b4b5bc53e2ff2bc384ecee8666ce48159662ab5872f99"}
May 26 15:18:38.357992 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:38.357941    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm" event={"ID":"32ae15e2-d624-4495-bcf0-2f8e91a827e0","Type":"ContainerStarted","Data":"18e80f112955063dc2dd01b92a3838ef6ec890f9d803d9a588c2a9f2ceb367ce"}
May 26 15:18:38.375119 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:38.375063    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddc6cdc58-mcttm" podStartSLOduration=2.007636268 podStartE2EDuration="7.375048704s" podCreationTimestamp="2026-05-26 15:18:31 +0000 UTC" firstStartedPulling="2026-05-26 15:18:32.025106544 +0000 UTC m=+50.545649988" lastFinishedPulling="2026-05-26 15:18:37.392518977 +0000 UTC m=+55.913062424" observedRunningTime="2026-05-26 15:18:38.373914808 +0000 UTC m=+56.894458274" watchObservedRunningTime="2026-05-26 15:18:38.375048704 +0000 UTC m=+56.895592170"
May 26 15:18:41.365204 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:41.365155    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" event={"ID":"d1f918fb-84e3-4b68-96b9-9df790ac14bc","Type":"ContainerStarted","Data":"e8d899c004ba26623d118d46ce6f4a605067c75d7af46d6faa5cdfa251af04a6"}
May 26 15:18:41.365204 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:41.365205    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" event={"ID":"d1f918fb-84e3-4b68-96b9-9df790ac14bc","Type":"ContainerStarted","Data":"ed137b032d0b261720a1d750ea0352cf86321c73938241679fa3754dbf219551"}
May 26 15:18:41.383387 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:41.383338    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" podStartSLOduration=1.870173634 podStartE2EDuration="10.383323594s" podCreationTimestamp="2026-05-26 15:18:31 +0000 UTC" firstStartedPulling="2026-05-26 15:18:32.015017749 +0000 UTC m=+50.535561193" lastFinishedPulling="2026-05-26 15:18:40.52816771 +0000 UTC m=+59.048711153" observedRunningTime="2026-05-26 15:18:41.383128983 +0000 UTC m=+59.903672449" watchObservedRunningTime="2026-05-26 15:18:41.383323594 +0000 UTC m=+59.903867062"
May 26 15:18:42.311029 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:42.311005    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fmxcw"
May 26 15:18:47.655483 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:47.655451    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:18:47.655991 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:47.655512    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:18:47.655991 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:47.655595    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:18:47.655991 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:47.655604    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:18:47.655991 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:47.655644    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert podName:5fb6d891-20e1-442b-9b19-905bba00a7ad nodeName:}" failed. No retries permitted until 2026-05-26 15:19:19.655630489 +0000 UTC m=+98.176173933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert") pod "ingress-canary-krxk5" (UID: "5fb6d891-20e1-442b-9b19-905bba00a7ad") : secret "canary-serving-cert" not found
May 26 15:18:47.655991 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:47.655680    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls podName:0629c812-9d09-45fa-9eec-162a272f6b86 nodeName:}" failed. No retries permitted until 2026-05-26 15:19:19.655660787 +0000 UTC m=+98.176204237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls") pod "dns-default-8wf52" (UID: "0629c812-9d09-45fa-9eec-162a272f6b86") : secret "dns-default-metrics-tls" not found
May 26 15:18:47.756707 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:47.756675    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:18:47.759413 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:47.759396    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 15:18:47.767521 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:47.767501    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 15:18:47.767588 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:18:47.767565    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs podName:fe9ab1f8-642f-42d3-a2ec-ae4613691a2b nodeName:}" failed. No retries permitted until 2026-05-26 15:19:51.767546704 +0000 UTC m=+130.288090162 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs") pod "network-metrics-daemon-vf787" (UID: "fe9ab1f8-642f-42d3-a2ec-ae4613691a2b") : secret "metrics-daemon-secret" not found
May 26 15:18:47.958609 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:47.958554    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:47.961203 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:47.961185    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 15:18:47.971644 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:47.971626    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 15:18:47.981956 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:47.981933    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2tgl\" (UniqueName: \"kubernetes.io/projected/95d379c6-e653-4033-af3e-f485d7fac20a-kube-api-access-c2tgl\") pod \"network-check-target-cdppb\" (UID: \"95d379c6-e653-4033-af3e-f485d7fac20a\") " pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:48.165609 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:48.165574    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9rgw2\""
May 26 15:18:48.173068 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:48.173047    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:48.287283 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:48.287252    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cdppb"]
May 26 15:18:48.290635 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:18:48.290608    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d379c6_e653_4033_af3e_f485d7fac20a.slice/crio-6a7b7cfc63b5e6bfb5f5e27b6044f18d73cacaeb4dbab3c826cd5a9c58f4115e WatchSource:0}: Error finding container 6a7b7cfc63b5e6bfb5f5e27b6044f18d73cacaeb4dbab3c826cd5a9c58f4115e: Status 404 returned error can't find the container with id 6a7b7cfc63b5e6bfb5f5e27b6044f18d73cacaeb4dbab3c826cd5a9c58f4115e
May 26 15:18:48.377789 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:48.377763    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cdppb" event={"ID":"95d379c6-e653-4033-af3e-f485d7fac20a","Type":"ContainerStarted","Data":"6a7b7cfc63b5e6bfb5f5e27b6044f18d73cacaeb4dbab3c826cd5a9c58f4115e"}
May 26 15:18:51.385346 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:51.385309    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cdppb" event={"ID":"95d379c6-e653-4033-af3e-f485d7fac20a","Type":"ContainerStarted","Data":"e62b930ea7f5536ede7046e16350d091fdbb15b4acb5c37b50d4ae869fda7004"}
May 26 15:18:51.385817 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:51.385525    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:18:51.401938 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:18:51.401900    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cdppb" podStartSLOduration=66.825382703 podStartE2EDuration="1m9.401889266s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:18:48.292263251 +0000 UTC m=+66.812806694" lastFinishedPulling="2026-05-26 15:18:50.868769795 +0000 UTC m=+69.389313257" observedRunningTime="2026-05-26 15:18:51.401128192 +0000 UTC m=+69.921671659" watchObservedRunningTime="2026-05-26 15:18:51.401889266 +0000 UTC m=+69.922432750"
May 26 15:19:19.672906 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:19:19.672867    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:19:19.672906 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:19:19.672914    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:19:19.673375 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:19:19.673005    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:19:19.673375 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:19:19.673081    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert podName:5fb6d891-20e1-442b-9b19-905bba00a7ad nodeName:}" failed. No retries permitted until 2026-05-26 15:20:23.673064791 +0000 UTC m=+162.193608234 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert") pod "ingress-canary-krxk5" (UID: "5fb6d891-20e1-442b-9b19-905bba00a7ad") : secret "canary-serving-cert" not found
May 26 15:19:19.673375 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:19:19.673008    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:19:19.673375 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:19:19.673143    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls podName:0629c812-9d09-45fa-9eec-162a272f6b86 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:23.673130924 +0000 UTC m=+162.193674368 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls") pod "dns-default-8wf52" (UID: "0629c812-9d09-45fa-9eec-162a272f6b86") : secret "dns-default-metrics-tls" not found
May 26 15:19:22.390077 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:19:22.390053    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cdppb"
May 26 15:19:44.339349 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:19:44.339320    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lxdbs_ca96af9f-d16f-4d3b-869c-2853e67592b0/dns-node-resolver/0.log"
May 26 15:19:44.938997 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:19:44.938973    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dz5k2_3bc43d23-582e-4a39-a80f-4760a45af3f7/node-ca/0.log"
May 26 15:19:51.785367 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:19:51.785336    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:19:51.785825 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:19:51.785454    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 15:19:51.785825 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:19:51.785512    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs podName:fe9ab1f8-642f-42d3-a2ec-ae4613691a2b nodeName:}" failed. No retries permitted until 2026-05-26 15:21:53.785498277 +0000 UTC m=+252.306041721 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs") pod "network-metrics-daemon-vf787" (UID: "fe9ab1f8-642f-42d3-a2ec-ae4613691a2b") : secret "metrics-daemon-secret" not found
May 26 15:20:05.593092 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.593058    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zcbzl"]
May 26 15:20:05.596059 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.596036    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.598766 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.598728    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 15:20:05.598880 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.598767    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 15:20:05.599622 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.599605    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 15:20:05.599714 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.599663    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 15:20:05.599823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.599805    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h445q\""
May 26 15:20:05.605544 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.605521    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zcbzl"]
May 26 15:20:05.672161 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.672128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0f317c0-3a75-4499-a11e-475722368d90-data-volume\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.672161 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.672163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0f317c0-3a75-4499-a11e-475722368d90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.672339 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.672237    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0f317c0-3a75-4499-a11e-475722368d90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.672339 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.672296    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khkm6\" (UniqueName: \"kubernetes.io/projected/e0f317c0-3a75-4499-a11e-475722368d90-kube-api-access-khkm6\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.672339 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.672325    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0f317c0-3a75-4499-a11e-475722368d90-crio-socket\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.741676 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.741652    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-8hzzw"]
May 26 15:20:05.744466 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.744451    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-8hzzw"
May 26 15:20:05.746947 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.746928    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 15:20:05.747074 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.747014    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6dqtp\""
May 26 15:20:05.747134 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.747074    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 15:20:05.762735 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.762712    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-8hzzw"]
May 26 15:20:05.772886 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.772860    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0f317c0-3a75-4499-a11e-475722368d90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.772970 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.772889    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khkm6\" (UniqueName: \"kubernetes.io/projected/e0f317c0-3a75-4499-a11e-475722368d90-kube-api-access-khkm6\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.772970 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.772907    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0f317c0-3a75-4499-a11e-475722368d90-crio-socket\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.772970 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.772959    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0f317c0-3a75-4499-a11e-475722368d90-crio-socket\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.773073 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.773005    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0f317c0-3a75-4499-a11e-475722368d90-data-volume\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.773073 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.773025    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0f317c0-3a75-4499-a11e-475722368d90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.773398 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.773377    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0f317c0-3a75-4499-a11e-475722368d90-data-volume\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.773515 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.773500    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0f317c0-3a75-4499-a11e-475722368d90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.775155 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.775139    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0f317c0-3a75-4499-a11e-475722368d90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.785080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.785060    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khkm6\" (UniqueName: \"kubernetes.io/projected/e0f317c0-3a75-4499-a11e-475722368d90-kube-api-access-khkm6\") pod \"insights-runtime-extractor-zcbzl\" (UID: \"e0f317c0-3a75-4499-a11e-475722368d90\") " pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.873496 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.873443    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tccl6\" (UniqueName: \"kubernetes.io/projected/e2010e00-6520-453d-b5c8-09efbc1af7e4-kube-api-access-tccl6\") pod \"downloads-57bd96b888-8hzzw\" (UID: \"e2010e00-6520-453d-b5c8-09efbc1af7e4\") " pod="openshift-console/downloads-57bd96b888-8hzzw"
May 26 15:20:05.904399 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.904378    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zcbzl"
May 26 15:20:05.975007 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.974594    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tccl6\" (UniqueName: \"kubernetes.io/projected/e2010e00-6520-453d-b5c8-09efbc1af7e4-kube-api-access-tccl6\") pod \"downloads-57bd96b888-8hzzw\" (UID: \"e2010e00-6520-453d-b5c8-09efbc1af7e4\") " pod="openshift-console/downloads-57bd96b888-8hzzw"
May 26 15:20:05.986141 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:05.986104    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tccl6\" (UniqueName: \"kubernetes.io/projected/e2010e00-6520-453d-b5c8-09efbc1af7e4-kube-api-access-tccl6\") pod \"downloads-57bd96b888-8hzzw\" (UID: \"e2010e00-6520-453d-b5c8-09efbc1af7e4\") " pod="openshift-console/downloads-57bd96b888-8hzzw"
May 26 15:20:06.052828 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:06.052481    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-8hzzw"
May 26 15:20:06.053672 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:06.053650    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zcbzl"]
May 26 15:20:06.058099 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:20:06.058078    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f317c0_3a75_4499_a11e_475722368d90.slice/crio-8bcf3238f4d7d2f54e3e2be420bdb299451f53407be55bda95bbb581c7a21994 WatchSource:0}: Error finding container 8bcf3238f4d7d2f54e3e2be420bdb299451f53407be55bda95bbb581c7a21994: Status 404 returned error can't find the container with id 8bcf3238f4d7d2f54e3e2be420bdb299451f53407be55bda95bbb581c7a21994
May 26 15:20:06.173138 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:06.173099    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-8hzzw"]
May 26 15:20:06.176649 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:20:06.176612    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2010e00_6520_453d_b5c8_09efbc1af7e4.slice/crio-0ebfcb8b5676763921d8e7a069a13f4bc99701840faeb0e9a151fbc7a5332456 WatchSource:0}: Error finding container 0ebfcb8b5676763921d8e7a069a13f4bc99701840faeb0e9a151fbc7a5332456: Status 404 returned error can't find the container with id 0ebfcb8b5676763921d8e7a069a13f4bc99701840faeb0e9a151fbc7a5332456
May 26 15:20:06.546770 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:06.546726    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zcbzl" event={"ID":"e0f317c0-3a75-4499-a11e-475722368d90","Type":"ContainerStarted","Data":"7b8bc14c25faba2bd7225b5e82b2c1b36e8d8b14d2d2791120f6d2abe9bebe1d"}
May 26 15:20:06.546770 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:06.546771    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zcbzl" event={"ID":"e0f317c0-3a75-4499-a11e-475722368d90","Type":"ContainerStarted","Data":"8bcf3238f4d7d2f54e3e2be420bdb299451f53407be55bda95bbb581c7a21994"}
May 26 15:20:06.547625 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:06.547603    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-8hzzw" event={"ID":"e2010e00-6520-453d-b5c8-09efbc1af7e4","Type":"ContainerStarted","Data":"0ebfcb8b5676763921d8e7a069a13f4bc99701840faeb0e9a151fbc7a5332456"}
May 26 15:20:07.552663 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:07.552622    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zcbzl" event={"ID":"e0f317c0-3a75-4499-a11e-475722368d90","Type":"ContainerStarted","Data":"b084279f360e5d118626d0f453c4285e158980496e2c02be6c6db40381c98ff3"}
May 26 15:20:09.560079 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:09.560034    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zcbzl" event={"ID":"e0f317c0-3a75-4499-a11e-475722368d90","Type":"ContainerStarted","Data":"7cd408f1eba78cf93d109db6d6a1c6fa2c38be55f1e2e08bec84c752853b7814"}
May 26 15:20:09.580384 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:09.580327    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zcbzl" podStartSLOduration=2.134490971 podStartE2EDuration="4.580311986s" podCreationTimestamp="2026-05-26 15:20:05 +0000 UTC" firstStartedPulling="2026-05-26 15:20:06.115779246 +0000 UTC m=+144.636322696" lastFinishedPulling="2026-05-26 15:20:08.561600264 +0000 UTC m=+147.082143711" observedRunningTime="2026-05-26 15:20:09.579326907 +0000 UTC m=+148.099870378" watchObservedRunningTime="2026-05-26 15:20:09.580311986 +0000 UTC m=+148.100855451"
May 26 15:20:18.849332 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:20:18.849281    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-krxk5" podUID="5fb6d891-20e1-442b-9b19-905bba00a7ad"
May 26 15:20:18.857507 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:20:18.857474    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8wf52" podUID="0629c812-9d09-45fa-9eec-162a272f6b86"
May 26 15:20:19.051159 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:20:19.051113    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vf787" podUID="fe9ab1f8-642f-42d3-a2ec-ae4613691a2b"
May 26 15:20:19.583600 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:19.583566    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:20:20.503118 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.503085    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"]
May 26 15:20:20.505793 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.505771    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.508699 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.508678    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 26 15:20:20.508840 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.508814    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 15:20:20.508906 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.508862    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 15:20:20.509953 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.509935    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 26 15:20:20.510160 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.510030    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 15:20:20.510257 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.510161    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m8khf\""
May 26 15:20:20.522649 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.522614    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"]
May 26 15:20:20.539085 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.539064    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hv74t"]
May 26 15:20:20.540859 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.540841    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.548979 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.548960    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 15:20:20.549128 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.549023    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vq2q\""
May 26 15:20:20.549271 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.549251    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 15:20:20.549363 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.549282    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 15:20:20.584675 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.584647    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.584784 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.584761    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.584853 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.584795    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.584853 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.584824    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h98kn\" (UniqueName: \"kubernetes.io/projected/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-kube-api-access-h98kn\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.685367 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685337    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.685367 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6058dbb-16be-4287-977d-3470c1b9c808-sys\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.685571 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685391    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6058dbb-16be-4287-977d-3470c1b9c808-root\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.685571 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-tls\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.685679 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685622    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.685679 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-accelerators-collector-config\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.685808 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-textfile\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.685808 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685706    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8hw8\" (UniqueName: \"kubernetes.io/projected/d6058dbb-16be-4287-977d-3470c1b9c808-kube-api-access-f8hw8\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.685808 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685761    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.685808 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685794    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h98kn\" (UniqueName: \"kubernetes.io/projected/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-kube-api-access-h98kn\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.686002 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685821    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-wtmp\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.686002 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685850    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6058dbb-16be-4287-977d-3470c1b9c808-metrics-client-ca\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.686002 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.685895    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.686467 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.686437    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.688380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.688356    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.688494 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.688424    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.695816 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.695794    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h98kn\" (UniqueName: \"kubernetes.io/projected/a7efd39c-b66f-4768-adb3-c6181e1fc3ab-kube-api-access-h98kn\") pod \"openshift-state-metrics-9c959559f-dpl4j\" (UID: \"a7efd39c-b66f-4768-adb3-c6181e1fc3ab\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.787138 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787060    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6058dbb-16be-4287-977d-3470c1b9c808-sys\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787138 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787106    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6058dbb-16be-4287-977d-3470c1b9c808-root\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787138 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787134    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-tls\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787177    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6058dbb-16be-4287-977d-3470c1b9c808-sys\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787190    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6058dbb-16be-4287-977d-3470c1b9c808-root\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787216    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787251    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-accelerators-collector-config\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787282    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-textfile\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787308    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hw8\" (UniqueName: \"kubernetes.io/projected/d6058dbb-16be-4287-977d-3470c1b9c808-kube-api-access-f8hw8\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787351    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-wtmp\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787755 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787381    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6058dbb-16be-4287-977d-3470c1b9c808-metrics-client-ca\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787755 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787644    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-wtmp\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.787997 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.787971    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-textfile\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.788137 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.788114    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-accelerators-collector-config\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.788340 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.788303    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6058dbb-16be-4287-977d-3470c1b9c808-metrics-client-ca\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.789702 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.789681    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-tls\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.789795 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.789735    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6058dbb-16be-4287-977d-3470c1b9c808-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.796267 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.796226    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8hw8\" (UniqueName: \"kubernetes.io/projected/d6058dbb-16be-4287-977d-3470c1b9c808-kube-api-access-f8hw8\") pod \"node-exporter-hv74t\" (UID: \"d6058dbb-16be-4287-977d-3470c1b9c808\") " pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:20.816023 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.816002    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"
May 26 15:20:20.849730 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:20.849709    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hv74t"
May 26 15:20:22.803124 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:20:22.803061    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6058dbb_16be_4287_977d_3470c1b9c808.slice/crio-4207863b35540591b694c9d6ee24bc3000dbd44c254664bdb49d9b339de68d32 WatchSource:0}: Error finding container 4207863b35540591b694c9d6ee24bc3000dbd44c254664bdb49d9b339de68d32: Status 404 returned error can't find the container with id 4207863b35540591b694c9d6ee24bc3000dbd44c254664bdb49d9b339de68d32
May 26 15:20:22.926415 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:22.926390    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j"]
May 26 15:20:22.929517 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:20:22.929493    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7efd39c_b66f_4768_adb3_c6181e1fc3ab.slice/crio-407ffc42fcb0f744ad8e18a9815afc77ec11ad2f67e1bf213c335bb61ecb46e7 WatchSource:0}: Error finding container 407ffc42fcb0f744ad8e18a9815afc77ec11ad2f67e1bf213c335bb61ecb46e7: Status 404 returned error can't find the container with id 407ffc42fcb0f744ad8e18a9815afc77ec11ad2f67e1bf213c335bb61ecb46e7
May 26 15:20:23.536162 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.536026    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"]
May 26 15:20:23.539661 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.539634    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.542533 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.542508    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 26 15:20:23.542665 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.542591    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4cr3pgcpgfnph\""
May 26 15:20:23.543237 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.543061    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wptxd\""
May 26 15:20:23.543825 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.543804    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 26 15:20:23.544010 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.543993    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 26 15:20:23.544264 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.544033    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 26 15:20:23.544349 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.544100    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 26 15:20:23.551229 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.551087    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"]
May 26 15:20:23.598324 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.598240    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j" event={"ID":"a7efd39c-b66f-4768-adb3-c6181e1fc3ab","Type":"ContainerStarted","Data":"65af8fbc2a09e48881e44317c0d565c0d612253d8091f9ba08926165e0f586de"}
May 26 15:20:23.598324 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.598286    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j" event={"ID":"a7efd39c-b66f-4768-adb3-c6181e1fc3ab","Type":"ContainerStarted","Data":"24b9fd5ea7dc01cb56e9c3733ce06053a056d00007d3b0d3ae7025dceee065f8"}
May 26 15:20:23.598324 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.598300    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j" event={"ID":"a7efd39c-b66f-4768-adb3-c6181e1fc3ab","Type":"ContainerStarted","Data":"407ffc42fcb0f744ad8e18a9815afc77ec11ad2f67e1bf213c335bb61ecb46e7"}
May 26 15:20:23.599828 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.599776    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hv74t" event={"ID":"d6058dbb-16be-4287-977d-3470c1b9c808","Type":"ContainerStarted","Data":"4207863b35540591b694c9d6ee24bc3000dbd44c254664bdb49d9b339de68d32"}
May 26 15:20:23.601601 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.601565    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-8hzzw" event={"ID":"e2010e00-6520-453d-b5c8-09efbc1af7e4","Type":"ContainerStarted","Data":"45328fa58edc28b5ce0d608409bf94c0857fcbb52c522f29500a452e9a8527e2"}
May 26 15:20:23.601924 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.601902    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-8hzzw"
May 26 15:20:23.617488 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.617456    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-8hzzw"
May 26 15:20:23.620370 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.620308    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-8hzzw" podStartSLOduration=1.9101854249999999 podStartE2EDuration="18.620291445s" podCreationTimestamp="2026-05-26 15:20:05 +0000 UTC" firstStartedPulling="2026-05-26 15:20:06.178494816 +0000 UTC m=+144.699038261" lastFinishedPulling="2026-05-26 15:20:22.888600824 +0000 UTC m=+161.409144281" observedRunningTime="2026-05-26 15:20:23.618978145 +0000 UTC m=+162.139521612" watchObservedRunningTime="2026-05-26 15:20:23.620291445 +0000 UTC m=+162.140834914"
May 26 15:20:23.710341 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.710088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-grpc-tls\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.710341 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.710132    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.710341 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.710158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.710341 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.710190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-metrics-client-ca\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.710341 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.710218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-tls\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.710341 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.710250    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.710341 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.710297    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:20:23.710832 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.710367    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:20:23.710894 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.710868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.711450 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.711030    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcl6s\" (UniqueName: \"kubernetes.io/projected/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-kube-api-access-mcl6s\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.714031 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.713987    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0629c812-9d09-45fa-9eec-162a272f6b86-metrics-tls\") pod \"dns-default-8wf52\" (UID: \"0629c812-9d09-45fa-9eec-162a272f6b86\") " pod="openshift-dns/dns-default-8wf52"
May 26 15:20:23.714580 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.714542    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb6d891-20e1-442b-9b19-905bba00a7ad-cert\") pod \"ingress-canary-krxk5\" (UID: \"5fb6d891-20e1-442b-9b19-905bba00a7ad\") " pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:20:23.787299 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.787228    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m8xk4\""
May 26 15:20:23.794705 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.794665    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-krxk5"
May 26 15:20:23.812196 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.812102    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.812767 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.812200    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcl6s\" (UniqueName: \"kubernetes.io/projected/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-kube-api-access-mcl6s\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.812767 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.812251    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-grpc-tls\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.812767 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.812284    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.812767 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.812311    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.812767 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.812345    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-metrics-client-ca\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.812767 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.812526    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-tls\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.812767 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.812571    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.814567 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.814447    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-metrics-client-ca\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.828069 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.828019    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcl6s\" (UniqueName: \"kubernetes.io/projected/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-kube-api-access-mcl6s\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.831694 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.831645    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-grpc-tls\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.832612 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.832565    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.834138 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.834093    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.834660 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.834612    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.838833 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.837407    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.839142 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.839099    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7b1e527d-0f4f-43b9-b543-b6e011d5d3ab-secret-thanos-querier-tls\") pod \"thanos-querier-7c84b5c876-r9rzn\" (UID: \"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab\") " pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.854820 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.854794    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:23.982611 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:23.982539    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-krxk5"]
May 26 15:20:23.989241 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:20:23.988993    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb6d891_20e1_442b_9b19_905bba00a7ad.slice/crio-95394ce04f74508da290aafa9266909250e580d4e5b7081d3f30d3e4bc64735c WatchSource:0}: Error finding container 95394ce04f74508da290aafa9266909250e580d4e5b7081d3f30d3e4bc64735c: Status 404 returned error can't find the container with id 95394ce04f74508da290aafa9266909250e580d4e5b7081d3f30d3e4bc64735c
May 26 15:20:24.064433 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:24.064404    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"]
May 26 15:20:24.333814 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:20:24.333710    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1e527d_0f4f_43b9_b543_b6e011d5d3ab.slice/crio-f2fb03b9a1daf561e6477666194124801c775455f9b2b9715cabf9e6a0a75dbd WatchSource:0}: Error finding container f2fb03b9a1daf561e6477666194124801c775455f9b2b9715cabf9e6a0a75dbd: Status 404 returned error can't find the container with id f2fb03b9a1daf561e6477666194124801c775455f9b2b9715cabf9e6a0a75dbd
May 26 15:20:24.608067 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:24.607253    2557 generic.go:358] "Generic (PLEG): container finished" podID="d6058dbb-16be-4287-977d-3470c1b9c808" containerID="1a6c9eeb30cc5a8f704e73a75812a428814b3d76298cd82bf412b9743d2588c1" exitCode=0
May 26 15:20:24.608067 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:24.607945    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hv74t" event={"ID":"d6058dbb-16be-4287-977d-3470c1b9c808","Type":"ContainerDied","Data":"1a6c9eeb30cc5a8f704e73a75812a428814b3d76298cd82bf412b9743d2588c1"}
May 26 15:20:24.610045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:24.610017    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn" event={"ID":"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab","Type":"ContainerStarted","Data":"f2fb03b9a1daf561e6477666194124801c775455f9b2b9715cabf9e6a0a75dbd"}
May 26 15:20:24.611996 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:24.611969    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-krxk5" event={"ID":"5fb6d891-20e1-442b-9b19-905bba00a7ad","Type":"ContainerStarted","Data":"95394ce04f74508da290aafa9266909250e580d4e5b7081d3f30d3e4bc64735c"}
May 26 15:20:24.615272 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:24.615035    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j" event={"ID":"a7efd39c-b66f-4768-adb3-c6181e1fc3ab","Type":"ContainerStarted","Data":"2c6175b5ffcd347cabc1fe07d274c52535fa99926d88ef1fba251ee9b3f77e3e"}
May 26 15:20:24.646050 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:24.645999    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-dpl4j" podStartSLOduration=3.310495924 podStartE2EDuration="4.645983664s" podCreationTimestamp="2026-05-26 15:20:20 +0000 UTC" firstStartedPulling="2026-05-26 15:20:23.027699769 +0000 UTC m=+161.548243212" lastFinishedPulling="2026-05-26 15:20:24.363187493 +0000 UTC m=+162.883730952" observedRunningTime="2026-05-26 15:20:24.645027484 +0000 UTC m=+163.165570952" watchObservedRunningTime="2026-05-26 15:20:24.645983664 +0000 UTC m=+163.166527130"
May 26 15:20:25.622109 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:25.622071    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hv74t" event={"ID":"d6058dbb-16be-4287-977d-3470c1b9c808","Type":"ContainerStarted","Data":"524d8a65cea314c945c8d34059e79fb06099b90ce6909c9bc9b590801f7a501e"}
May 26 15:20:25.623025 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:25.622117    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hv74t" event={"ID":"d6058dbb-16be-4287-977d-3470c1b9c808","Type":"ContainerStarted","Data":"eb0079392ef953e5d73ab4967455431a22e9d78c12e41a2629d97990a07c8ffc"}
May 26 15:20:25.644677 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:25.644619    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hv74t" podStartSLOduration=4.65767578 podStartE2EDuration="5.644602141s" podCreationTimestamp="2026-05-26 15:20:20 +0000 UTC" firstStartedPulling="2026-05-26 15:20:22.804881711 +0000 UTC m=+161.325425154" lastFinishedPulling="2026-05-26 15:20:23.791808069 +0000 UTC m=+162.312351515" observedRunningTime="2026-05-26 15:20:25.642833113 +0000 UTC m=+164.163376579" watchObservedRunningTime="2026-05-26 15:20:25.644602141 +0000 UTC m=+164.165145606"
May 26 15:20:26.985559 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:26.985528    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59bdfcb7c8-x2gnh"]
May 26 15:20:27.013901 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.013877    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bdfcb7c8-x2gnh"]
May 26 15:20:27.014040 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.014002    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.016639 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.016617    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 15:20:27.016791 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.016728    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 15:20:27.016863 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.016788    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47bk2\""
May 26 15:20:27.016931 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.016859    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 15:20:27.017700 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.017673    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 15:20:27.018107 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.018086    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 15:20:27.022435 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.022223    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 15:20:27.141782 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.141728    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-oauth-serving-cert\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.141927 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.141789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-oauth-config\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.141927 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.141831    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-config\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.141927 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.141891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zd6r\" (UniqueName: \"kubernetes.io/projected/c3cd01d3-03f4-43ef-899a-86367055cb1e-kube-api-access-9zd6r\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.142096 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.141977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-serving-cert\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.142096 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.142017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-service-ca\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.142173 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.142107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-trusted-ca-bundle\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.243096 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.243033    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-service-ca\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.243218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.243096    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-trusted-ca-bundle\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.243218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.243151    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-oauth-serving-cert\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.243218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.243175    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-oauth-config\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.243218 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.243203    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-config\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.243524 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.243496    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zd6r\" (UniqueName: \"kubernetes.io/projected/c3cd01d3-03f4-43ef-899a-86367055cb1e-kube-api-access-9zd6r\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.243631 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.243558    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-serving-cert\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.243857 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.243803    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-service-ca\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.243961 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.243942    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-oauth-serving-cert\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.244124 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.244047    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-config\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.244124 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.244074    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-trusted-ca-bundle\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.246189 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.246169    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-oauth-config\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.246314 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.246292    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-serving-cert\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.268436 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.268415    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zd6r\" (UniqueName: \"kubernetes.io/projected/c3cd01d3-03f4-43ef-899a-86367055cb1e-kube-api-access-9zd6r\") pod \"console-59bdfcb7c8-x2gnh\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") " pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.324715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.324689    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:27.492823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.492775    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bdfcb7c8-x2gnh"]
May 26 15:20:27.495946 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:20:27.495918    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3cd01d3_03f4_43ef_899a_86367055cb1e.slice/crio-8f4117fca42107ea51588d70a442c527e2ff034c974cf736ab000cac97a2b4ff WatchSource:0}: Error finding container 8f4117fca42107ea51588d70a442c527e2ff034c974cf736ab000cac97a2b4ff: Status 404 returned error can't find the container with id 8f4117fca42107ea51588d70a442c527e2ff034c974cf736ab000cac97a2b4ff
May 26 15:20:27.630142 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.630010    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn" event={"ID":"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab","Type":"ContainerStarted","Data":"802dbc2d7b0169b49a1f3efb38555da636fd213c302e6ab1f924c14d976f82bd"}
May 26 15:20:27.630142 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.630048    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn" event={"ID":"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab","Type":"ContainerStarted","Data":"5a640996a16e7797081097973ce062a7d3024234e15a6d2e7cf2f551aefd0a7d"}
May 26 15:20:27.631813 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.631785    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-krxk5" event={"ID":"5fb6d891-20e1-442b-9b19-905bba00a7ad","Type":"ContainerStarted","Data":"f86bb1c77817e4130c3f9bfdd147049409fe295f1d6f6e9cd185c3c33c75f1f2"}
May 26 15:20:27.632993 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.632945    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bdfcb7c8-x2gnh" event={"ID":"c3cd01d3-03f4-43ef-899a-86367055cb1e","Type":"ContainerStarted","Data":"8f4117fca42107ea51588d70a442c527e2ff034c974cf736ab000cac97a2b4ff"}
May 26 15:20:27.660182 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:27.660143    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-krxk5" podStartSLOduration=129.399192318 podStartE2EDuration="2m12.660132458s" podCreationTimestamp="2026-05-26 15:18:15 +0000 UTC" firstStartedPulling="2026-05-26 15:20:23.992659116 +0000 UTC m=+162.513202572" lastFinishedPulling="2026-05-26 15:20:27.253599267 +0000 UTC m=+165.774142712" observedRunningTime="2026-05-26 15:20:27.659413875 +0000 UTC m=+166.179957354" watchObservedRunningTime="2026-05-26 15:20:27.660132458 +0000 UTC m=+166.180675925"
May 26 15:20:28.641065 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:28.640930    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn" event={"ID":"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab","Type":"ContainerStarted","Data":"2bcf7a24cdb489e304824e28aa33991ccaabd16e037a6b3b65795d71c8d58436"}
May 26 15:20:29.648279 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:29.648189    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn" event={"ID":"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab","Type":"ContainerStarted","Data":"2adde4ce495e72f158a925c34782e16d77da953f4ef6c0fe6a360720bc485f12"}
May 26 15:20:29.648279 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:29.648238    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn" event={"ID":"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab","Type":"ContainerStarted","Data":"5ba34974cbbf601fff755855f92df3df677057eb83ebabc36e20a0cda6adafe4"}
May 26 15:20:29.648279 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:29.648254    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn" event={"ID":"7b1e527d-0f4f-43b9-b543-b6e011d5d3ab","Type":"ContainerStarted","Data":"3db6142a222aa4c8fdabbd129a364bf417c0a679b21e87b2bf4eefabbbcc4967"}
May 26 15:20:29.648960 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:29.648643    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:29.681148 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:29.681085    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn" podStartSLOduration=2.105659454 podStartE2EDuration="6.681068927s" podCreationTimestamp="2026-05-26 15:20:23 +0000 UTC" firstStartedPulling="2026-05-26 15:20:24.338589577 +0000 UTC m=+162.859133026" lastFinishedPulling="2026-05-26 15:20:28.913999038 +0000 UTC m=+167.434542499" observedRunningTime="2026-05-26 15:20:29.678803124 +0000 UTC m=+168.199346591" watchObservedRunningTime="2026-05-26 15:20:29.681068927 +0000 UTC m=+168.201612394"
May 26 15:20:31.657348 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:31.657308    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bdfcb7c8-x2gnh" event={"ID":"c3cd01d3-03f4-43ef-899a-86367055cb1e","Type":"ContainerStarted","Data":"0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc"}
May 26 15:20:31.679012 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:31.678969    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59bdfcb7c8-x2gnh" podStartSLOduration=1.987752854 podStartE2EDuration="5.678959017s" podCreationTimestamp="2026-05-26 15:20:26 +0000 UTC" firstStartedPulling="2026-05-26 15:20:27.498619115 +0000 UTC m=+166.019162565" lastFinishedPulling="2026-05-26 15:20:31.189825285 +0000 UTC m=+169.710368728" observedRunningTime="2026-05-26 15:20:31.678782947 +0000 UTC m=+170.199326413" watchObservedRunningTime="2026-05-26 15:20:31.678959017 +0000 UTC m=+170.199502484"
May 26 15:20:32.039734 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:32.039710    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wf52"
May 26 15:20:32.043132 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:32.043108    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lcntx\""
May 26 15:20:32.050627 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:32.050611    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wf52"
May 26 15:20:32.173986 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:32.173956    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8wf52"]
May 26 15:20:32.175978 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:20:32.175948    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0629c812_9d09_45fa_9eec_162a272f6b86.slice/crio-896458aa22f388d6fcb22a1a5a59031093a20ff538658b26334f102958c6bd0b WatchSource:0}: Error finding container 896458aa22f388d6fcb22a1a5a59031093a20ff538658b26334f102958c6bd0b: Status 404 returned error can't find the container with id 896458aa22f388d6fcb22a1a5a59031093a20ff538658b26334f102958c6bd0b
May 26 15:20:32.660528 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:32.660494    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wf52" event={"ID":"0629c812-9d09-45fa-9eec-162a272f6b86","Type":"ContainerStarted","Data":"896458aa22f388d6fcb22a1a5a59031093a20ff538658b26334f102958c6bd0b"}
May 26 15:20:33.038400 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:33.038325    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:20:34.667702 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:34.667664    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wf52" event={"ID":"0629c812-9d09-45fa-9eec-162a272f6b86","Type":"ContainerStarted","Data":"86a8135df5486e685be3f4341974afe44b469e2d01ff062696719f26a80a9948"}
May 26 15:20:34.667702 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:34.667697    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wf52" event={"ID":"0629c812-9d09-45fa-9eec-162a272f6b86","Type":"ContainerStarted","Data":"28f972718d3866e2849c220fe3e17cf2fdebaeefa2af629fdd38eb2fbdaebba0"}
May 26 15:20:34.668191 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:34.667787    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8wf52"
May 26 15:20:34.685170 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:34.685124    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-8wf52" podStartSLOduration=137.654930976 podStartE2EDuration="2m19.685111825s" podCreationTimestamp="2026-05-26 15:18:15 +0000 UTC" firstStartedPulling="2026-05-26 15:20:32.177830383 +0000 UTC m=+170.698373839" lastFinishedPulling="2026-05-26 15:20:34.208011235 +0000 UTC m=+172.728554688" observedRunningTime="2026-05-26 15:20:34.684949468 +0000 UTC m=+173.205492933" watchObservedRunningTime="2026-05-26 15:20:34.685111825 +0000 UTC m=+173.205655288"
May 26 15:20:35.660775 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:35.660734    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c84b5c876-r9rzn"
May 26 15:20:37.324844 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:37.324810    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:37.325204 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:37.324854    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:37.329465 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:37.329443    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:37.680949 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:37.680881    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:20:44.673526 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:20:44.673492    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8wf52"
May 26 15:21:01.883823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:01.883776    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" podUID="d1f918fb-84e3-4b68-96b9-9df790ac14bc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 15:21:11.883559 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:11.883519    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" podUID="d1f918fb-84e3-4b68-96b9-9df790ac14bc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 15:21:21.883283 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:21.883246    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" podUID="d1f918fb-84e3-4b68-96b9-9df790ac14bc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 15:21:21.883675 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:21.883308    2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2"
May 26 15:21:21.883776 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:21.883728    2557 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e8d899c004ba26623d118d46ce6f4a605067c75d7af46d6faa5cdfa251af04a6"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 26 15:21:21.883819 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:21.883799    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" podUID="d1f918fb-84e3-4b68-96b9-9df790ac14bc" containerName="service-proxy" containerID="cri-o://e8d899c004ba26623d118d46ce6f4a605067c75d7af46d6faa5cdfa251af04a6" gracePeriod=30
May 26 15:21:22.799907 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:22.799873    2557 generic.go:358] "Generic (PLEG): container finished" podID="d1f918fb-84e3-4b68-96b9-9df790ac14bc" containerID="e8d899c004ba26623d118d46ce6f4a605067c75d7af46d6faa5cdfa251af04a6" exitCode=2
May 26 15:21:22.800059 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:22.799930    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" event={"ID":"d1f918fb-84e3-4b68-96b9-9df790ac14bc","Type":"ContainerDied","Data":"e8d899c004ba26623d118d46ce6f4a605067c75d7af46d6faa5cdfa251af04a6"}
May 26 15:21:22.800059 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:22.799968    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fcdfdd8d6-j8kg2" event={"ID":"d1f918fb-84e3-4b68-96b9-9df790ac14bc","Type":"ContainerStarted","Data":"7f2d8539dbd0178befa916e61327efb903b6e5b0529d9e629fcabed3e158e27e"}
May 26 15:21:53.862221 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:53.862143    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:21:53.864330 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:53.864299    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe9ab1f8-642f-42d3-a2ec-ae4613691a2b-metrics-certs\") pod \"network-metrics-daemon-vf787\" (UID: \"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b\") " pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:21:54.041234 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:54.041209    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nc4qx\""
May 26 15:21:54.049258 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:54.049227    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf787"
May 26 15:21:54.164596 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:54.164290    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vf787"]
May 26 15:21:54.884824 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:54.884781    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vf787" event={"ID":"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b","Type":"ContainerStarted","Data":"2dd01c19e55d79bf603b6837c48d42747d96f53481105a2c20eee267338b63bd"}
May 26 15:21:55.888673 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:55.888624    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vf787" event={"ID":"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b","Type":"ContainerStarted","Data":"32803ecff97eebf12606cc290811aa238d44d7323b57a8ccdf4eada36cb3abc0"}
May 26 15:21:55.888673 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:55.888664    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vf787" event={"ID":"fe9ab1f8-642f-42d3-a2ec-ae4613691a2b","Type":"ContainerStarted","Data":"b9e0dc981684f5918a700bf0bf3ae7aea87cde6cd1b0e68b285f04fc19058390"}
May 26 15:21:55.907108 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:21:55.907067    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vf787" podStartSLOduration=253.016377275 podStartE2EDuration="4m13.907053623s" podCreationTimestamp="2026-05-26 15:17:42 +0000 UTC" firstStartedPulling="2026-05-26 15:21:54.171253405 +0000 UTC m=+252.691796850" lastFinishedPulling="2026-05-26 15:21:55.061929752 +0000 UTC m=+253.582473198" observedRunningTime="2026-05-26 15:21:55.905899703 +0000 UTC m=+254.426443173" watchObservedRunningTime="2026-05-26 15:21:55.907053623 +0000 UTC m=+254.427597089"
May 26 15:22:01.443591 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:01.443555    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bdfcb7c8-x2gnh"]
May 26 15:22:26.461908 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.461863    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-59bdfcb7c8-x2gnh" podUID="c3cd01d3-03f4-43ef-899a-86367055cb1e" containerName="console" containerID="cri-o://0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc" gracePeriod=15
May 26 15:22:26.692554 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.692532    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59bdfcb7c8-x2gnh_c3cd01d3-03f4-43ef-899a-86367055cb1e/console/0.log"
May 26 15:22:26.692661 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.692618    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:22:26.780326 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780270    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-service-ca\") pod \"c3cd01d3-03f4-43ef-899a-86367055cb1e\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") "
May 26 15:22:26.780326 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780304    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-trusted-ca-bundle\") pod \"c3cd01d3-03f4-43ef-899a-86367055cb1e\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") "
May 26 15:22:26.780515 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780330    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-oauth-serving-cert\") pod \"c3cd01d3-03f4-43ef-899a-86367055cb1e\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") "
May 26 15:22:26.780515 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780348    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-serving-cert\") pod \"c3cd01d3-03f4-43ef-899a-86367055cb1e\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") "
May 26 15:22:26.780515 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780372    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-oauth-config\") pod \"c3cd01d3-03f4-43ef-899a-86367055cb1e\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") "
May 26 15:22:26.780515 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780396    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zd6r\" (UniqueName: \"kubernetes.io/projected/c3cd01d3-03f4-43ef-899a-86367055cb1e-kube-api-access-9zd6r\") pod \"c3cd01d3-03f4-43ef-899a-86367055cb1e\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") "
May 26 15:22:26.780515 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780424    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-config\") pod \"c3cd01d3-03f4-43ef-899a-86367055cb1e\" (UID: \"c3cd01d3-03f4-43ef-899a-86367055cb1e\") "
May 26 15:22:26.780858 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780828    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-service-ca" (OuterVolumeSpecName: "service-ca") pod "c3cd01d3-03f4-43ef-899a-86367055cb1e" (UID: "c3cd01d3-03f4-43ef-899a-86367055cb1e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:22:26.780936 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780863    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c3cd01d3-03f4-43ef-899a-86367055cb1e" (UID: "c3cd01d3-03f4-43ef-899a-86367055cb1e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:22:26.780936 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780910    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-config" (OuterVolumeSpecName: "console-config") pod "c3cd01d3-03f4-43ef-899a-86367055cb1e" (UID: "c3cd01d3-03f4-43ef-899a-86367055cb1e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:22:26.781009 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.780953    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c3cd01d3-03f4-43ef-899a-86367055cb1e" (UID: "c3cd01d3-03f4-43ef-899a-86367055cb1e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:22:26.782635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.782610    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3cd01d3-03f4-43ef-899a-86367055cb1e-kube-api-access-9zd6r" (OuterVolumeSpecName: "kube-api-access-9zd6r") pod "c3cd01d3-03f4-43ef-899a-86367055cb1e" (UID: "c3cd01d3-03f4-43ef-899a-86367055cb1e"). InnerVolumeSpecName "kube-api-access-9zd6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:22:26.782878 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.782855    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c3cd01d3-03f4-43ef-899a-86367055cb1e" (UID: "c3cd01d3-03f4-43ef-899a-86367055cb1e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:22:26.782878 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.782870    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c3cd01d3-03f4-43ef-899a-86367055cb1e" (UID: "c3cd01d3-03f4-43ef-899a-86367055cb1e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:22:26.881525 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.881499    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-oauth-config\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:22:26.881617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.881531    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zd6r\" (UniqueName: \"kubernetes.io/projected/c3cd01d3-03f4-43ef-899a-86367055cb1e-kube-api-access-9zd6r\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:22:26.881617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.881550    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-config\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:22:26.881617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.881566    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-service-ca\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:22:26.881617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.881580    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-trusted-ca-bundle\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:22:26.881617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.881596    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3cd01d3-03f4-43ef-899a-86367055cb1e-oauth-serving-cert\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:22:26.881617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.881611    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3cd01d3-03f4-43ef-899a-86367055cb1e-console-serving-cert\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:22:26.969819 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.969799    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59bdfcb7c8-x2gnh_c3cd01d3-03f4-43ef-899a-86367055cb1e/console/0.log"
May 26 15:22:26.969924 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.969836    2557 generic.go:358] "Generic (PLEG): container finished" podID="c3cd01d3-03f4-43ef-899a-86367055cb1e" containerID="0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc" exitCode=2
May 26 15:22:26.969924 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.969894    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bdfcb7c8-x2gnh"
May 26 15:22:26.970006 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.969922    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bdfcb7c8-x2gnh" event={"ID":"c3cd01d3-03f4-43ef-899a-86367055cb1e","Type":"ContainerDied","Data":"0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc"}
May 26 15:22:26.970006 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.969960    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bdfcb7c8-x2gnh" event={"ID":"c3cd01d3-03f4-43ef-899a-86367055cb1e","Type":"ContainerDied","Data":"8f4117fca42107ea51588d70a442c527e2ff034c974cf736ab000cac97a2b4ff"}
May 26 15:22:26.970006 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.969974    2557 scope.go:117] "RemoveContainer" containerID="0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc"
May 26 15:22:26.977761 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.977724    2557 scope.go:117] "RemoveContainer" containerID="0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc"
May 26 15:22:26.977991 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:22:26.977972    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc\": container with ID starting with 0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc not found: ID does not exist" containerID="0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc"
May 26 15:22:26.978056 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.977999    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc"} err="failed to get container status \"0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc\": rpc error: code = NotFound desc = could not find container \"0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc\": container with ID starting with 0ae43040d58be8c93ea4e49036ba2c1491fd04fa7c33f826f722dd9ba8681ffc not found: ID does not exist"
May 26 15:22:26.991193 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.991173    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bdfcb7c8-x2gnh"]
May 26 15:22:26.994714 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:26.994695    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59bdfcb7c8-x2gnh"]
May 26 15:22:28.041796 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:28.041762    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3cd01d3-03f4-43ef-899a-86367055cb1e" path="/var/lib/kubelet/pods/c3cd01d3-03f4-43ef-899a-86367055cb1e/volumes"
May 26 15:22:41.988841 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:41.988814    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:22:41.989320 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:41.989289    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:22:41.994019 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:22:41.994001    2557 kubelet.go:1628] "Image garbage collection succeeded"
May 26 15:27:42.006345 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:27:42.006322    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:27:42.007672 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:27:42.007650    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:30:46.542285 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:46.542246    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-c7bxt"]
May 26 15:30:46.542722 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:46.542518    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3cd01d3-03f4-43ef-899a-86367055cb1e" containerName="console"
May 26 15:30:46.542722 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:46.542530    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3cd01d3-03f4-43ef-899a-86367055cb1e" containerName="console"
May 26 15:30:46.542722 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:46.542590    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3cd01d3-03f4-43ef-899a-86367055cb1e" containerName="console"
May 26 15:30:46.545281 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:46.545263    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-c7bxt"
May 26 15:30:46.553911 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:30:46.553884    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"feast-credit-scoring-dockercfg-fxqqw\" is forbidden: User \"system:node:ip-10-0-142-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"test-ns-feast\": no relationship found between node 'ip-10-0-142-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-fxqqw\"" type="*v1.Secret"
May 26 15:30:46.555140 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:30:46.555122    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"feast-credit-scoring-intra-comm\" is forbidden: User \"system:node:ip-10-0-142-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"test-ns-feast\": no relationship found between node 'ip-10-0-142-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" type="*v1.ConfigMap"
May 26 15:30:46.555140 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:30:46.555130    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"test-ns-feast\": no relationship found between node 'ip-10-0-142-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
May 26 15:30:46.558438 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:46.558414    2557 status_manager.go:895] "Failed to get status for pod" podUID="d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" pod="test-ns-feast/feast-test-apply-c7bxt" err="pods \"feast-test-apply-c7bxt\" is forbidden: User \"system:node:ip-10-0-142-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"test-ns-feast\": no relationship found between node 'ip-10-0-142-253.ec2.internal' and this object"
May 26 15:30:46.558685 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:30:46.558668    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"test-ns-feast\": no relationship found between node 'ip-10-0-142-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
May 26 15:30:46.562583 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:46.562563    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-c7bxt"]
May 26 15:30:46.649531 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:46.649502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxvrg\" (UniqueName: \"kubernetes.io/projected/d1da7ca5-4b61-4ad0-927a-b38e7a3411a3-kube-api-access-dxvrg\") pod \"feast-test-apply-c7bxt\" (UID: \"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3\") " pod="test-ns-feast/feast-test-apply-c7bxt"
May 26 15:30:46.750824 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:46.750787    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxvrg\" (UniqueName: \"kubernetes.io/projected/d1da7ca5-4b61-4ad0-927a-b38e7a3411a3-kube-api-access-dxvrg\") pod \"feast-test-apply-c7bxt\" (UID: \"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3\") " pod="test-ns-feast/feast-test-apply-c7bxt"
May 26 15:30:47.499281 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:47.499254    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 26 15:30:47.534368 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:47.534345    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-fxqqw\""
May 26 15:30:47.542178 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:47.542162    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 15:30:48.032913 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:48.032888    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 15:30:48.040986 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:48.040962    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxvrg\" (UniqueName: \"kubernetes.io/projected/d1da7ca5-4b61-4ad0-927a-b38e7a3411a3-kube-api-access-dxvrg\") pod \"feast-test-apply-c7bxt\" (UID: \"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3\") " pod="test-ns-feast/feast-test-apply-c7bxt"
May 26 15:30:48.053693 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:48.053674    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-c7bxt"
May 26 15:30:48.174344 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:48.174314    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-c7bxt"]
May 26 15:30:48.177346 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:30:48.177319    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1da7ca5_4b61_4ad0_927a_b38e7a3411a3.slice/crio-14a847eae3b02a813628943c7af66828a543ced2c0bd64149172e1ac2165691b WatchSource:0}: Error finding container 14a847eae3b02a813628943c7af66828a543ced2c0bd64149172e1ac2165691b: Status 404 returned error can't find the container with id 14a847eae3b02a813628943c7af66828a543ced2c0bd64149172e1ac2165691b
May 26 15:30:48.178971 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:48.178957    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:30:48.221233 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:48.221207    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-c7bxt" event={"ID":"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3","Type":"ContainerStarted","Data":"14a847eae3b02a813628943c7af66828a543ced2c0bd64149172e1ac2165691b"}
May 26 15:30:54.239849 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:30:54.239814    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-c7bxt" event={"ID":"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3","Type":"ContainerStarted","Data":"0a92be9ff3cdf359cbb54e0f34b9419716fd6d18e9c7abdc9f7c6f29421376e5"}
May 26 15:31:00.256052 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:00.256013    2557 generic.go:358] "Generic (PLEG): container finished" podID="d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" containerID="0a92be9ff3cdf359cbb54e0f34b9419716fd6d18e9c7abdc9f7c6f29421376e5" exitCode=0
May 26 15:31:00.256437 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:00.256086    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-c7bxt" event={"ID":"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3","Type":"ContainerDied","Data":"0a92be9ff3cdf359cbb54e0f34b9419716fd6d18e9c7abdc9f7c6f29421376e5"}
May 26 15:31:01.260005 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:01.259971    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-c7bxt" event={"ID":"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3","Type":"ContainerStarted","Data":"ea249801152f9595690f94c571ca403bc1f7350a8801288caae3960cdb5c66d6"}
May 26 15:31:01.276058 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:01.276020    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-c7bxt" podStartSLOduration=9.767692621 podStartE2EDuration="15.276008445s" podCreationTimestamp="2026-05-26 15:30:46 +0000 UTC" firstStartedPulling="2026-05-26 15:30:48.179080812 +0000 UTC m=+786.699624256" lastFinishedPulling="2026-05-26 15:30:53.687396633 +0000 UTC m=+792.207940080" observedRunningTime="2026-05-26 15:31:01.275308777 +0000 UTC m=+799.795852247" watchObservedRunningTime="2026-05-26 15:31:01.276008445 +0000 UTC m=+799.796551908"
May 26 15:31:09.281525 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:09.281425    2557 generic.go:358] "Generic (PLEG): container finished" podID="d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" containerID="ea249801152f9595690f94c571ca403bc1f7350a8801288caae3960cdb5c66d6" exitCode=0
May 26 15:31:09.281525 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:09.281473    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-c7bxt" event={"ID":"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3","Type":"ContainerDied","Data":"ea249801152f9595690f94c571ca403bc1f7350a8801288caae3960cdb5c66d6"}
May 26 15:31:10.403955 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:10.403933    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-c7bxt"
May 26 15:31:10.420372 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:10.420343    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxvrg\" (UniqueName: \"kubernetes.io/projected/d1da7ca5-4b61-4ad0-927a-b38e7a3411a3-kube-api-access-dxvrg\") pod \"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3\" (UID: \"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3\") "
May 26 15:31:10.422791 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:10.422769    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1da7ca5-4b61-4ad0-927a-b38e7a3411a3-kube-api-access-dxvrg" (OuterVolumeSpecName: "kube-api-access-dxvrg") pod "d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" (UID: "d1da7ca5-4b61-4ad0-927a-b38e7a3411a3"). InnerVolumeSpecName "kube-api-access-dxvrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:31:10.521343 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:10.521314    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxvrg\" (UniqueName: \"kubernetes.io/projected/d1da7ca5-4b61-4ad0-927a-b38e7a3411a3-kube-api-access-dxvrg\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:31:11.288085 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:11.288051    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-c7bxt" event={"ID":"d1da7ca5-4b61-4ad0-927a-b38e7a3411a3","Type":"ContainerDied","Data":"14a847eae3b02a813628943c7af66828a543ced2c0bd64149172e1ac2165691b"}
May 26 15:31:11.288085 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:11.288084    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14a847eae3b02a813628943c7af66828a543ced2c0bd64149172e1ac2165691b"
May 26 15:31:11.288085 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:11.288086    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-c7bxt"
May 26 15:31:11.496635 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:11.496579    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-c7bxt_d1da7ca5-4b61-4ad0-927a-b38e7a3411a3/feast-0/0.log"
May 26 15:31:11.504698 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:11.504678    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-c7bxt_d1da7ca5-4b61-4ad0-927a-b38e7a3411a3/feast-1/0.log"
May 26 15:31:45.925200 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:45.925155    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-c7bxt"]
May 26 15:31:45.931207 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:45.931184    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-c7bxt"]
May 26 15:31:46.042071 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:31:46.042037    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" path="/var/lib/kubelet/pods/d1da7ca5-4b61-4ad0-927a-b38e7a3411a3/volumes"
May 26 15:32:42.025024 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:32:42.024950    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:32:42.026760 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:32:42.026721    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:36:19.926916 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.926887    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"]
May 26 15:36:19.927408 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.927268    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" containerName="feast-0"
May 26 15:36:19.927408 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.927286    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" containerName="feast-0"
May 26 15:36:19.927408 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.927322    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" containerName="feast-1"
May 26 15:36:19.927408 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.927331    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" containerName="feast-1"
May 26 15:36:19.927408 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.927397    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1da7ca5-4b61-4ad0-927a-b38e7a3411a3" containerName="feast-1"
May 26 15:36:19.929379 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.929359    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"
May 26 15:36:19.932845 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.932826    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-cwjsn\""
May 26 15:36:19.933831 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.933817    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 15:36:19.941460 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.941443    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 15:36:19.984715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:19.984693    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wg24\" (UniqueName: \"kubernetes.io/projected/4e45e8cb-76b9-486f-9e87-7785698ac516-kube-api-access-9wg24\") pod \"feast-operator-controller-manager-cf99db75-2bxlp\" (UID: \"4e45e8cb-76b9-486f-9e87-7785698ac516\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"
May 26 15:36:20.085333 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:20.085305    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wg24\" (UniqueName: \"kubernetes.io/projected/4e45e8cb-76b9-486f-9e87-7785698ac516-kube-api-access-9wg24\") pod \"feast-operator-controller-manager-cf99db75-2bxlp\" (UID: \"4e45e8cb-76b9-486f-9e87-7785698ac516\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"
May 26 15:36:20.094675 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:20.094649    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"]
May 26 15:36:20.099980 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:20.099958    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wg24\" (UniqueName: \"kubernetes.io/projected/4e45e8cb-76b9-486f-9e87-7785698ac516-kube-api-access-9wg24\") pod \"feast-operator-controller-manager-cf99db75-2bxlp\" (UID: \"4e45e8cb-76b9-486f-9e87-7785698ac516\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"
May 26 15:36:20.239452 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:20.239425    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"
May 26 15:36:20.381080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:20.380955    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"]
May 26 15:36:20.383676 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:36:20.383648    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e45e8cb_76b9_486f_9e87_7785698ac516.slice/crio-466e25c2b3964af6643f8a969d535e93dc6d06fc4dda59fabed0f0c780c2d386 WatchSource:0}: Error finding container 466e25c2b3964af6643f8a969d535e93dc6d06fc4dda59fabed0f0c780c2d386: Status 404 returned error can't find the container with id 466e25c2b3964af6643f8a969d535e93dc6d06fc4dda59fabed0f0c780c2d386
May 26 15:36:20.385370 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:20.385353    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:36:21.108219 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:21.108180    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp" event={"ID":"4e45e8cb-76b9-486f-9e87-7785698ac516","Type":"ContainerStarted","Data":"466e25c2b3964af6643f8a969d535e93dc6d06fc4dda59fabed0f0c780c2d386"}
May 26 15:36:23.115496 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:23.115462    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp" event={"ID":"4e45e8cb-76b9-486f-9e87-7785698ac516","Type":"ContainerStarted","Data":"fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df"}
May 26 15:36:23.115872 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:23.115541    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"
May 26 15:36:23.134996 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:23.134952    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp" podStartSLOduration=1.492083526 podStartE2EDuration="4.134940017s" podCreationTimestamp="2026-05-26 15:36:19 +0000 UTC" firstStartedPulling="2026-05-26 15:36:20.385477108 +0000 UTC m=+1118.906020556" lastFinishedPulling="2026-05-26 15:36:23.028333599 +0000 UTC m=+1121.548877047" observedRunningTime="2026-05-26 15:36:23.133333506 +0000 UTC m=+1121.653876973" watchObservedRunningTime="2026-05-26 15:36:23.134940017 +0000 UTC m=+1121.655483520"
May 26 15:36:34.120374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:34.120337    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"
May 26 15:36:36.754643 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.754608    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"]
May 26 15:36:36.757221 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.757204    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.759929 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.759904    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 15:36:36.760058 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.759956    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 15:36:36.760058 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.759956    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 15:36:36.760058 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.759956    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 15:36:36.760058 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.759932    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 15:36:36.760058 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.759963    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-r8krt\""
May 26 15:36:36.760885 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.760868    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 15:36:36.768634 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.768615    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"]
May 26 15:36:36.800320 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.800285    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.800424 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.800330    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.800424 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.800354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.800424 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.800410    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxxvc\" (UniqueName: \"kubernetes.io/projected/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-kube-api-access-kxxvc\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.800530 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.800478    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.800530 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.800503    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.901711 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.901689    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.901824 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.901719    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.901824 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.901757    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.901824 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.901788    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxxvc\" (UniqueName: \"kubernetes.io/projected/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-kube-api-access-kxxvc\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.901824 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.901812    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.902090 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.901832    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.902090 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:36:36.901845    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 15:36:36.902090 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:36:36.901960    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-online-tls podName:d53c22c5-5b0e-4651-9de2-73b73dc81a7d nodeName:}" failed. No retries permitted until 2026-05-26 15:36:37.40193817 +0000 UTC m=+1135.922481619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-online-tls") pod "feast-simple-feast-setup-664fcfcc58-5bfj2" (UID: "d53c22c5-5b0e-4651-9de2-73b73dc81a7d") : secret "feast-simple-feast-setup-online-tls" not found
May 26 15:36:36.902090 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:36:36.901961    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:36:36.902090 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:36:36.901990    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls podName:d53c22c5-5b0e-4651-9de2-73b73dc81a7d nodeName:}" failed. No retries permitted until 2026-05-26 15:36:37.401983262 +0000 UTC m=+1135.922526706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-5bfj2" (UID: "d53c22c5-5b0e-4651-9de2-73b73dc81a7d") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:36:36.902303 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.902184    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.904196 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.904175    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.904353 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.904333    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:36.910144 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:36.910113    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxxvc\" (UniqueName: \"kubernetes.io/projected/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-kube-api-access-kxxvc\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:37.404821 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:37.404788    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:37.404983 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:37.404840    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:37.404983 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:36:37.404948    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:36:37.405060 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:36:37.405016    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls podName:d53c22c5-5b0e-4651-9de2-73b73dc81a7d nodeName:}" failed. No retries permitted until 2026-05-26 15:36:38.404995449 +0000 UTC m=+1136.925538906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-5bfj2" (UID: "d53c22c5-5b0e-4651-9de2-73b73dc81a7d") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:36:37.407141 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:37.407116    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:38.410387 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:38.410345    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:38.412785 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:38.412735    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5bfj2\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:38.566397 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:38.566374    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:36:38.689789 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:38.689765    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"]
May 26 15:36:38.691193 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:36:38.691160    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd53c22c5_5b0e_4651_9de2_73b73dc81a7d.slice/crio-f4d1084bd1a13dd9ca5053a636b163a98dec5094773c3d0f0ca4bec03f7cd288 WatchSource:0}: Error finding container f4d1084bd1a13dd9ca5053a636b163a98dec5094773c3d0f0ca4bec03f7cd288: Status 404 returned error can't find the container with id f4d1084bd1a13dd9ca5053a636b163a98dec5094773c3d0f0ca4bec03f7cd288
May 26 15:36:39.154833 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:39.154800    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerStarted","Data":"f4d1084bd1a13dd9ca5053a636b163a98dec5094773c3d0f0ca4bec03f7cd288"}
May 26 15:36:54.213359 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:54.213320    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerStarted","Data":"2047ad8b7116e8f5b98da1298d4df6590129529f58213a101ac62a2937fae7d2"}
May 26 15:36:58.226569 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:58.226486    2557 generic.go:358] "Generic (PLEG): container finished" podID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerID="2047ad8b7116e8f5b98da1298d4df6590129529f58213a101ac62a2937fae7d2" exitCode=0
May 26 15:36:58.226569 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:58.226556    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerDied","Data":"2047ad8b7116e8f5b98da1298d4df6590129529f58213a101ac62a2937fae7d2"}
May 26 15:36:59.231044 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:36:59.231011    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerStarted","Data":"2912328918b1a4809c6ae5f5e0032ac6a72ca713a6cc7adc749c97065f609037"}
May 26 15:37:04.244427 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:04.244397    2557 generic.go:358] "Generic (PLEG): container finished" podID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerID="2912328918b1a4809c6ae5f5e0032ac6a72ca713a6cc7adc749c97065f609037" exitCode=0
May 26 15:37:04.244818 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:04.244439    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerDied","Data":"2912328918b1a4809c6ae5f5e0032ac6a72ca713a6cc7adc749c97065f609037"}
May 26 15:37:05.252157 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.252114    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerStarted","Data":"2b737ac636e845e488c5efe5178ad00c9054abda8c3c6f374a7905bc13240e27"}
May 26 15:37:05.252665 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.252169    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerStarted","Data":"a4e9e666d849d8b5ae193ddc4aaf96d6436816150553b16f854fe18b2c7754e5"}
May 26 15:37:05.252665 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.252185    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerStarted","Data":"dc0118545333c63757d966d4221bded49d3ce8ee2db2f03bab720d90341903bc"}
May 26 15:37:05.252665 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.252197    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerStarted","Data":"e9e7b978630615d4e9f8639ad1ceb0258315308f2df69150e297ee25a4e97f88"}
May 26 15:37:05.277436 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.277369    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podStartSLOduration=14.609887253 podStartE2EDuration="29.277348179s" podCreationTimestamp="2026-05-26 15:36:36 +0000 UTC" firstStartedPulling="2026-05-26 15:36:38.692873531 +0000 UTC m=+1137.213416975" lastFinishedPulling="2026-05-26 15:36:53.360334453 +0000 UTC m=+1151.880877901" observedRunningTime="2026-05-26 15:37:05.274971921 +0000 UTC m=+1163.795515388" watchObservedRunningTime="2026-05-26 15:37:05.277348179 +0000 UTC m=+1163.797891646"
May 26 15:37:05.566902 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.566866    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:05.567085 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.566910    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:05.567085 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.566926    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:05.567085 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.566939    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:05.569080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.568945    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused"
May 26 15:37:05.569080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.569023    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.17:8816: connect: connection refused"
May 26 15:37:05.569080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.569034    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused"
May 26 15:37:05.569080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:05.569028    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.17:6571: connect: connection refused"
May 26 15:37:08.566600 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:08.566559    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:08.567097 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:08.566613    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:08.567097 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:08.566770    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused"
May 26 15:37:08.567097 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:08.566814    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.17:6571: connect: connection refused"
May 26 15:37:08.567274 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:08.567253    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:08.567332 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:08.567280    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:08.567332 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:08.567282    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused"
May 26 15:37:08.567485 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:08.567448    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.17:8816: connect: connection refused"
May 26 15:37:11.568342 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:11.568308    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:11.568791 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:11.568451    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:11.568961 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:11.568939    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:11.569143 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:11.569102    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:11.569305 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:11.569276    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:11.569499 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:11.569482    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:11.572733 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:11.572717    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:12.279761 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:12.279725    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:37:42.047657 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:42.047631    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:37:42.049445 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:42.049426    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:37:42.053468 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:42.053448    2557 scope.go:117] "RemoveContainer" containerID="0a92be9ff3cdf359cbb54e0f34b9419716fd6d18e9c7abdc9f7c6f29421376e5"
May 26 15:37:42.060080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:37:42.060062    2557 scope.go:117] "RemoveContainer" containerID="ea249801152f9595690f94c571ca403bc1f7350a8801288caae3960cdb5c66d6"
May 26 15:38:14.019757 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.019713    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"]
May 26 15:38:14.020479 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.020053    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="registry" containerID="cri-o://e9e7b978630615d4e9f8639ad1ceb0258315308f2df69150e297ee25a4e97f88" gracePeriod=30
May 26 15:38:14.020479 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.020127    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="online" containerID="cri-o://dc0118545333c63757d966d4221bded49d3ce8ee2db2f03bab720d90341903bc" gracePeriod=30
May 26 15:38:14.020479 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.020130    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="ui" containerID="cri-o://2b737ac636e845e488c5efe5178ad00c9054abda8c3c6f374a7905bc13240e27" gracePeriod=30
May 26 15:38:14.020479 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.020151    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="offline" containerID="cri-o://a4e9e666d849d8b5ae193ddc4aaf96d6436816150553b16f854fe18b2c7754e5" gracePeriod=30
May 26 15:38:14.401245 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.401211    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"]
May 26 15:38:14.405162 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.405142    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.407599 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.407577    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-fcn8r\""
May 26 15:38:14.416420 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.416398    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"]
May 26 15:38:14.445986 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.445963    2557 generic.go:358] "Generic (PLEG): container finished" podID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerID="2b737ac636e845e488c5efe5178ad00c9054abda8c3c6f374a7905bc13240e27" exitCode=0
May 26 15:38:14.446092 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.446003    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerDied","Data":"2b737ac636e845e488c5efe5178ad00c9054abda8c3c6f374a7905bc13240e27"}
May 26 15:38:14.482556 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.482527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.482707 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.482568    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.482707 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.482586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.482707 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.482664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c23a08-77d9-4b63-854a-f3f1914c72fd-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.482707 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.482686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.482919 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.482776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vlp5\" (UniqueName: \"kubernetes.io/projected/74c23a08-77d9-4b63-854a-f3f1914c72fd-kube-api-access-2vlp5\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.583565 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.583533    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c23a08-77d9-4b63-854a-f3f1914c72fd-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.583565 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.583569    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.583848 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.583599    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vlp5\" (UniqueName: \"kubernetes.io/projected/74c23a08-77d9-4b63-854a-f3f1914c72fd-kube-api-access-2vlp5\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.583848 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.583646    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.583848 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.583684    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.583848 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.583708    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.583848 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:38:14.583706    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 15:38:14.583848 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:38:14.583829    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-ui-tls podName:74c23a08-77d9-4b63-854a-f3f1914c72fd nodeName:}" failed. No retries permitted until 2026-05-26 15:38:15.083805922 +0000 UTC m=+1233.604349388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-89s59" (UID: "74c23a08-77d9-4b63-854a-f3f1914c72fd") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 15:38:14.584088 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:38:14.583864    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 26 15:38:14.584088 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:38:14.583932    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-offline-tls podName:74c23a08-77d9-4b63-854a-f3f1914c72fd nodeName:}" failed. No retries permitted until 2026-05-26 15:38:15.08391259 +0000 UTC m=+1233.604456051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-89s59" (UID: "74c23a08-77d9-4b63-854a-f3f1914c72fd") : secret "feast-simple-feast-setup-offline-tls" not found
May 26 15:38:14.584088 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:38:14.583988    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:38:14.584088 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.584003    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c23a08-77d9-4b63-854a-f3f1914c72fd-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.584088 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:38:14.584029    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-registry-tls podName:74c23a08-77d9-4b63-854a-f3f1914c72fd nodeName:}" failed. No retries permitted until 2026-05-26 15:38:15.084015475 +0000 UTC m=+1233.604558933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-89s59" (UID: "74c23a08-77d9-4b63-854a-f3f1914c72fd") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:38:14.586085 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.586065    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:14.592269 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:14.592247    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vlp5\" (UniqueName: \"kubernetes.io/projected/74c23a08-77d9-4b63-854a-f3f1914c72fd-kube-api-access-2vlp5\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:15.088315 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.088284    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:15.088721 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.088320    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:15.088721 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.088348    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:15.090689 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.090664    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:15.090796 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.090713    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:15.090796 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.090725    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-89s59\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:15.314320 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.314278    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:15.438840 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.438813    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"]
May 26 15:38:15.439821 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:38:15.439794    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74c23a08_77d9_4b63_854a_f3f1914c72fd.slice/crio-6468e41a511c9e04fd13c94afac5dc15a94a911af3f41d7d5428e92a687ff883 WatchSource:0}: Error finding container 6468e41a511c9e04fd13c94afac5dc15a94a911af3f41d7d5428e92a687ff883: Status 404 returned error can't find the container with id 6468e41a511c9e04fd13c94afac5dc15a94a911af3f41d7d5428e92a687ff883
May 26 15:38:15.449198 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.449173    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerStarted","Data":"6468e41a511c9e04fd13c94afac5dc15a94a911af3f41d7d5428e92a687ff883"}
May 26 15:38:15.451506 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.451485    2557 generic.go:358] "Generic (PLEG): container finished" podID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerID="dc0118545333c63757d966d4221bded49d3ce8ee2db2f03bab720d90341903bc" exitCode=0
May 26 15:38:15.451591 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:15.451542    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerDied","Data":"dc0118545333c63757d966d4221bded49d3ce8ee2db2f03bab720d90341903bc"}
May 26 15:38:16.456425 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:16.456386    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerStarted","Data":"8d5e96340c3f458ffc029072c19ffb8cfe492bd698416340bbe4917bb3a38c25"}
May 26 15:38:20.469354 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:20.469317    2557 generic.go:358] "Generic (PLEG): container finished" podID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerID="8d5e96340c3f458ffc029072c19ffb8cfe492bd698416340bbe4917bb3a38c25" exitCode=0
May 26 15:38:20.469868 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:20.469394    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerDied","Data":"8d5e96340c3f458ffc029072c19ffb8cfe492bd698416340bbe4917bb3a38c25"}
May 26 15:38:21.474321 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:21.474285    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerStarted","Data":"920a5e70db4ebd51ba6ecba8e0305da78fafaa40b424bd99ea45afa7b2fb3392"}
May 26 15:38:21.569139 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:21.569104    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused"
May 26 15:38:22.277174 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:22.277130    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused"
May 26 15:38:26.489479 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:26.489446    2557 generic.go:358] "Generic (PLEG): container finished" podID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerID="920a5e70db4ebd51ba6ecba8e0305da78fafaa40b424bd99ea45afa7b2fb3392" exitCode=0
May 26 15:38:26.489942 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:26.489525    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerDied","Data":"920a5e70db4ebd51ba6ecba8e0305da78fafaa40b424bd99ea45afa7b2fb3392"}
May 26 15:38:27.497717 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:27.497674    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerStarted","Data":"b830955b2a24c8aefcfd84482b291d0514c2847c6cfb031fc2c428e31a4eea93"}
May 26 15:38:27.498203 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:27.497727    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerStarted","Data":"937369876d31056caec35041254f869593aac8a43a44f0fcdf0d022b269746d7"}
May 26 15:38:27.498203 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:27.497760    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerStarted","Data":"30a424612917c839838b6df02c4dd6629aba82bec058dd20c9431c2e428dce2c"}
May 26 15:38:27.498203 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:27.497777    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerStarted","Data":"a01adfb1a70c8d761fe4f6dca264a94abaeedd1199dd42ba6b1f0f46118ba49c"}
May 26 15:38:27.524199 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:27.524139    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podStartSLOduration=13.524118655 podStartE2EDuration="13.524118655s" podCreationTimestamp="2026-05-26 15:38:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:38:27.522126445 +0000 UTC m=+1246.042669914" watchObservedRunningTime="2026-05-26 15:38:27.524118655 +0000 UTC m=+1246.044662123"
May 26 15:38:30.315078 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:30.315044    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:30.315595 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:30.315572    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:30.315595 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:30.315598    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:30.315595 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:30.315611    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:30.317061 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:30.317014    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.18:6571: connect: connection refused"
May 26 15:38:30.317265 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:30.317041    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused"
May 26 15:38:30.317341 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:30.317056    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.18:8816: connect: connection refused"
May 26 15:38:30.317341 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:30.317102    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused"
May 26 15:38:31.569970 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:31.569926    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused"
May 26 15:38:32.276895 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:32.276853    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused"
May 26 15:38:33.316041 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.316013    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.316386 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.316108    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.316386 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.316337    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.316758 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.316674    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.316887 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.316766    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.316887 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.316783    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.316887 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.316883    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.317119 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.317103    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.317879 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.317863    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.320396 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.320376    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.519773 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.519048    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:33.526318 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:33.526295    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:38:41.569930 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:41.569890    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused"
May 26 15:38:41.570333 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:41.570059    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:38:42.277566 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:42.277532    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused"
May 26 15:38:42.277722 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:42.277651    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:38:44.551686 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.551658    2557 generic.go:358] "Generic (PLEG): container finished" podID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerID="a4e9e666d849d8b5ae193ddc4aaf96d6436816150553b16f854fe18b2c7754e5" exitCode=137
May 26 15:38:44.551686 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.551683    2557 generic.go:358] "Generic (PLEG): container finished" podID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerID="e9e7b978630615d4e9f8639ad1ceb0258315308f2df69150e297ee25a4e97f88" exitCode=137
May 26 15:38:44.552064 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.551726    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerDied","Data":"a4e9e666d849d8b5ae193ddc4aaf96d6436816150553b16f854fe18b2c7754e5"}
May 26 15:38:44.552064 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.551786    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerDied","Data":"e9e7b978630615d4e9f8639ad1ceb0258315308f2df69150e297ee25a4e97f88"}
May 26 15:38:44.659569 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.659548    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:38:44.724192 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.724165    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-ui-tls\") pod \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") "
May 26 15:38:44.724307 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.724199    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxxvc\" (UniqueName: \"kubernetes.io/projected/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-kube-api-access-kxxvc\") pod \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") "
May 26 15:38:44.724307 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.724217    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-offline-tls\") pod \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") "
May 26 15:38:44.724307 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.724237    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-feast-data\") pod \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") "
May 26 15:38:44.724454 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.724365    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls\") pod \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") "
May 26 15:38:44.724506 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.724486    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-online-tls\") pod \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\" (UID: \"d53c22c5-5b0e-4651-9de2-73b73dc81a7d\") "
May 26 15:38:44.724794 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.724769    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-feast-data" (OuterVolumeSpecName: "feast-data") pod "d53c22c5-5b0e-4651-9de2-73b73dc81a7d" (UID: "d53c22c5-5b0e-4651-9de2-73b73dc81a7d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:38:44.726471 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.726441    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d53c22c5-5b0e-4651-9de2-73b73dc81a7d" (UID: "d53c22c5-5b0e-4651-9de2-73b73dc81a7d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:38:44.726559 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.726470    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d53c22c5-5b0e-4651-9de2-73b73dc81a7d" (UID: "d53c22c5-5b0e-4651-9de2-73b73dc81a7d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:38:44.726559 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.726494    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d53c22c5-5b0e-4651-9de2-73b73dc81a7d" (UID: "d53c22c5-5b0e-4651-9de2-73b73dc81a7d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:38:44.726652 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.726639    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-kube-api-access-kxxvc" (OuterVolumeSpecName: "kube-api-access-kxxvc") pod "d53c22c5-5b0e-4651-9de2-73b73dc81a7d" (UID: "d53c22c5-5b0e-4651-9de2-73b73dc81a7d"). InnerVolumeSpecName "kube-api-access-kxxvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:38:44.726778 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.726758    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-online-tls" (OuterVolumeSpecName: "online-tls") pod "d53c22c5-5b0e-4651-9de2-73b73dc81a7d" (UID: "d53c22c5-5b0e-4651-9de2-73b73dc81a7d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:38:44.825907 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.825877    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-online-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:38:44.825907 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.825908    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-ui-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:38:44.826045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.825923    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxxvc\" (UniqueName: \"kubernetes.io/projected/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-kube-api-access-kxxvc\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:38:44.826045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.825935    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-offline-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:38:44.826045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.825947    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-feast-data\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:38:44.826045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:44.825959    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d53c22c5-5b0e-4651-9de2-73b73dc81a7d-registry-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:38:45.557180 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.557148    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2" event={"ID":"d53c22c5-5b0e-4651-9de2-73b73dc81a7d","Type":"ContainerDied","Data":"f4d1084bd1a13dd9ca5053a636b163a98dec5094773c3d0f0ca4bec03f7cd288"}
May 26 15:38:45.557620 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.557195    2557 scope.go:117] "RemoveContainer" containerID="2b737ac636e845e488c5efe5178ad00c9054abda8c3c6f374a7905bc13240e27"
May 26 15:38:45.557620 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.557206    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"
May 26 15:38:45.566064 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.566045    2557 scope.go:117] "RemoveContainer" containerID="a4e9e666d849d8b5ae193ddc4aaf96d6436816150553b16f854fe18b2c7754e5"
May 26 15:38:45.572985 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.572969    2557 scope.go:117] "RemoveContainer" containerID="dc0118545333c63757d966d4221bded49d3ce8ee2db2f03bab720d90341903bc"
May 26 15:38:45.579234 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.579220    2557 scope.go:117] "RemoveContainer" containerID="e9e7b978630615d4e9f8639ad1ceb0258315308f2df69150e297ee25a4e97f88"
May 26 15:38:45.584848 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.584821    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"]
May 26 15:38:45.585882 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.585867    2557 scope.go:117] "RemoveContainer" containerID="2912328918b1a4809c6ae5f5e0032ac6a72ca713a6cc7adc749c97065f609037"
May 26 15:38:45.594361 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.594328    2557 scope.go:117] "RemoveContainer" containerID="2047ad8b7116e8f5b98da1298d4df6590129529f58213a101ac62a2937fae7d2"
May 26 15:38:45.595051 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:45.595036    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5bfj2"]
May 26 15:38:46.042276 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:38:46.042245    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" path="/var/lib/kubelet/pods/d53c22c5-5b0e-4651-9de2-73b73dc81a7d/volumes"
May 26 15:39:36.245241 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245211    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"]
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245477    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="offline"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245488    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="offline"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245502    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="feast-apply"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245507    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="feast-apply"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245516    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="registry"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245521    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="registry"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245530    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="online"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245535    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="online"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245544    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="ui"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245549    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="ui"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245557    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="feast-init"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245563    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="feast-init"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245606    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="registry"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245615    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="online"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245621    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="ui"
May 26 15:39:36.245648 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.245627    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d53c22c5-5b0e-4651-9de2-73b73dc81a7d" containerName="offline"
May 26 15:39:36.252114 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.252085    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.254680 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.254655    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 15:39:36.254829 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.254688    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 15:39:36.254829 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.254726    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 15:39:36.255611 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.255592    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 15:39:36.255611 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.255602    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-zgx9h\""
May 26 15:39:36.255611 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.255600    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 15:39:36.255798 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.255609    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 15:39:36.260917 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.260899    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"]
May 26 15:39:36.275779 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.275759    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.275901 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.275804    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.275901 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.275834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.275901 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.275861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.275901 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.275885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf9cp\" (UniqueName: \"kubernetes.io/projected/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-kube-api-access-cf9cp\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.276078 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.275938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.377048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.377023    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.377164 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.377054    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.377164 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.377072    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.377256 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.377183    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cf9cp\" (UniqueName: \"kubernetes.io/projected/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-kube-api-access-cf9cp\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.377256 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.377217    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.377336 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.377291    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.377420 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.377398    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.377957 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.377938    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.379480 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.379453    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.379599 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.379482    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.379599 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.379556    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.386065 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.386043    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf9cp\" (UniqueName: \"kubernetes.io/projected/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-kube-api-access-cf9cp\") pod \"feast-simple-feast-remote-setup-5cff94746b-dvhqv\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.561228 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.561200    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:36.687776 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:36.687724    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"]
May 26 15:39:36.691178 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:39:36.691154    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b3aa310_9b0a_403a_9046_2aa9e6c1a05e.slice/crio-94be591b17437c771591cd9ebc58fc0108109028ef0d89a008c9343eb85c02e5 WatchSource:0}: Error finding container 94be591b17437c771591cd9ebc58fc0108109028ef0d89a008c9343eb85c02e5: Status 404 returned error can't find the container with id 94be591b17437c771591cd9ebc58fc0108109028ef0d89a008c9343eb85c02e5
May 26 15:39:37.693942 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:37.693908    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerStarted","Data":"f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e"}
May 26 15:39:37.693942 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:37.693947    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerStarted","Data":"94be591b17437c771591cd9ebc58fc0108109028ef0d89a008c9343eb85c02e5"}
May 26 15:39:41.706174 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:41.706141    2557 generic.go:358] "Generic (PLEG): container finished" podID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerID="f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e" exitCode=0
May 26 15:39:41.706564 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:41.706206    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerDied","Data":"f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e"}
May 26 15:39:42.710012 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:42.709979    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerStarted","Data":"1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f"}
May 26 15:39:47.725465 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:47.725429    2557 generic.go:358] "Generic (PLEG): container finished" podID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerID="1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f" exitCode=0
May 26 15:39:47.725848 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:47.725497    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerDied","Data":"1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f"}
May 26 15:39:48.731724 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:48.731683    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerStarted","Data":"633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751"}
May 26 15:39:48.732116 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:48.731755    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerStarted","Data":"bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9"}
May 26 15:39:48.732116 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:48.731773    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerStarted","Data":"7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973"}
May 26 15:39:48.759632 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:48.759581    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podStartSLOduration=12.759562599 podStartE2EDuration="12.759562599s" podCreationTimestamp="2026-05-26 15:39:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:39:48.757783292 +0000 UTC m=+1327.278326759" watchObservedRunningTime="2026-05-26 15:39:48.759562599 +0000 UTC m=+1327.280106067"
May 26 15:39:51.561698 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:51.561630    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:51.561698 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:51.561684    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:51.561698 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:51.561701    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:51.563689 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:51.563653    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
May 26 15:39:51.563924 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:51.563661    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused"
May 26 15:39:51.564023 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:51.563686    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
May 26 15:39:54.562978 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:54.562908    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:54.563436 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:54.563036    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:54.563503 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:54.563442    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:54.563503 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:54.563480    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:54.563860 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:54.563840    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:54.563957 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:54.563881    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:54.566789 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:54.566773    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:54.752522 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:54.752497    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:39:54.755217 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:39:54.755204    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:40:57.478430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.478395    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"]
May 26 15:40:57.478915 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.478825    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="online" containerID="cri-o://7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973" gracePeriod=30
May 26 15:40:57.478987 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.478896    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="offline" containerID="cri-o://bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9" gracePeriod=30
May 26 15:40:57.479090 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.479069    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="ui" containerID="cri-o://633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751" gracePeriod=30
May 26 15:40:57.623402 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.623368    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"]
May 26 15:40:57.624048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.623766    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="registry" containerID="cri-o://a01adfb1a70c8d761fe4f6dca264a94abaeedd1199dd42ba6b1f0f46118ba49c" gracePeriod=30
May 26 15:40:57.624048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.623783    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="offline" containerID="cri-o://937369876d31056caec35041254f869593aac8a43a44f0fcdf0d022b269746d7" gracePeriod=30
May 26 15:40:57.624048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.623822    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="online" containerID="cri-o://30a424612917c839838b6df02c4dd6629aba82bec058dd20c9431c2e428dce2c" gracePeriod=30
May 26 15:40:57.624510 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.624480    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="ui" containerID="cri-o://b830955b2a24c8aefcfd84482b291d0514c2847c6cfb031fc2c428e31a4eea93" gracePeriod=30
May 26 15:40:57.926631 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.926596    2557 generic.go:358] "Generic (PLEG): container finished" podID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerID="633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751" exitCode=0
May 26 15:40:57.926820 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:57.926655    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerDied","Data":"633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751"}
May 26 15:40:58.931275 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:58.931241    2557 generic.go:358] "Generic (PLEG): container finished" podID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerID="b830955b2a24c8aefcfd84482b291d0514c2847c6cfb031fc2c428e31a4eea93" exitCode=0
May 26 15:40:58.931275 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:58.931266    2557 generic.go:358] "Generic (PLEG): container finished" podID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerID="30a424612917c839838b6df02c4dd6629aba82bec058dd20c9431c2e428dce2c" exitCode=0
May 26 15:40:58.931707 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:58.931318    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerDied","Data":"b830955b2a24c8aefcfd84482b291d0514c2847c6cfb031fc2c428e31a4eea93"}
May 26 15:40:58.931707 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:58.931351    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerDied","Data":"30a424612917c839838b6df02c4dd6629aba82bec058dd20c9431c2e428dce2c"}
May 26 15:40:58.933560 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:58.933539    2557 generic.go:358] "Generic (PLEG): container finished" podID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerID="7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973" exitCode=0
May 26 15:40:58.933672 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:40:58.933579    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerDied","Data":"7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973"}
May 26 15:41:03.317485 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:03.317442    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused"
May 26 15:41:03.519320 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:03.519280    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused"
May 26 15:41:04.564520 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:04.564479    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
May 26 15:41:04.752729 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:04.752694    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
May 26 15:41:13.317066 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:13.317017    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused"
May 26 15:41:13.518992 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:13.518953    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused"
May 26 15:41:14.564456 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:14.564415    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
May 26 15:41:14.752905 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:14.752872    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
May 26 15:41:23.317126 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:23.317034    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused"
May 26 15:41:23.317664 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:23.317185    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:41:23.519048 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:23.519005    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused"
May 26 15:41:23.519225 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:23.519157    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:41:24.564198 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:24.564160    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
May 26 15:41:24.564578 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:24.564281    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:41:24.753419 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:24.753385    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
May 26 15:41:24.753565 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:24.753517    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:41:27.713598 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.713575    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:41:27.756233 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.756180    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-feast-data\") pod \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") "
May 26 15:41:27.756233 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.756214    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-online-tls\") pod \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") "
May 26 15:41:27.756404 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.756259    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf9cp\" (UniqueName: \"kubernetes.io/projected/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-kube-api-access-cf9cp\") pod \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") "
May 26 15:41:27.756404 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.756276    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-registry-tls\") pod \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") "
May 26 15:41:27.756404 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.756300    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-offline-tls\") pod \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") "
May 26 15:41:27.756404 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.756315    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-ui-tls\") pod \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\" (UID: \"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e\") "
May 26 15:41:27.756693 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.756654    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" (UID: "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:41:27.756819 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.756728    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-feast-data" (OuterVolumeSpecName: "feast-data") pod "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" (UID: "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:41:27.758459 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.758438    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-kube-api-access-cf9cp" (OuterVolumeSpecName: "kube-api-access-cf9cp") pod "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" (UID: "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e"). InnerVolumeSpecName "kube-api-access-cf9cp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:41:27.758540 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.758486    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" (UID: "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:41:27.758540 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.758497    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" (UID: "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:41:27.758540 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.758513    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-online-tls" (OuterVolumeSpecName: "online-tls") pod "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" (UID: "1b3aa310-9b0a-403a-9046-2aa9e6c1a05e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:41:27.857725 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.857704    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-feast-data\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:27.857725 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.857725    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-online-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:27.857827 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.857734    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf9cp\" (UniqueName: \"kubernetes.io/projected/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-kube-api-access-cf9cp\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:27.857827 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.857767    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-registry-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:27.857827 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.857776    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-offline-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:27.857827 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:27.857784    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e-ui-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:28.016306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.016245    2557 generic.go:358] "Generic (PLEG): container finished" podID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerID="937369876d31056caec35041254f869593aac8a43a44f0fcdf0d022b269746d7" exitCode=137
May 26 15:41:28.016306 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.016267    2557 generic.go:358] "Generic (PLEG): container finished" podID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerID="a01adfb1a70c8d761fe4f6dca264a94abaeedd1199dd42ba6b1f0f46118ba49c" exitCode=137
May 26 15:41:28.016437 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.016319    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerDied","Data":"937369876d31056caec35041254f869593aac8a43a44f0fcdf0d022b269746d7"}
May 26 15:41:28.016437 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.016350    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerDied","Data":"a01adfb1a70c8d761fe4f6dca264a94abaeedd1199dd42ba6b1f0f46118ba49c"}
May 26 15:41:28.018311 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.018288    2557 generic.go:358] "Generic (PLEG): container finished" podID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerID="bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9" exitCode=137
May 26 15:41:28.018392 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.018348    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerDied","Data":"bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9"}
May 26 15:41:28.018392 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.018359    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"
May 26 15:41:28.018392 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.018374    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv" event={"ID":"1b3aa310-9b0a-403a-9046-2aa9e6c1a05e","Type":"ContainerDied","Data":"94be591b17437c771591cd9ebc58fc0108109028ef0d89a008c9343eb85c02e5"}
May 26 15:41:28.018496 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.018394    2557 scope.go:117] "RemoveContainer" containerID="633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751"
May 26 15:41:28.026542 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.026526    2557 scope.go:117] "RemoveContainer" containerID="bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9"
May 26 15:41:28.033086 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.033069    2557 scope.go:117] "RemoveContainer" containerID="7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973"
May 26 15:41:28.040415 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.040325    2557 scope.go:117] "RemoveContainer" containerID="1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f"
May 26 15:41:28.046497 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.046476    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"]
May 26 15:41:28.047128 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.047104    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dvhqv"]
May 26 15:41:28.051315 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.051298    2557 scope.go:117] "RemoveContainer" containerID="f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e"
May 26 15:41:28.057733 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.057714    2557 scope.go:117] "RemoveContainer" containerID="633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751"
May 26 15:41:28.057966 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:41:28.057949    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751\": container with ID starting with 633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751 not found: ID does not exist" containerID="633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751"
May 26 15:41:28.058010 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.057973    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751"} err="failed to get container status \"633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751\": rpc error: code = NotFound desc = could not find container \"633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751\": container with ID starting with 633448eb4b293384bd789e64331042e4a78872fdef46b8698c1785d09846a751 not found: ID does not exist"
May 26 15:41:28.058010 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.057990    2557 scope.go:117] "RemoveContainer" containerID="bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9"
May 26 15:41:28.058229 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:41:28.058211    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9\": container with ID starting with bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9 not found: ID does not exist" containerID="bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9"
May 26 15:41:28.058277 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.058233    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9"} err="failed to get container status \"bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9\": rpc error: code = NotFound desc = could not find container \"bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9\": container with ID starting with bd247a76783136b8b941c20b1d9bb9d9179f6cda6588afe4a62fc3df6432b1e9 not found: ID does not exist"
May 26 15:41:28.058277 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.058249    2557 scope.go:117] "RemoveContainer" containerID="7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973"
May 26 15:41:28.058459 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:41:28.058444    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973\": container with ID starting with 7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973 not found: ID does not exist" containerID="7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973"
May 26 15:41:28.058504 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.058463    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973"} err="failed to get container status \"7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973\": rpc error: code = NotFound desc = could not find container \"7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973\": container with ID starting with 7667aff54da35479812b2dd83d7ab885c9f7ab6f582de720a5a120310a5f1973 not found: ID does not exist"
May 26 15:41:28.058504 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.058477    2557 scope.go:117] "RemoveContainer" containerID="1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f"
May 26 15:41:28.058692 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:41:28.058678    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f\": container with ID starting with 1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f not found: ID does not exist" containerID="1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f"
May 26 15:41:28.058758 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.058695    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f"} err="failed to get container status \"1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f\": rpc error: code = NotFound desc = could not find container \"1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f\": container with ID starting with 1e5e73bda329b9214fbab7f485043d6859161ab03823492c4361929e7b64966f not found: ID does not exist"
May 26 15:41:28.058758 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.058707    2557 scope.go:117] "RemoveContainer" containerID="f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e"
May 26 15:41:28.058927 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:41:28.058913    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e\": container with ID starting with f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e not found: ID does not exist" containerID="f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e"
May 26 15:41:28.058976 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.058929    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e"} err="failed to get container status \"f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e\": rpc error: code = NotFound desc = could not find container \"f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e\": container with ID starting with f6242081c18d2da09d675bb60ec289d8cc92504321f5090b715f14576c819f3e not found: ID does not exist"
May 26 15:41:28.260689 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.260668    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:41:28.361228 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.361200    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c23a08-77d9-4b63-854a-f3f1914c72fd-feast-data\") pod \"74c23a08-77d9-4b63-854a-f3f1914c72fd\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") "
May 26 15:41:28.361347 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.361240    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-online-tls\") pod \"74c23a08-77d9-4b63-854a-f3f1914c72fd\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") "
May 26 15:41:28.361347 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.361273    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-offline-tls\") pod \"74c23a08-77d9-4b63-854a-f3f1914c72fd\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") "
May 26 15:41:28.361347 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.361305    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-registry-tls\") pod \"74c23a08-77d9-4b63-854a-f3f1914c72fd\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") "
May 26 15:41:28.361457 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.361372    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vlp5\" (UniqueName: \"kubernetes.io/projected/74c23a08-77d9-4b63-854a-f3f1914c72fd-kube-api-access-2vlp5\") pod \"74c23a08-77d9-4b63-854a-f3f1914c72fd\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") "
May 26 15:41:28.361457 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.361403    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-ui-tls\") pod \"74c23a08-77d9-4b63-854a-f3f1914c72fd\" (UID: \"74c23a08-77d9-4b63-854a-f3f1914c72fd\") "
May 26 15:41:28.361785 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.361735    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74c23a08-77d9-4b63-854a-f3f1914c72fd-feast-data" (OuterVolumeSpecName: "feast-data") pod "74c23a08-77d9-4b63-854a-f3f1914c72fd" (UID: "74c23a08-77d9-4b63-854a-f3f1914c72fd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:41:28.363459 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.363423    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74c23a08-77d9-4b63-854a-f3f1914c72fd" (UID: "74c23a08-77d9-4b63-854a-f3f1914c72fd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:41:28.363561 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.363481    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "74c23a08-77d9-4b63-854a-f3f1914c72fd" (UID: "74c23a08-77d9-4b63-854a-f3f1914c72fd"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:41:28.363561 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.363520    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "74c23a08-77d9-4b63-854a-f3f1914c72fd" (UID: "74c23a08-77d9-4b63-854a-f3f1914c72fd"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:41:28.363781 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.363762    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-online-tls" (OuterVolumeSpecName: "online-tls") pod "74c23a08-77d9-4b63-854a-f3f1914c72fd" (UID: "74c23a08-77d9-4b63-854a-f3f1914c72fd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:41:28.363849 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.363777    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74c23a08-77d9-4b63-854a-f3f1914c72fd-kube-api-access-2vlp5" (OuterVolumeSpecName: "kube-api-access-2vlp5") pod "74c23a08-77d9-4b63-854a-f3f1914c72fd" (UID: "74c23a08-77d9-4b63-854a-f3f1914c72fd"). InnerVolumeSpecName "kube-api-access-2vlp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:41:28.462043 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.462018    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vlp5\" (UniqueName: \"kubernetes.io/projected/74c23a08-77d9-4b63-854a-f3f1914c72fd-kube-api-access-2vlp5\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:28.462043 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.462041    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-ui-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:28.462173 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.462056    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c23a08-77d9-4b63-854a-f3f1914c72fd-feast-data\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:28.462173 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.462068    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-online-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:28.462173 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.462080    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-offline-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:28.462173 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:28.462092    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74c23a08-77d9-4b63-854a-f3f1914c72fd-registry-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:29.022983 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.022951    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"
May 26 15:41:29.023427 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.022953    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59" event={"ID":"74c23a08-77d9-4b63-854a-f3f1914c72fd","Type":"ContainerDied","Data":"6468e41a511c9e04fd13c94afac5dc15a94a911af3f41d7d5428e92a687ff883"}
May 26 15:41:29.023427 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.023075    2557 scope.go:117] "RemoveContainer" containerID="b830955b2a24c8aefcfd84482b291d0514c2847c6cfb031fc2c428e31a4eea93"
May 26 15:41:29.031337 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.031312    2557 scope.go:117] "RemoveContainer" containerID="937369876d31056caec35041254f869593aac8a43a44f0fcdf0d022b269746d7"
May 26 15:41:29.037924 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.037907    2557 scope.go:117] "RemoveContainer" containerID="30a424612917c839838b6df02c4dd6629aba82bec058dd20c9431c2e428dce2c"
May 26 15:41:29.043962 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.043942    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"]
May 26 15:41:29.044948 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.044931    2557 scope.go:117] "RemoveContainer" containerID="a01adfb1a70c8d761fe4f6dca264a94abaeedd1199dd42ba6b1f0f46118ba49c"
May 26 15:41:29.047369 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.047347    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-89s59"]
May 26 15:41:29.051779 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.051729    2557 scope.go:117] "RemoveContainer" containerID="920a5e70db4ebd51ba6ecba8e0305da78fafaa40b424bd99ea45afa7b2fb3392"
May 26 15:41:29.058140 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:29.058125    2557 scope.go:117] "RemoveContainer" containerID="8d5e96340c3f458ffc029072c19ffb8cfe492bd698416340bbe4917bb3a38c25"
May 26 15:41:30.041757 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:30.041720    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" path="/var/lib/kubelet/pods/1b3aa310-9b0a-403a-9046-2aa9e6c1a05e/volumes"
May 26 15:41:30.042256 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:30.042241    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" path="/var/lib/kubelet/pods/74c23a08-77d9-4b63-854a-f3f1914c72fd/volumes"
May 26 15:41:48.182994 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:48.182963    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"]
May 26 15:41:48.183337 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:48.183173    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp" podUID="4e45e8cb-76b9-486f-9e87-7785698ac516" containerName="manager" containerID="cri-o://fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df" gracePeriod=10
May 26 15:41:48.417030 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:48.417007    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"
May 26 15:41:48.495302 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:48.495231    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wg24\" (UniqueName: \"kubernetes.io/projected/4e45e8cb-76b9-486f-9e87-7785698ac516-kube-api-access-9wg24\") pod \"4e45e8cb-76b9-486f-9e87-7785698ac516\" (UID: \"4e45e8cb-76b9-486f-9e87-7785698ac516\") "
May 26 15:41:48.497237 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:48.497205    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e45e8cb-76b9-486f-9e87-7785698ac516-kube-api-access-9wg24" (OuterVolumeSpecName: "kube-api-access-9wg24") pod "4e45e8cb-76b9-486f-9e87-7785698ac516" (UID: "4e45e8cb-76b9-486f-9e87-7785698ac516"). InnerVolumeSpecName "kube-api-access-9wg24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:41:48.596323 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:48.596302    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wg24\" (UniqueName: \"kubernetes.io/projected/4e45e8cb-76b9-486f-9e87-7785698ac516-kube-api-access-9wg24\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:41:49.076819 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:49.076787    2557 generic.go:358] "Generic (PLEG): container finished" podID="4e45e8cb-76b9-486f-9e87-7785698ac516" containerID="fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df" exitCode=0
May 26 15:41:49.076984 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:49.076826    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp" event={"ID":"4e45e8cb-76b9-486f-9e87-7785698ac516","Type":"ContainerDied","Data":"fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df"}
May 26 15:41:49.076984 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:49.076844    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"
May 26 15:41:49.076984 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:49.076857    2557 scope.go:117] "RemoveContainer" containerID="fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df"
May 26 15:41:49.076984 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:49.076847    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp" event={"ID":"4e45e8cb-76b9-486f-9e87-7785698ac516","Type":"ContainerDied","Data":"466e25c2b3964af6643f8a969d535e93dc6d06fc4dda59fabed0f0c780c2d386"}
May 26 15:41:49.084472 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:49.084455    2557 scope.go:117] "RemoveContainer" containerID="fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df"
May 26 15:41:49.084777 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:41:49.084735    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df\": container with ID starting with fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df not found: ID does not exist" containerID="fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df"
May 26 15:41:49.084857 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:49.084782    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df"} err="failed to get container status \"fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df\": rpc error: code = NotFound desc = could not find container \"fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df\": container with ID starting with fe249f8868df7cbe5af6e373fd23a773bbd0f64c16a373d0ee336a8eff6a11df not found: ID does not exist"
May 26 15:41:49.097057 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:49.097032    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"]
May 26 15:41:49.100669 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:49.100649    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2bxlp"]
May 26 15:41:50.042431 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:41:50.042399    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e45e8cb-76b9-486f-9e87-7785698ac516" path="/var/lib/kubelet/pods/4e45e8cb-76b9-486f-9e87-7785698ac516/volumes"
May 26 15:42:08.060141 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060107    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"]
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060444    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="ui"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060463    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="ui"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060477    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="feast-apply"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060486    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="feast-apply"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060498    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e45e8cb-76b9-486f-9e87-7785698ac516" containerName="manager"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060506    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e45e8cb-76b9-486f-9e87-7785698ac516" containerName="manager"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060515    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="feast-apply"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060522    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="feast-apply"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060532    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="ui"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060540    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="ui"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060553    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="feast-init"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060560    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="feast-init"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060569    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="feast-init"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060577    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="feast-init"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060589    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="online"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060598    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="online"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060609    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="online"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060619    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="online"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060628    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="offline"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060636    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="offline"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060648    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="registry"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060656    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="registry"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060667    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="offline"
May 26 15:42:08.060715 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060675    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="offline"
May 26 15:42:08.061812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060735    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="online"
May 26 15:42:08.061812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060764    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="registry"
May 26 15:42:08.061812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060773    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="offline"
May 26 15:42:08.061812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060784    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="offline"
May 26 15:42:08.061812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060794    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="ui"
May 26 15:42:08.061812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060805    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b3aa310-9b0a-403a-9046-2aa9e6c1a05e" containerName="online"
May 26 15:42:08.061812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060814    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e45e8cb-76b9-486f-9e87-7785698ac516" containerName="manager"
May 26 15:42:08.061812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.060824    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="74c23a08-77d9-4b63-854a-f3f1914c72fd" containerName="ui"
May 26 15:42:08.063653 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.063634    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"
May 26 15:42:08.066081 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.066060    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-cwjsn\""
May 26 15:42:08.066183 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.066151    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 15:42:08.067124 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.067104    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 15:42:08.069584 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.069542    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"]
May 26 15:42:08.117596 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.117569    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg7xm\" (UniqueName: \"kubernetes.io/projected/13844bb0-3411-4fd2-8b88-a44c175eed4a-kube-api-access-hg7xm\") pod \"feast-operator-controller-manager-cf99db75-q9wrr\" (UID: \"13844bb0-3411-4fd2-8b88-a44c175eed4a\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"
May 26 15:42:08.218381 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.218354    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hg7xm\" (UniqueName: \"kubernetes.io/projected/13844bb0-3411-4fd2-8b88-a44c175eed4a-kube-api-access-hg7xm\") pod \"feast-operator-controller-manager-cf99db75-q9wrr\" (UID: \"13844bb0-3411-4fd2-8b88-a44c175eed4a\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"
May 26 15:42:08.226490 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.226472    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg7xm\" (UniqueName: \"kubernetes.io/projected/13844bb0-3411-4fd2-8b88-a44c175eed4a-kube-api-access-hg7xm\") pod \"feast-operator-controller-manager-cf99db75-q9wrr\" (UID: \"13844bb0-3411-4fd2-8b88-a44c175eed4a\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"
May 26 15:42:08.374860 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.374806    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"
May 26 15:42:08.494151 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.494123    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"]
May 26 15:42:08.497734 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:42:08.497708    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13844bb0_3411_4fd2_8b88_a44c175eed4a.slice/crio-628fb9212a587799fedcef3144183a5f61b75449cb077f76841b51f551e741e7 WatchSource:0}: Error finding container 628fb9212a587799fedcef3144183a5f61b75449cb077f76841b51f551e741e7: Status 404 returned error can't find the container with id 628fb9212a587799fedcef3144183a5f61b75449cb077f76841b51f551e741e7
May 26 15:42:08.499311 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:08.499296    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:42:09.131415 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:09.131380    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr" event={"ID":"13844bb0-3411-4fd2-8b88-a44c175eed4a","Type":"ContainerStarted","Data":"77d34e0ad7b961b8afc9741b80edbe77309aed5f138a7b7bcfe7ca722b5acfb9"}
May 26 15:42:09.131415 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:09.131416    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr" event={"ID":"13844bb0-3411-4fd2-8b88-a44c175eed4a","Type":"ContainerStarted","Data":"628fb9212a587799fedcef3144183a5f61b75449cb077f76841b51f551e741e7"}
May 26 15:42:09.131944 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:09.131504    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"
May 26 15:42:09.150617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:09.150572    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr" podStartSLOduration=1.150560612 podStartE2EDuration="1.150560612s" podCreationTimestamp="2026-05-26 15:42:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:42:09.149252776 +0000 UTC m=+1467.669796241" watchObservedRunningTime="2026-05-26 15:42:09.150560612 +0000 UTC m=+1467.671104080"
May 26 15:42:20.135316 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:20.135283    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-q9wrr"
May 26 15:42:25.939401 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.939360    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"]
May 26 15:42:25.943643 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.943626    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:25.946369 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.946345    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 15:42:25.946476 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.946430    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 15:42:25.946646 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.946631    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 15:42:25.946870 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.946852    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 15:42:25.946933 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.946882    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-k5bqw\""
May 26 15:42:25.946933 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.946888    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 15:42:25.947159 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.947143    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 15:42:25.953394 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:25.953372    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"]
May 26 15:42:26.032846 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.032820    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggxtv\" (UniqueName: \"kubernetes.io/projected/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-kube-api-access-ggxtv\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.032952 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.032849    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.032952 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.032868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.032952 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.032891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.033063 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.032958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.033063 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.033004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.133698 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.133668    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.133820 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.133709    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxtv\" (UniqueName: \"kubernetes.io/projected/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-kube-api-access-ggxtv\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.133820 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.133734    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.133820 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.133785    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.133968 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.133821    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.133968 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:42:26.133839    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 15:42:26.133968 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.133856    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.133968 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:42:26.133910    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-ui-tls podName:caa0ef9f-36e3-4f9a-befc-761e2a6a87c1 nodeName:}" failed. No retries permitted until 2026-05-26 15:42:26.633888483 +0000 UTC m=+1485.154431950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-8fznv" (UID: "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 15:42:26.134190 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.134170    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.136339 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.136319    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.136447 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.136339    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.136447 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.136380    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.145551 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.145522    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggxtv\" (UniqueName: \"kubernetes.io/projected/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-kube-api-access-ggxtv\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.636951 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.636920    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.639179 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.639157    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-8fznv\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.851974 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.851944    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:26.978296 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:26.978274    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"]
May 26 15:42:26.980272 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:42:26.980240    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaa0ef9f_36e3_4f9a_befc_761e2a6a87c1.slice/crio-86dd027fb31f931a70929b023cd217bfa0bd8152e00196d044953b41c8999c59 WatchSource:0}: Error finding container 86dd027fb31f931a70929b023cd217bfa0bd8152e00196d044953b41c8999c59: Status 404 returned error can't find the container with id 86dd027fb31f931a70929b023cd217bfa0bd8152e00196d044953b41c8999c59
May 26 15:42:27.178462 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:27.178388    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerStarted","Data":"58aea188e3ac25e68c482b6f2e0c8941aa2761c7c7e988cfb6cc5bc9a4584d3f"}
May 26 15:42:27.178462 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:27.178423    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerStarted","Data":"86dd027fb31f931a70929b023cd217bfa0bd8152e00196d044953b41c8999c59"}
May 26 15:42:32.191842 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:32.191806    2557 generic.go:358] "Generic (PLEG): container finished" podID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerID="58aea188e3ac25e68c482b6f2e0c8941aa2761c7c7e988cfb6cc5bc9a4584d3f" exitCode=0
May 26 15:42:32.192212 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:32.191881    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerDied","Data":"58aea188e3ac25e68c482b6f2e0c8941aa2761c7c7e988cfb6cc5bc9a4584d3f"}
May 26 15:42:33.196232 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:33.196196    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerStarted","Data":"087d9ea9acc81d0bfe4431452d9feae1008081d123582e1a5e8204d235b3601e"}
May 26 15:42:38.211576 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:38.211545    2557 generic.go:358] "Generic (PLEG): container finished" podID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerID="087d9ea9acc81d0bfe4431452d9feae1008081d123582e1a5e8204d235b3601e" exitCode=0
May 26 15:42:38.211961 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:38.211619    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerDied","Data":"087d9ea9acc81d0bfe4431452d9feae1008081d123582e1a5e8204d235b3601e"}
May 26 15:42:39.218233 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:39.218181    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerStarted","Data":"fb26896aa510096f5a260a61fb8257e12b956f4ea81b1571848232e9653b3b6a"}
May 26 15:42:39.218233 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:39.218238    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerStarted","Data":"f9f01149984b2a853880f5612421f01f4c8bdc83a8501c92d3474255140b8b9c"}
May 26 15:42:39.219063 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:39.218256    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerStarted","Data":"769b7149805db2983fcb38290684bf302236f4a73ac6528b9cc08c5e889442f0"}
May 26 15:42:39.219063 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:39.218270    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerStarted","Data":"44978fd37c957cadeda7d536e37250352100a81574c3c35a97c2c36c92f20718"}
May 26 15:42:39.244983 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:39.244926    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podStartSLOduration=14.244904643 podStartE2EDuration="14.244904643s" podCreationTimestamp="2026-05-26 15:42:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:42:39.242184673 +0000 UTC m=+1497.762728140" watchObservedRunningTime="2026-05-26 15:42:39.244904643 +0000 UTC m=+1497.765448110"
May 26 15:42:41.852714 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:41.852682    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:41.853189 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:41.852734    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:41.853189 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:41.852777    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:41.853189 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:41.852790    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:41.854585 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:41.854546    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused"
May 26 15:42:41.854585 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:41.854568    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
May 26 15:42:41.854823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:41.854575    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused"
May 26 15:42:41.854823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:41.854626    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
May 26 15:42:42.073386 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:42.073354    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:42:42.076694 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:42.076673    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:42:44.853702 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.853660    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:44.854198 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.853858    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:44.854198 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.854112    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:44.854313 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.854207    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:44.854617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.854515    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:44.854617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.854547    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:44.854617 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.854605    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:44.854874 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.854643    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:44.854874 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.854776    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:44.858376 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:44.858356    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:45.237598 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:45.237515    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:42:45.240509 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:42:45.240490    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:43:47.973454 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:47.973414    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"]
May 26 15:43:47.973907 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:47.973752    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="registry" containerID="cri-o://44978fd37c957cadeda7d536e37250352100a81574c3c35a97c2c36c92f20718" gracePeriod=30
May 26 15:43:47.973907 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:47.973792    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="ui" containerID="cri-o://fb26896aa510096f5a260a61fb8257e12b956f4ea81b1571848232e9653b3b6a" gracePeriod=30
May 26 15:43:47.973907 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:47.973841    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="online" containerID="cri-o://769b7149805db2983fcb38290684bf302236f4a73ac6528b9cc08c5e889442f0" gracePeriod=30
May 26 15:43:47.973907 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:47.973829    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="offline" containerID="cri-o://f9f01149984b2a853880f5612421f01f4c8bdc83a8501c92d3474255140b8b9c" gracePeriod=30
May 26 15:43:48.276979 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.276894    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"]
May 26 15:43:48.280667 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.280646    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.283519 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.283500    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tmj87\""
May 26 15:43:48.294608 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.294584    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"]
May 26 15:43:48.299776 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.299726    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.299924 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.299806    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.299924 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.299874    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p46gz\" (UniqueName: \"kubernetes.io/projected/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-kube-api-access-p46gz\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.299924 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.299910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.300024 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.299941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.300024 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.299969    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.400550 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.400511    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.400550 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.400567    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.400826 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.400640    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p46gz\" (UniqueName: \"kubernetes.io/projected/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-kube-api-access-p46gz\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.400826 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.400672    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.400826 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.400700    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.400826 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.400724    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.400826 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:43:48.400752    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 15:43:48.400826 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:43:48.400825    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-ui-tls podName:5dfef5f6-f736-4efe-a83a-c6ca441aaf2d nodeName:}" failed. No retries permitted until 2026-05-26 15:43:48.900800051 +0000 UTC m=+1567.421343510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-ztmkb" (UID: "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 15:43:48.401099 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:43:48.400969    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 26 15:43:48.401099 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.400989    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.401099 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:43:48.401032    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-offline-tls podName:5dfef5f6-f736-4efe-a83a-c6ca441aaf2d nodeName:}" failed. No retries permitted until 2026-05-26 15:43:48.901013234 +0000 UTC m=+1567.421556690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-ztmkb" (UID: "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d") : secret "feast-simple-feast-setup-offline-tls" not found
May 26 15:43:48.403537 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.403495    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.403774 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.403727    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.412503 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.412472    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p46gz\" (UniqueName: \"kubernetes.io/projected/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-kube-api-access-p46gz\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.904121 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.904044    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.904121 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.904103    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.906351 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.906327    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:48.906461 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:48.906378    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-ztmkb\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:49.191856 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:49.191787    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:43:49.318209 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:49.318181    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"]
May 26 15:43:49.319107 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:43:49.319083    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dfef5f6_f736_4efe_a83a_c6ca441aaf2d.slice/crio-8e48ab1f689e2845eab8fb044b207d906c210d402bdcac2f5805479f75d11490 WatchSource:0}: Error finding container 8e48ab1f689e2845eab8fb044b207d906c210d402bdcac2f5805479f75d11490: Status 404 returned error can't find the container with id 8e48ab1f689e2845eab8fb044b207d906c210d402bdcac2f5805479f75d11490
May 26 15:43:49.407010 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:49.406977    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerStarted","Data":"109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4"}
May 26 15:43:49.407129 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:49.407015    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerStarted","Data":"8e48ab1f689e2845eab8fb044b207d906c210d402bdcac2f5805479f75d11490"}
May 26 15:43:49.409846 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:49.409820    2557 generic.go:358] "Generic (PLEG): container finished" podID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerID="fb26896aa510096f5a260a61fb8257e12b956f4ea81b1571848232e9653b3b6a" exitCode=0
May 26 15:43:49.409846 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:49.409843    2557 generic.go:358] "Generic (PLEG): container finished" podID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerID="769b7149805db2983fcb38290684bf302236f4a73ac6528b9cc08c5e889442f0" exitCode=0
May 26 15:43:49.410017 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:49.409877    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerDied","Data":"fb26896aa510096f5a260a61fb8257e12b956f4ea81b1571848232e9653b3b6a"}
May 26 15:43:49.410017 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:49.409894    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerDied","Data":"769b7149805db2983fcb38290684bf302236f4a73ac6528b9cc08c5e889442f0"}
May 26 15:43:54.423359 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:54.423327    2557 generic.go:358] "Generic (PLEG): container finished" podID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerID="109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4" exitCode=0
May 26 15:43:54.423762 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:54.423400    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerDied","Data":"109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4"}
May 26 15:43:54.855174 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:54.855124    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
May 26 15:43:55.238793 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:55.238689    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
May 26 15:43:55.428045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:43:55.428008    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerStarted","Data":"85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb"}
May 26 15:44:00.443929 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:00.443898    2557 generic.go:358] "Generic (PLEG): container finished" podID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerID="85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb" exitCode=0
May 26 15:44:00.444275 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:00.443971    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerDied","Data":"85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb"}
May 26 15:44:01.456095 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:01.456054    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerStarted","Data":"489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51"}
May 26 15:44:01.456580 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:01.456104    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerStarted","Data":"669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c"}
May 26 15:44:01.456580 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:01.456122    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerStarted","Data":"6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b"}
May 26 15:44:01.456580 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:01.456135    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerStarted","Data":"3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4"}
May 26 15:44:01.486257 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:01.486186    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podStartSLOduration=13.486162407 podStartE2EDuration="13.486162407s" podCreationTimestamp="2026-05-26 15:43:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:44:01.484632165 +0000 UTC m=+1580.005175644" watchObservedRunningTime="2026-05-26 15:44:01.486162407 +0000 UTC m=+1580.006705875"
May 26 15:44:04.193021 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:04.192977    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:04.193503 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:04.193031    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:04.193503 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:04.193046    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:04.193503 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:04.193057    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:04.195012 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:04.194976    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
May 26 15:44:04.195149 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:04.195006    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
May 26 15:44:04.195149 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:04.195047    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
May 26 15:44:04.195328 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:04.195287    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused"
May 26 15:44:04.854987 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:04.854878    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
May 26 15:44:05.238546 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:05.238434    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
May 26 15:44:07.193519 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.193479    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.193977 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.193656    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.193977 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.193793    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.194277 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.194249    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.194401 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.194286    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.194401 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.194300    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.194555 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.194534    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.194627 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.194579    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.194670 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.194657    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.198312 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.198292    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.477059 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.476989    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:07.479828 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:07.479808    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:44:14.855081 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:14.855037    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
May 26 15:44:14.855514 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:14.855199    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:44:15.237994 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:15.237902    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
May 26 15:44:15.238156 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:15.238021    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:44:18.509050 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.509021    2557 generic.go:358] "Generic (PLEG): container finished" podID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerID="f9f01149984b2a853880f5612421f01f4c8bdc83a8501c92d3474255140b8b9c" exitCode=137
May 26 15:44:18.509050 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.509046    2557 generic.go:358] "Generic (PLEG): container finished" podID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerID="44978fd37c957cadeda7d536e37250352100a81574c3c35a97c2c36c92f20718" exitCode=137
May 26 15:44:18.509403 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.509103    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerDied","Data":"f9f01149984b2a853880f5612421f01f4c8bdc83a8501c92d3474255140b8b9c"}
May 26 15:44:18.509403 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.509145    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerDied","Data":"44978fd37c957cadeda7d536e37250352100a81574c3c35a97c2c36c92f20718"}
May 26 15:44:18.621144 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.621120    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:44:18.729935 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.729902    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggxtv\" (UniqueName: \"kubernetes.io/projected/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-kube-api-access-ggxtv\") pod \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") "
May 26 15:44:18.730081 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.729959    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-ui-tls\") pod \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") "
May 26 15:44:18.730081 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.729986    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-registry-tls\") pod \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") "
May 26 15:44:18.730081 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.730008    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-feast-data\") pod \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") "
May 26 15:44:18.730081 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.730055    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-offline-tls\") pod \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") "
May 26 15:44:18.730081 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.730082    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-online-tls\") pod \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\" (UID: \"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1\") "
May 26 15:44:18.730605 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.730574    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-feast-data" (OuterVolumeSpecName: "feast-data") pod "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" (UID: "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:44:18.732343 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.732309    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" (UID: "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:44:18.732441 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.732359    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-kube-api-access-ggxtv" (OuterVolumeSpecName: "kube-api-access-ggxtv") pod "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" (UID: "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1"). InnerVolumeSpecName "kube-api-access-ggxtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:44:18.732441 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.732393    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-online-tls" (OuterVolumeSpecName: "online-tls") pod "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" (UID: "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:44:18.732550 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.732476    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" (UID: "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:44:18.732550 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.732492    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" (UID: "caa0ef9f-36e3-4f9a-befc-761e2a6a87c1"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:44:18.830982 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.830958    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-offline-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:44:18.830982 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.830982    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-online-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:44:18.831123 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.830997    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggxtv\" (UniqueName: \"kubernetes.io/projected/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-kube-api-access-ggxtv\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:44:18.831123 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.831009    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-ui-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:44:18.831123 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.831022    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-registry-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:44:18.831123 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:18.831034    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1-feast-data\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:44:19.513914 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.513881    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv" event={"ID":"caa0ef9f-36e3-4f9a-befc-761e2a6a87c1","Type":"ContainerDied","Data":"86dd027fb31f931a70929b023cd217bfa0bd8152e00196d044953b41c8999c59"}
May 26 15:44:19.513914 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.513898    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"
May 26 15:44:19.513914 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.513923    2557 scope.go:117] "RemoveContainer" containerID="fb26896aa510096f5a260a61fb8257e12b956f4ea81b1571848232e9653b3b6a"
May 26 15:44:19.523876 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.523855    2557 scope.go:117] "RemoveContainer" containerID="f9f01149984b2a853880f5612421f01f4c8bdc83a8501c92d3474255140b8b9c"
May 26 15:44:19.530378 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.530363    2557 scope.go:117] "RemoveContainer" containerID="769b7149805db2983fcb38290684bf302236f4a73ac6528b9cc08c5e889442f0"
May 26 15:44:19.537374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.537336    2557 scope.go:117] "RemoveContainer" containerID="44978fd37c957cadeda7d536e37250352100a81574c3c35a97c2c36c92f20718"
May 26 15:44:19.537564 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.537541    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"]
May 26 15:44:19.540646 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.540626    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-8fznv"]
May 26 15:44:19.544115 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.544100    2557 scope.go:117] "RemoveContainer" containerID="087d9ea9acc81d0bfe4431452d9feae1008081d123582e1a5e8204d235b3601e"
May 26 15:44:19.550466 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:19.550449    2557 scope.go:117] "RemoveContainer" containerID="58aea188e3ac25e68c482b6f2e0c8941aa2761c7c7e988cfb6cc5bc9a4584d3f"
May 26 15:44:20.042290 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:44:20.042256    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" path="/var/lib/kubelet/pods/caa0ef9f-36e3-4f9a-befc-761e2a6a87c1/volumes"
May 26 15:45:09.823840 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.823805    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"]
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824063    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="feast-apply"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824075    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="feast-apply"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824086    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="online"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824092    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="online"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824108    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="registry"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824113    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="registry"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824125    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="feast-init"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824130    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="feast-init"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824136    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="offline"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824141    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="offline"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824149    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="ui"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824154    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="ui"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824195    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="online"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824203    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="offline"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824211    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="registry"
May 26 15:45:09.824380 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.824218    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="caa0ef9f-36e3-4f9a-befc-761e2a6a87c1" containerName="ui"
May 26 15:45:09.827234 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.827218    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:09.829887 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.829864    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 15:45:09.830045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.829906    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 15:45:09.830045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.829968    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 15:45:09.830045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.829998    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 15:45:09.830045 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.829999    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-796hd\""
May 26 15:45:09.830252 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.830118    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 15:45:09.830252 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.830192    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 15:45:09.837863 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.837835    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"]
May 26 15:45:09.974227 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.974202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:09.974352 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.974228    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/08617e01-ca2a-403d-932d-27e1b1ca86d8-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:09.974352 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.974253    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:09.974352 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.974291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:09.974513 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.974378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/08617e01-ca2a-403d-932d-27e1b1ca86d8-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:09.974513 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:09.974417    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n7hh\" (UniqueName: \"kubernetes.io/projected/08617e01-ca2a-403d-932d-27e1b1ca86d8-kube-api-access-6n7hh\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.074923 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.074856    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.074923 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.074883    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/08617e01-ca2a-403d-932d-27e1b1ca86d8-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.074923 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.074905    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.074923 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.074925    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.075224 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.074970    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/08617e01-ca2a-403d-932d-27e1b1ca86d8-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.075224 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.075003    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6n7hh\" (UniqueName: \"kubernetes.io/projected/08617e01-ca2a-403d-932d-27e1b1ca86d8-kube-api-access-6n7hh\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.075224 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:45:10.075019    2557 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 15:45:10.075224 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:45:10.075092    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-ui-tls podName:08617e01-ca2a-403d-932d-27e1b1ca86d8 nodeName:}" failed. No retries permitted until 2026-05-26 15:45:10.575069838 +0000 UTC m=+1649.095613302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-ui-tls") pod "feast-simple-feast-remote-setup-5cff94746b-d5qd9" (UID: "08617e01-ca2a-403d-932d-27e1b1ca86d8") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 15:45:10.075445 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.075297    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/08617e01-ca2a-403d-932d-27e1b1ca86d8-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.075618 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.075602    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/08617e01-ca2a-403d-932d-27e1b1ca86d8-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.077282 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.077264    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.077450 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.077430    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.085609 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.085583    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n7hh\" (UniqueName: \"kubernetes.io/projected/08617e01-ca2a-403d-932d-27e1b1ca86d8-kube-api-access-6n7hh\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.579806 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.579770    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.581953 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.581935    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-d5qd9\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.737333 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.737297    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:10.864118 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:10.864088    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"]
May 26 15:45:10.864845 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:45:10.864823    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08617e01_ca2a_403d_932d_27e1b1ca86d8.slice/crio-9f8394e25d5bdf82969b86de1b59f14ca5bb7592439572d6f11951f2cb7a7df9 WatchSource:0}: Error finding container 9f8394e25d5bdf82969b86de1b59f14ca5bb7592439572d6f11951f2cb7a7df9: Status 404 returned error can't find the container with id 9f8394e25d5bdf82969b86de1b59f14ca5bb7592439572d6f11951f2cb7a7df9
May 26 15:45:11.649987 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:11.649952    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerStarted","Data":"ce820e85e3dfe1f700f893cf62948a74c48504edb85ff2b29891d7c36ea93636"}
May 26 15:45:11.649987 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:11.649989    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerStarted","Data":"9f8394e25d5bdf82969b86de1b59f14ca5bb7592439572d6f11951f2cb7a7df9"}
May 26 15:45:15.662038 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:15.661964    2557 generic.go:358] "Generic (PLEG): container finished" podID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerID="ce820e85e3dfe1f700f893cf62948a74c48504edb85ff2b29891d7c36ea93636" exitCode=0
May 26 15:45:15.662038 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:15.662021    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerDied","Data":"ce820e85e3dfe1f700f893cf62948a74c48504edb85ff2b29891d7c36ea93636"}
May 26 15:45:16.666157 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:16.666124    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerStarted","Data":"98cb70cbd4e3aa8ddf2f3154d3e2e3b5dd9c2085613245d5f8da86403db04f40"}
May 26 15:45:21.682142 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:21.682112    2557 generic.go:358] "Generic (PLEG): container finished" podID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerID="98cb70cbd4e3aa8ddf2f3154d3e2e3b5dd9c2085613245d5f8da86403db04f40" exitCode=0
May 26 15:45:21.682496 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:21.682173    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerDied","Data":"98cb70cbd4e3aa8ddf2f3154d3e2e3b5dd9c2085613245d5f8da86403db04f40"}
May 26 15:45:22.688379 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.688345    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerStarted","Data":"775addb2531d59e1a113c6e85f0f7b95ae2b8b5165bea2414c42f15aa21c0782"}
May 26 15:45:22.688379 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.688383    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerStarted","Data":"fbaa89d4adea8d18625641b90178a29703c33fb7e802c3caa57e7c29551d2910"}
May 26 15:45:22.688916 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.688393    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerStarted","Data":"ff35640592a9a5628c74a1c6704b44ac22562338218abed0f2c2ae9087cb35d1"}
May 26 15:45:22.714381 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.713213    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podStartSLOduration=13.713195161 podStartE2EDuration="13.713195161s" podCreationTimestamp="2026-05-26 15:45:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:45:22.711328559 +0000 UTC m=+1661.231872026" watchObservedRunningTime="2026-05-26 15:45:22.713195161 +0000 UTC m=+1661.233738631"
May 26 15:45:22.738300 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.738275    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:22.738498 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.738469    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:22.738600 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.738525    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:22.740282 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.740250    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
May 26 15:45:22.740402 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.740280    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused"
May 26 15:45:22.740402 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:22.740311    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
May 26 15:45:25.738467 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:25.738423    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused"
May 26 15:45:25.738939 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:25.738429    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
May 26 15:45:25.738939 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:25.738424    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
May 26 15:45:28.739374 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:28.739346    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:28.739755 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:28.739440    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:28.739823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:28.739767    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:28.739823 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:28.739797    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:28.740197 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:28.740174    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:28.740277 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:28.740237    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:28.743357 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:28.743334    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:29.710504 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:29.710476    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:45:29.713200 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:45:29.713169    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:46:30.811190 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:30.811156    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"]
May 26 15:46:30.811678 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:30.811574    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="online" containerID="cri-o://ff35640592a9a5628c74a1c6704b44ac22562338218abed0f2c2ae9087cb35d1" gracePeriod=30
May 26 15:46:30.811961 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:30.811735    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="ui" containerID="cri-o://775addb2531d59e1a113c6e85f0f7b95ae2b8b5165bea2414c42f15aa21c0782" gracePeriod=30
May 26 15:46:30.811961 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:30.811811    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="offline" containerID="cri-o://fbaa89d4adea8d18625641b90178a29703c33fb7e802c3caa57e7c29551d2910" gracePeriod=30
May 26 15:46:30.980839 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:30.980804    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"]
May 26 15:46:30.981332 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:30.981280    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="registry" containerID="cri-o://3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4" gracePeriod=30
May 26 15:46:30.981456 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:30.981331    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="ui" containerID="cri-o://489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51" gracePeriod=30
May 26 15:46:30.981456 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:30.981308    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="online" containerID="cri-o://6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b" gracePeriod=30
May 26 15:46:30.981456 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:30.981299    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="offline" containerID="cri-o://669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c" gracePeriod=30
May 26 15:46:31.878537 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:31.878508    2557 generic.go:358] "Generic (PLEG): container finished" podID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerID="489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51" exitCode=0
May 26 15:46:31.878537 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:31.878532    2557 generic.go:358] "Generic (PLEG): container finished" podID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerID="6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b" exitCode=0
May 26 15:46:31.878944 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:31.878576    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerDied","Data":"489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51"}
May 26 15:46:31.878944 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:31.878609    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerDied","Data":"6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b"}
May 26 15:46:31.880844 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:31.880818    2557 generic.go:358] "Generic (PLEG): container finished" podID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerID="775addb2531d59e1a113c6e85f0f7b95ae2b8b5165bea2414c42f15aa21c0782" exitCode=0
May 26 15:46:31.880844 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:31.880844    2557 generic.go:358] "Generic (PLEG): container finished" podID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerID="ff35640592a9a5628c74a1c6704b44ac22562338218abed0f2c2ae9087cb35d1" exitCode=0
May 26 15:46:31.880987 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:31.880880    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerDied","Data":"775addb2531d59e1a113c6e85f0f7b95ae2b8b5165bea2414c42f15aa21c0782"}
May 26 15:46:31.880987 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:31.880903    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerDied","Data":"ff35640592a9a5628c74a1c6704b44ac22562338218abed0f2c2ae9087cb35d1"}
May 26 15:46:37.194396 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:37.194351    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
May 26 15:46:37.477556 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:37.477475    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
May 26 15:46:38.740795 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:38.740722    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
May 26 15:46:39.711052 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:39.711013    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
May 26 15:46:47.195270 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:47.195225    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
May 26 15:46:47.478097 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:47.478017    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
May 26 15:46:48.740845 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:48.740806    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
May 26 15:46:49.710989 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:49.710952    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
May 26 15:46:57.194639 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:57.194597    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
May 26 15:46:57.195182 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:57.194771    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:46:57.478109 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:57.478025    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
May 26 15:46:57.478269 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:57.478147    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:46:58.740601 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:58.740560    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
May 26 15:46:58.741071 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:58.740680    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:46:59.711288 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:59.711251    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
May 26 15:46:59.711472 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:46:59.711368    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:47:00.957938 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:00.957909    2557 generic.go:358] "Generic (PLEG): container finished" podID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerID="fbaa89d4adea8d18625641b90178a29703c33fb7e802c3caa57e7c29551d2910" exitCode=137
May 26 15:47:00.958232 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:00.957950    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerDied","Data":"fbaa89d4adea8d18625641b90178a29703c33fb7e802c3caa57e7c29551d2910"}
May 26 15:47:01.453561 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.453536    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:47:01.540019 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.539992    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/08617e01-ca2a-403d-932d-27e1b1ca86d8-feast-data\") pod \"08617e01-ca2a-403d-932d-27e1b1ca86d8\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") "
May 26 15:47:01.540164 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.540032    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-online-tls\") pod \"08617e01-ca2a-403d-932d-27e1b1ca86d8\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") "
May 26 15:47:01.540164 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.540054    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/08617e01-ca2a-403d-932d-27e1b1ca86d8-registry-tls\") pod \"08617e01-ca2a-403d-932d-27e1b1ca86d8\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") "
May 26 15:47:01.540164 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.540122    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-ui-tls\") pod \"08617e01-ca2a-403d-932d-27e1b1ca86d8\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") "
May 26 15:47:01.540333 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.540276    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n7hh\" (UniqueName: \"kubernetes.io/projected/08617e01-ca2a-403d-932d-27e1b1ca86d8-kube-api-access-6n7hh\") pod \"08617e01-ca2a-403d-932d-27e1b1ca86d8\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") "
May 26 15:47:01.540390 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.540355    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-offline-tls\") pod \"08617e01-ca2a-403d-932d-27e1b1ca86d8\" (UID: \"08617e01-ca2a-403d-932d-27e1b1ca86d8\") "
May 26 15:47:01.540488 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.540439    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08617e01-ca2a-403d-932d-27e1b1ca86d8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "08617e01-ca2a-403d-932d-27e1b1ca86d8" (UID: "08617e01-ca2a-403d-932d-27e1b1ca86d8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:47:01.540488 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.540481    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08617e01-ca2a-403d-932d-27e1b1ca86d8-feast-data" (OuterVolumeSpecName: "feast-data") pod "08617e01-ca2a-403d-932d-27e1b1ca86d8" (UID: "08617e01-ca2a-403d-932d-27e1b1ca86d8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:47:01.540684 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.540592    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/08617e01-ca2a-403d-932d-27e1b1ca86d8-feast-data\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.540684 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.540612    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/08617e01-ca2a-403d-932d-27e1b1ca86d8-registry-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.542228 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.542201    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-online-tls" (OuterVolumeSpecName: "online-tls") pod "08617e01-ca2a-403d-932d-27e1b1ca86d8" (UID: "08617e01-ca2a-403d-932d-27e1b1ca86d8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:47:01.542323 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.542251    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "08617e01-ca2a-403d-932d-27e1b1ca86d8" (UID: "08617e01-ca2a-403d-932d-27e1b1ca86d8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:47:01.542790 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.542759    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08617e01-ca2a-403d-932d-27e1b1ca86d8-kube-api-access-6n7hh" (OuterVolumeSpecName: "kube-api-access-6n7hh") pod "08617e01-ca2a-403d-932d-27e1b1ca86d8" (UID: "08617e01-ca2a-403d-932d-27e1b1ca86d8"). InnerVolumeSpecName "kube-api-access-6n7hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:47:01.542863 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.542818    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "08617e01-ca2a-403d-932d-27e1b1ca86d8" (UID: "08617e01-ca2a-403d-932d-27e1b1ca86d8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:47:01.620381 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.620360    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:47:01.641949 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.641924    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-ui-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.641949 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.641947    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n7hh\" (UniqueName: \"kubernetes.io/projected/08617e01-ca2a-403d-932d-27e1b1ca86d8-kube-api-access-6n7hh\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.642080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.641962    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-offline-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.642080 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.641977    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/08617e01-ca2a-403d-932d-27e1b1ca86d8-online-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.742619 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.742585    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-registry-tls\") pod \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") "
May 26 15:47:01.742774 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.742630    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-feast-data\") pod \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") "
May 26 15:47:01.742774 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.742646    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-online-tls\") pod \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") "
May 26 15:47:01.742774 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.742664    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-ui-tls\") pod \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") "
May 26 15:47:01.742774 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.742718    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p46gz\" (UniqueName: \"kubernetes.io/projected/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-kube-api-access-p46gz\") pod \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") "
May 26 15:47:01.742774 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.742734    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-offline-tls\") pod \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\" (UID: \"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d\") "
May 26 15:47:01.743172 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.743150    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-feast-data" (OuterVolumeSpecName: "feast-data") pod "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" (UID: "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:47:01.744687 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.744663    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" (UID: "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:47:01.745103 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.745086    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" (UID: "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:47:01.745174 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.745135    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-online-tls" (OuterVolumeSpecName: "online-tls") pod "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" (UID: "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:47:01.745240 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.745217    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" (UID: "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:47:01.745284 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.745215    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-kube-api-access-p46gz" (OuterVolumeSpecName: "kube-api-access-p46gz") pod "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" (UID: "5dfef5f6-f736-4efe-a83a-c6ca441aaf2d"). InnerVolumeSpecName "kube-api-access-p46gz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:47:01.843677 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.843645    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-feast-data\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.843677 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.843677    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-online-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.843677 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.843686    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-ui-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.843845 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.843696    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p46gz\" (UniqueName: \"kubernetes.io/projected/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-kube-api-access-p46gz\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.843845 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.843706    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-offline-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.843845 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.843715    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d-registry-tls\") on node \"ip-10-0-142-253.ec2.internal\" DevicePath \"\""
May 26 15:47:01.963302 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.963241    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"
May 26 15:47:01.963645 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.963245    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9" event={"ID":"08617e01-ca2a-403d-932d-27e1b1ca86d8","Type":"ContainerDied","Data":"9f8394e25d5bdf82969b86de1b59f14ca5bb7592439572d6f11951f2cb7a7df9"}
May 26 15:47:01.963645 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.963378    2557 scope.go:117] "RemoveContainer" containerID="775addb2531d59e1a113c6e85f0f7b95ae2b8b5165bea2414c42f15aa21c0782"
May 26 15:47:01.965941 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.965918    2557 generic.go:358] "Generic (PLEG): container finished" podID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerID="669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c" exitCode=137
May 26 15:47:01.965941 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.965941    2557 generic.go:358] "Generic (PLEG): container finished" podID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerID="3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4" exitCode=137
May 26 15:47:01.966056 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.965992    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"
May 26 15:47:01.966056 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.966000    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerDied","Data":"669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c"}
May 26 15:47:01.966056 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.966036    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerDied","Data":"3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4"}
May 26 15:47:01.966056 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.966048    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb" event={"ID":"5dfef5f6-f736-4efe-a83a-c6ca441aaf2d","Type":"ContainerDied","Data":"8e48ab1f689e2845eab8fb044b207d906c210d402bdcac2f5805479f75d11490"}
May 26 15:47:01.971765 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.971729    2557 scope.go:117] "RemoveContainer" containerID="fbaa89d4adea8d18625641b90178a29703c33fb7e802c3caa57e7c29551d2910"
May 26 15:47:01.979918 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.979903    2557 scope.go:117] "RemoveContainer" containerID="ff35640592a9a5628c74a1c6704b44ac22562338218abed0f2c2ae9087cb35d1"
May 26 15:47:01.986182 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.986166    2557 scope.go:117] "RemoveContainer" containerID="98cb70cbd4e3aa8ddf2f3154d3e2e3b5dd9c2085613245d5f8da86403db04f40"
May 26 15:47:01.988637 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.988616    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"]
May 26 15:47:01.993140 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.993117    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-d5qd9"]
May 26 15:47:01.993707 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:01.993687    2557 scope.go:117] "RemoveContainer" containerID="ce820e85e3dfe1f700f893cf62948a74c48504edb85ff2b29891d7c36ea93636"
May 26 15:47:02.000125 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.000103    2557 scope.go:117] "RemoveContainer" containerID="489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51"
May 26 15:47:02.006220 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.006193    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"]
May 26 15:47:02.007430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.007413    2557 scope.go:117] "RemoveContainer" containerID="669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c"
May 26 15:47:02.009721 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.009702    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-ztmkb"]
May 26 15:47:02.014328 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.014311    2557 scope.go:117] "RemoveContainer" containerID="6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b"
May 26 15:47:02.020595 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.020580    2557 scope.go:117] "RemoveContainer" containerID="3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4"
May 26 15:47:02.026812 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.026794    2557 scope.go:117] "RemoveContainer" containerID="85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb"
May 26 15:47:02.033702 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.033683    2557 scope.go:117] "RemoveContainer" containerID="109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4"
May 26 15:47:02.041046 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.041032    2557 scope.go:117] "RemoveContainer" containerID="489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51"
May 26 15:47:02.041291 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:47:02.041273    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51\": container with ID starting with 489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51 not found: ID does not exist" containerID="489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51"
May 26 15:47:02.041344 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.041298    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51"} err="failed to get container status \"489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51\": rpc error: code = NotFound desc = could not find container \"489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51\": container with ID starting with 489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51 not found: ID does not exist"
May 26 15:47:02.041344 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.041322    2557 scope.go:117] "RemoveContainer" containerID="669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c"
May 26 15:47:02.041563 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:47:02.041544    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c\": container with ID starting with 669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c not found: ID does not exist" containerID="669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c"
May 26 15:47:02.041615 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.041568    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c"} err="failed to get container status \"669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c\": rpc error: code = NotFound desc = could not find container \"669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c\": container with ID starting with 669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c not found: ID does not exist"
May 26 15:47:02.041615 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.041584    2557 scope.go:117] "RemoveContainer" containerID="6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b"
May 26 15:47:02.041824 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:47:02.041807    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b\": container with ID starting with 6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b not found: ID does not exist" containerID="6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b"
May 26 15:47:02.041902 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.041831    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b"} err="failed to get container status \"6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b\": rpc error: code = NotFound desc = could not find container \"6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b\": container with ID starting with 6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b not found: ID does not exist"
May 26 15:47:02.041902 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.041853    2557 scope.go:117] "RemoveContainer" containerID="3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4"
May 26 15:47:02.042063 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:47:02.042046    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4\": container with ID starting with 3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4 not found: ID does not exist" containerID="3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4"
May 26 15:47:02.042124 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042069    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4"} err="failed to get container status \"3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4\": rpc error: code = NotFound desc = could not find container \"3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4\": container with ID starting with 3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4 not found: ID does not exist"
May 26 15:47:02.042124 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042088    2557 scope.go:117] "RemoveContainer" containerID="85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb"
May 26 15:47:02.042306 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:47:02.042290    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb\": container with ID starting with 85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb not found: ID does not exist" containerID="85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb"
May 26 15:47:02.042369 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042312    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb"} err="failed to get container status \"85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb\": rpc error: code = NotFound desc = could not find container \"85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb\": container with ID starting with 85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb not found: ID does not exist"
May 26 15:47:02.042369 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042333    2557 scope.go:117] "RemoveContainer" containerID="109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4"
May 26 15:47:02.042567 ip-10-0-142-253 kubenswrapper[2557]: E0526 15:47:02.042552    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4\": container with ID starting with 109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4 not found: ID does not exist" containerID="109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4"
May 26 15:47:02.042606 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042571    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4"} err="failed to get container status \"109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4\": rpc error: code = NotFound desc = could not find container \"109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4\": container with ID starting with 109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4 not found: ID does not exist"
May 26 15:47:02.042606 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042585    2557 scope.go:117] "RemoveContainer" containerID="489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51"
May 26 15:47:02.042782 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042757    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51"} err="failed to get container status \"489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51\": rpc error: code = NotFound desc = could not find container \"489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51\": container with ID starting with 489f4f1538f6c5d55c2601cb0f359b10e801b0058b22d5ed0923fb6e56a15e51 not found: ID does not exist"
May 26 15:47:02.042839 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042785    2557 scope.go:117] "RemoveContainer" containerID="669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c"
May 26 15:47:02.042995 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042969    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c"} err="failed to get container status \"669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c\": rpc error: code = NotFound desc = could not find container \"669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c\": container with ID starting with 669be123b23f8cf36d4734c8ba64983a5e8df55897d06835908bf9fc0b3c4a3c not found: ID does not exist"
May 26 15:47:02.042995 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.042995    2557 scope.go:117] "RemoveContainer" containerID="6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b"
May 26 15:47:02.043128 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.043016    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" path="/var/lib/kubelet/pods/08617e01-ca2a-403d-932d-27e1b1ca86d8/volumes"
May 26 15:47:02.043204 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.043183    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b"} err="failed to get container status \"6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b\": rpc error: code = NotFound desc = could not find container \"6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b\": container with ID starting with 6a90b494859624a2e8e24e20781c137bbea18419e77ecbc98e66da25b27a265b not found: ID does not exist"
May 26 15:47:02.043250 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.043206    2557 scope.go:117] "RemoveContainer" containerID="3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4"
May 26 15:47:02.043448 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.043430    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4"} err="failed to get container status \"3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4\": rpc error: code = NotFound desc = could not find container \"3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4\": container with ID starting with 3f4e657c20493b23fb40ef03fc0c57c54853f6ac5ec30d02a531f2316c2591e4 not found: ID does not exist"
May 26 15:47:02.043520 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.043451    2557 scope.go:117] "RemoveContainer" containerID="85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb"
May 26 15:47:02.043656 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.043638    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" path="/var/lib/kubelet/pods/5dfef5f6-f736-4efe-a83a-c6ca441aaf2d/volumes"
May 26 15:47:02.043714 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.043647    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb"} err="failed to get container status \"85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb\": rpc error: code = NotFound desc = could not find container \"85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb\": container with ID starting with 85b580dcc805f2ba31c9a3f53451732a941cf2c3b8c0105d83b1420a7bcc40eb not found: ID does not exist"
May 26 15:47:02.043714 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.043666    2557 scope.go:117] "RemoveContainer" containerID="109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4"
May 26 15:47:02.043913 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:02.043889    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4"} err="failed to get container status \"109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4\": rpc error: code = NotFound desc = could not find container \"109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4\": container with ID starting with 109471fd8f885555113deaa523625143b0a7163a37e556c5cb621eb3b74980f4 not found: ID does not exist"
May 26 15:47:40.139999 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:40.139967    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2zqtz_d92794c3-4f3a-44e4-bdac-96e902e9c040/global-pull-secret-syncer/0.log"
May 26 15:47:40.323892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:40.323866    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hp7rv_e69ab1d5-19da-495e-a87b-261216525ef7/konnectivity-agent/0.log"
May 26 15:47:40.382031 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:40.382008    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-253.ec2.internal_d5114a2ba826e8e29effd27b13629957/haproxy/0.log"
May 26 15:47:42.092658 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:42.092631    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:47:42.097047 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:42.097028    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:47:44.004104 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.004074    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hv74t_d6058dbb-16be-4287-977d-3470c1b9c808/node-exporter/0.log"
May 26 15:47:44.025657 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.025630    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hv74t_d6058dbb-16be-4287-977d-3470c1b9c808/kube-rbac-proxy/0.log"
May 26 15:47:44.047047 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.047028    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hv74t_d6058dbb-16be-4287-977d-3470c1b9c808/init-textfile/0.log"
May 26 15:47:44.074150 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.074127    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-dpl4j_a7efd39c-b66f-4768-adb3-c6181e1fc3ab/kube-rbac-proxy-main/0.log"
May 26 15:47:44.093657 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.093633    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-dpl4j_a7efd39c-b66f-4768-adb3-c6181e1fc3ab/kube-rbac-proxy-self/0.log"
May 26 15:47:44.111660 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.111637    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-dpl4j_a7efd39c-b66f-4768-adb3-c6181e1fc3ab/openshift-state-metrics/0.log"
May 26 15:47:44.442704 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.442682    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c84b5c876-r9rzn_7b1e527d-0f4f-43b9-b543-b6e011d5d3ab/thanos-query/0.log"
May 26 15:47:44.464526 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.464497    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c84b5c876-r9rzn_7b1e527d-0f4f-43b9-b543-b6e011d5d3ab/kube-rbac-proxy-web/0.log"
May 26 15:47:44.484433 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.484414    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c84b5c876-r9rzn_7b1e527d-0f4f-43b9-b543-b6e011d5d3ab/kube-rbac-proxy/0.log"
May 26 15:47:44.503713 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.503695    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c84b5c876-r9rzn_7b1e527d-0f4f-43b9-b543-b6e011d5d3ab/prom-label-proxy/0.log"
May 26 15:47:44.520616 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.520597    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c84b5c876-r9rzn_7b1e527d-0f4f-43b9-b543-b6e011d5d3ab/kube-rbac-proxy-rules/0.log"
May 26 15:47:44.539137 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:44.539119    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c84b5c876-r9rzn_7b1e527d-0f4f-43b9-b543-b6e011d5d3ab/kube-rbac-proxy-metrics/0.log"
May 26 15:47:46.430296 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.430266    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-8hzzw_e2010e00-6520-453d-b5c8-09efbc1af7e4/download-server/0.log"
May 26 15:47:46.699059 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.698987    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"]
May 26 15:47:46.699244 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699222    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="online"
May 26 15:47:46.699244 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699234    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="online"
May 26 15:47:46.699244 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699242    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="offline"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699248    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="offline"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699258    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="registry"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699266    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="registry"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699272    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="ui"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699280    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="ui"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699289    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="feast-apply"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699294    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="feast-apply"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699301    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="offline"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699306    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="offline"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699313    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="online"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699318    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="online"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699326    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="ui"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699331    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="ui"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699339    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="feast-init"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699343    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="feast-init"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699349    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="feast-apply"
May 26 15:47:46.699350 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699354    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="feast-apply"
May 26 15:47:46.699892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699359    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="feast-init"
May 26 15:47:46.699892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699364    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="feast-init"
May 26 15:47:46.699892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699415    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="offline"
May 26 15:47:46.699892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699422    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="online"
May 26 15:47:46.699892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699427    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="ui"
May 26 15:47:46.699892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699435    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="offline"
May 26 15:47:46.699892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699441    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="registry"
May 26 15:47:46.699892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699447    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="08617e01-ca2a-403d-932d-27e1b1ca86d8" containerName="online"
May 26 15:47:46.699892 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.699453    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dfef5f6-f736-4efe-a83a-c6ca441aaf2d" containerName="ui"
May 26 15:47:46.703856 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.703830    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.706916 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.706897    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8fq7\"/\"kube-root-ca.crt\""
May 26 15:47:46.707850 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.707827    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g8fq7\"/\"default-dockercfg-rbl2g\""
May 26 15:47:46.707952 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.707871    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8fq7\"/\"openshift-service-ca.crt\""
May 26 15:47:46.710447 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.710220    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"]
May 26 15:47:46.734817 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.734793    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-sys\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.734919 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.734828    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-lib-modules\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.734919 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.734852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-podres\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.734919 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.734898    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xfx9\" (UniqueName: \"kubernetes.io/projected/9f03ef28-131a-4b91-9467-28c7d0e15cb6-kube-api-access-2xfx9\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.735062 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.734937    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-proc\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.836068 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.836044    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-proc\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.836170 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.836084    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-sys\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.836170 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.836107    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-lib-modules\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.836170 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.836135    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-podres\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.836170 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.836150    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xfx9\" (UniqueName: \"kubernetes.io/projected/9f03ef28-131a-4b91-9467-28c7d0e15cb6-kube-api-access-2xfx9\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.836170 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.836166    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-sys\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.836347 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.836173    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-proc\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.836347 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.836263    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-lib-modules\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.836347 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.836272    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f03ef28-131a-4b91-9467-28c7d0e15cb6-podres\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:46.844427 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:46.844407    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xfx9\" (UniqueName: \"kubernetes.io/projected/9f03ef28-131a-4b91-9467-28c7d0e15cb6-kube-api-access-2xfx9\") pod \"perf-node-gather-daemonset-pq457\" (UID: \"9f03ef28-131a-4b91-9467-28c7d0e15cb6\") " pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:47.014409 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:47.014346    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:47.133112 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:47.133089    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"]
May 26 15:47:47.135376 ip-10-0-142-253 kubenswrapper[2557]: W0526 15:47:47.135351    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9f03ef28_131a_4b91_9467_28c7d0e15cb6.slice/crio-c9ea5fbfc1ee2d06df005f8d1ad1596303547ef35d051f567f8f156d9e069b7d WatchSource:0}: Error finding container c9ea5fbfc1ee2d06df005f8d1ad1596303547ef35d051f567f8f156d9e069b7d: Status 404 returned error can't find the container with id c9ea5fbfc1ee2d06df005f8d1ad1596303547ef35d051f567f8f156d9e069b7d
May 26 15:47:47.136955 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:47.136941    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:47:47.401401 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:47.401377    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8wf52_0629c812-9d09-45fa-9eec-162a272f6b86/dns/0.log"
May 26 15:47:47.419620 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:47.419599    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8wf52_0629c812-9d09-45fa-9eec-162a272f6b86/kube-rbac-proxy/0.log"
May 26 15:47:47.569094 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:47.569071    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lxdbs_ca96af9f-d16f-4d3b-869c-2853e67592b0/dns-node-resolver/0.log"
May 26 15:47:47.952914 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:47.952887    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dz5k2_3bc43d23-582e-4a39-a80f-4760a45af3f7/node-ca/0.log"
May 26 15:47:48.087757 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:48.087717    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457" event={"ID":"9f03ef28-131a-4b91-9467-28c7d0e15cb6","Type":"ContainerStarted","Data":"cbe621cc5dce64ed966a0973ae254b60df29c10fde5ffa8b076defb69a496e4b"}
May 26 15:47:48.087900 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:48.087763    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457" event={"ID":"9f03ef28-131a-4b91-9467-28c7d0e15cb6","Type":"ContainerStarted","Data":"c9ea5fbfc1ee2d06df005f8d1ad1596303547ef35d051f567f8f156d9e069b7d"}
May 26 15:47:48.087900 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:48.087859    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:48.105957 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:48.105917    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457" podStartSLOduration=2.105904712 podStartE2EDuration="2.105904712s" podCreationTimestamp="2026-05-26 15:47:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:47:48.104449787 +0000 UTC m=+1806.624993254" watchObservedRunningTime="2026-05-26 15:47:48.105904712 +0000 UTC m=+1806.626448178"
May 26 15:47:48.930884 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:48.930856    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-krxk5_5fb6d891-20e1-442b-9b19-905bba00a7ad/serve-healthcheck-canary/0.log"
May 26 15:47:49.455095 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:49.455067    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zcbzl_e0f317c0-3a75-4499-a11e-475722368d90/kube-rbac-proxy/0.log"
May 26 15:47:49.474148 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:49.474118    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zcbzl_e0f317c0-3a75-4499-a11e-475722368d90/exporter/0.log"
May 26 15:47:49.492839 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:49.492820    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zcbzl_e0f317c0-3a75-4499-a11e-475722368d90/extractor/0.log"
May 26 15:47:54.099726 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.099699    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g8fq7/perf-node-gather-daemonset-pq457"
May 26 15:47:54.337716 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.337690    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vsgv_f4a11aa6-ff7c-4d15-9423-1965544d2d25/kube-multus-additional-cni-plugins/0.log"
May 26 15:47:54.356430 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.356375    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vsgv_f4a11aa6-ff7c-4d15-9423-1965544d2d25/egress-router-binary-copy/0.log"
May 26 15:47:54.375213 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.375193    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vsgv_f4a11aa6-ff7c-4d15-9423-1965544d2d25/cni-plugins/0.log"
May 26 15:47:54.392551 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.392534    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vsgv_f4a11aa6-ff7c-4d15-9423-1965544d2d25/bond-cni-plugin/0.log"
May 26 15:47:54.410150 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.410136    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vsgv_f4a11aa6-ff7c-4d15-9423-1965544d2d25/routeoverride-cni/0.log"
May 26 15:47:54.428562 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.428548    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vsgv_f4a11aa6-ff7c-4d15-9423-1965544d2d25/whereabouts-cni-bincopy/0.log"
May 26 15:47:54.446317 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.446297    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5vsgv_f4a11aa6-ff7c-4d15-9423-1965544d2d25/whereabouts-cni/0.log"
May 26 15:47:54.788539 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.788519    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sgdld_9288c0c9-d24c-4932-be3a-584f39a6df8f/kube-multus/0.log"
May 26 15:47:54.931388 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.931370    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vf787_fe9ab1f8-642f-42d3-a2ec-ae4613691a2b/network-metrics-daemon/0.log"
May 26 15:47:54.948195 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:54.948176    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vf787_fe9ab1f8-642f-42d3-a2ec-ae4613691a2b/kube-rbac-proxy/0.log"
May 26 15:47:56.009314 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:56.009243    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-controller/0.log"
May 26 15:47:56.029393 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:56.029366    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/0.log"
May 26 15:47:56.036530 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:56.036512    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovn-acl-logging/1.log"
May 26 15:47:56.055500 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:56.055483    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/kube-rbac-proxy-node/0.log"
May 26 15:47:56.073598 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:56.073561    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/kube-rbac-proxy-ovn-metrics/0.log"
May 26 15:47:56.092825 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:56.092810    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/northd/0.log"
May 26 15:47:56.116965 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:56.116941    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/nbdb/0.log"
May 26 15:47:56.135533 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:56.135512    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/sbdb/0.log"
May 26 15:47:56.245986 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:56.245951    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fmxcw_99c60328-df56-42c0-9f63-0f302076398e/ovnkube-controller/0.log"
May 26 15:47:57.441177 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:57.441147    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cdppb_95d379c6-e653-4033-af3e-f485d7fac20a/network-check-target-container/0.log"
May 26 15:47:58.233754 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:58.233724    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-n24gc_8ef54bc6-23d1-4ada-8bbf-680876a1245a/iptables-alerter/0.log"
May 26 15:47:58.837304 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:47:58.837276    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-svzd6_d40ef27c-c495-489f-9c91-18af598d484c/tuned/0.log"
May 26 15:48:01.825286 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:48:01.825256    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-jkbxk_b12fd7f2-87d9-464a-b5b6-677dbb60fde4/csi-driver/0.log"
May 26 15:48:01.844714 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:48:01.844693    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-jkbxk_b12fd7f2-87d9-464a-b5b6-677dbb60fde4/csi-node-driver-registrar/0.log"
May 26 15:48:01.864082 ip-10-0-142-253 kubenswrapper[2557]: I0526 15:48:01.864029    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-jkbxk_b12fd7f2-87d9-464a-b5b6-677dbb60fde4/csi-liveness-probe/0.log"