May 26 23:40:56.936787 ip-10-0-136-0 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 23:40:56.936799 ip-10-0-136-0 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 23:40:56.936806 ip-10-0-136-0 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 23:40:56.937049 ip-10-0-136-0 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 23:41:07.178399 ip-10-0-136-0 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 23:41:07.178420 ip-10-0-136-0 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 995302b9104046f1869361d7d8bf0e39 --
May 26 23:43:23.974339 ip-10-0-136-0 systemd[1]: Starting Kubernetes Kubelet...
May 26 23:43:24.473605 ip-10-0-136-0 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 23:43:24.473605 ip-10-0-136-0 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 23:43:24.473605 ip-10-0-136-0 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 23:43:24.473605 ip-10-0-136-0 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 23:43:24.473605 ip-10-0-136-0 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 23:43:24.475463 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.475369    2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 23:43:24.479256 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479238    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:43:24.479256 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479254    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:43:24.479256 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479259    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479263    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479268    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479272    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479277    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479281    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479284    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479288    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479291    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479295    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479299    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479302    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479306    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479311    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479315    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479319    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479323    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479327    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479331    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479335    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:43:24.479448 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479339    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479343    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479347    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479351    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479355    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479359    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479363    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479368    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479373    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479377    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479381    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479385    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479389    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479393    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479400    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479404    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479408    2574 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479417    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479424    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479429    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:43:24.480231 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479433    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479437    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479443    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479447    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479451    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479455    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479460    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479464    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479469    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479473    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479477    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479481    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479485    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479489    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479493    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479498    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479504    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479510    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479515    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:43:24.480845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479520    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479524    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479529    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479533    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479537    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479541    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479546    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479551    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479556    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479560    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479564    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479569    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479574    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479578    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479582    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479586    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479592    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479597    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479602    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479606    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:43:24.481380 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479610    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479614    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479618    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479622    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.479626    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481821    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481833    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481838    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481841    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481844    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481846    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481850    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481854    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481858    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481860    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481863    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481867    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481869    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481872    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481875    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:43:24.481970 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481877    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481880    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481882    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481885    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481888    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481890    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481893    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481895    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481898    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481900    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481903    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481910    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481913    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481916    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481919    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481921    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481924    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481927    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481930    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481932    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:43:24.482488 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481935    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481938    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481940    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481943    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481946    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481948    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481951    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481953    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481956    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481959    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481961    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481964    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481966    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481969    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481972    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481975    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481977    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481980    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481983    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481985    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:43:24.482987 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481988    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481991    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481993    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481995    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.481998    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482002    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482006    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482008    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482011    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482014    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482017    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482020    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482022    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482025    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482027    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482030    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482033    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482036    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482038    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:43:24.483494 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482041    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482044    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482062    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482067    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482069    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482072    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482075    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482077    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482080    2574 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482083    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482085    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482088    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482156    2574 flags.go:64] FLAG: --address="0.0.0.0"
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482163    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482173    2574 flags.go:64] FLAG: --anonymous-auth="true"
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482180    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482186    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482191    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482195    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482199    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482203    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 23:43:24.484035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482206    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482209    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482213    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482216    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482219    2574 flags.go:64] FLAG: --cgroup-root=""
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482222    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482225    2574 flags.go:64] FLAG: --client-ca-file=""
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482228    2574 flags.go:64] FLAG: --cloud-config=""
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482230    2574 flags.go:64] FLAG: --cloud-provider="external"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482233    2574 flags.go:64] FLAG: --cluster-dns="[]"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482238    2574 flags.go:64] FLAG: --cluster-domain=""
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482241    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482244    2574 flags.go:64] FLAG: --config-dir=""
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482247    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482250    2574 flags.go:64] FLAG: --container-log-max-files="5"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482255    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482258    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482261    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482264    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482267    2574 flags.go:64] FLAG: --contention-profiling="false"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482269    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482272    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482276    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482278    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482283    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 23:43:24.484586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482287    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482290    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482293    2574 flags.go:64] FLAG: --enable-load-reader="false"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482296    2574 flags.go:64] FLAG: --enable-server="true"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482299    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482303    2574 flags.go:64] FLAG: --event-burst="100"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482305    2574 flags.go:64] FLAG: --event-qps="50"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482308    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482312    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482315    2574 flags.go:64] FLAG: --eviction-hard=""
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482318    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482321    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482324    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482327    2574 flags.go:64] FLAG: --eviction-soft=""
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482330    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482333    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482336    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482339    2574 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482342    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482344    2574 flags.go:64] FLAG: --fail-swap-on="true"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482347    2574 flags.go:64] FLAG: --feature-gates=""
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482351    2574 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482354    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482358    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482361    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482364    2574 flags.go:64] FLAG: --healthz-port="10248"
May 26 23:43:24.485203 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482367    2574 flags.go:64] FLAG: --help="false"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482370    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-136-0.ec2.internal"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482373    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482376    2574 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482379    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482382    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482387    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482390    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482393    2574 flags.go:64] FLAG: --image-service-endpoint=""
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482396    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482398    2574 flags.go:64] FLAG: --kube-api-burst="100"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482401    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482405    2574 flags.go:64] FLAG: --kube-api-qps="50"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482408    2574 flags.go:64] FLAG: --kube-reserved=""
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482412    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482415    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482418    2574 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482421    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482424    2574 flags.go:64] FLAG: --lock-file=""
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482426    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482429    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482432    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482442    2574 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 23:43:24.485852 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482445    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482448    2574 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482451    2574 flags.go:64] FLAG: --logging-format="text"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482454    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482457    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482460    2574 flags.go:64] FLAG: --manifest-url=""
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482463    2574 flags.go:64] FLAG: --manifest-url-header=""
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482468    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482471    2574 flags.go:64] FLAG: --max-open-files="1000000"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482475    2574 flags.go:64] FLAG: --max-pods="110"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482478    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482481    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482485    2574 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482488    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482491    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482495    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482498    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482506    2574 flags.go:64] FLAG: --node-status-max-images="50"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482509    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482512    2574 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482515    2574 flags.go:64] FLAG: --pod-cidr=""
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482517    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482523    2574 flags.go:64] FLAG: --pod-manifest-path=""
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482526    2574 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 23:43:24.486409 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482530    2574 flags.go:64] FLAG: --pods-per-core="0"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482533    2574 flags.go:64] FLAG: --port="10250"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482536    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482539    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0474a117310bcee5e"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482542    2574 flags.go:64] FLAG: --qos-reserved=""
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482545    2574 flags.go:64] FLAG: --read-only-port="10255"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482548    2574 flags.go:64] FLAG: --register-node="true"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482551    2574 flags.go:64] FLAG: --register-schedulable="true"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482554    2574 flags.go:64] FLAG: --register-with-taints=""
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482557    2574 flags.go:64] FLAG: --registry-burst="10"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482560    2574 flags.go:64] FLAG: --registry-qps="5"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482563    2574 flags.go:64] FLAG: --reserved-cpus=""
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482566    2574 flags.go:64] FLAG: --reserved-memory=""
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482569    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482572    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482575    2574 flags.go:64] FLAG: --rotate-certificates="false"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482578    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482581    2574 flags.go:64] FLAG: --runonce="false"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482584    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482587    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482590    2574 flags.go:64] FLAG: --seccomp-default="false"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482593    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482596    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482599    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482602    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482605    2574 flags.go:64] FLAG: --storage-driver-password="root"
May 26 23:43:24.486993 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482608    2574 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482611    2574 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482614    2574 flags.go:64] FLAG: --storage-driver-user="root"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482617    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482620    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482623    2574 flags.go:64] FLAG: --system-cgroups=""
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482626    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482631    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482634    2574 flags.go:64] FLAG: --tls-cert-file=""
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482637    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482641    2574 flags.go:64] FLAG: --tls-min-version=""
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482643    2574 flags.go:64] FLAG: --tls-private-key-file=""
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482646    2574 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482649    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482652    2574 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482654    2574 flags.go:64] FLAG: --v="2"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482659    2574 flags.go:64] FLAG: --version="false"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482663    2574 flags.go:64] FLAG: --vmodule=""
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482667    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482670    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482763    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482767    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482770    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482773    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:43:24.487676 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482776    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482778    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482781    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482784    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482787    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482790    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482793    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482795    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482798    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482801    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482803    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482806    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482808    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482811    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482813    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482816    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482818    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482820    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482823    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482826    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482828    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:43:24.488287 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482831    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482833    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482836    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482839    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482841    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482844    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482846    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482849    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482851    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482854    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482856    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482859    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482862    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482864    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482867    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482870    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482876    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482879    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482883    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:43:24.488845 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482885    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482889    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482891    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482895    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482898    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482901    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482904    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482906    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482909    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482911    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482914    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482916    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482919    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482921    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482924    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482926    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482929    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482931    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482934    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:43:24.489350 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482936    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482939    2574 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482942    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482944    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482947    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482949    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482952    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482954    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482957    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482959    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482964    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482967    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482969    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482972    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482974    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482977    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482979    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482982    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482984    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482986    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:43:24.489802 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482989    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:43:24.490299 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482991    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:43:24.490299 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.482994    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:43:24.490299 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.482999    2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 23:43:24.490772 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.490754    2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 23:43:24.490806 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.490772    2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 23:43:24.490843 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490835    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:43:24.490843 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490843    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490847    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490850    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490853    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490856    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490859    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490861    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490864    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490867    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490870    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490872    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490877    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490882    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490885    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490888    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490891    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490894    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490897    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490899    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:43:24.490897 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490903    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490906    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490909    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490912    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490915    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490918    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490921    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490924    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490927    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490929    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490932    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490935    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490937    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490940    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490942    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490946    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490948    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490951    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490953    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490956    2574 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:43:24.491421 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490959    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490961    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490964    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490966    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490969    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490972    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490974    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490977    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490979    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490982    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490985    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490987    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490990    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490992    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490995    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.490998    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491001    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491004    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491007    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:43:24.491901 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491011    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491014    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491017    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491019    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491022    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491025    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491027    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491030    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491032    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491035    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491038    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491041    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491043    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491060    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491063    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491066    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491068    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491071    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491075    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491078    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:43:24.492439 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491081    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491083    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491086    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491089    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491091    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491094    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491096    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.491101    2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491193    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491199    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491203    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491205    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491208    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491211    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491213    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491215    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:43:24.492922 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491218    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491221    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491225    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491229    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491232    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491235    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491237    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491240    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491242    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491245    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491248    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491250    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491253    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491255    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491257    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491260    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491263    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491266    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491268    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:43:24.493346 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491271    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491273    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491276    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491278    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491281    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491284    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491287    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491289    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491292    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491294    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491297    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491299    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491302    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491304    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491307    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491309    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491312    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491314    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491317    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:43:24.493813 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491319    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491322    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491324    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491327    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491329    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491331    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491334    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491337    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491339    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491342    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491345    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491348    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491351    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491353    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491356    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491358    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491361    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491364    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491366    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491369    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:43:24.494280 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491371    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491374    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491377    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491379    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491382    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491384    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491386    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491389    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491391    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491394    2574 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491397    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491399    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491402    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491404    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491407    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491409    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491412    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491415    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491417    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:43:24.494766 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:24.491420    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:43:24.495242 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.491425    2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 23:43:24.495242 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.492314    2574 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 23:43:24.498172 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.498158    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 23:43:24.499165 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.499154    2574 server.go:1019] "Starting client certificate rotation"
May 26 23:43:24.499268 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.499252    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 23:43:24.499302 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.499290    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 23:43:24.526977 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.526956    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 23:43:24.528783 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.528756    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 23:43:24.540769 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.540754    2574 log.go:25] "Validated CRI v1 runtime API"
May 26 23:43:24.547004 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.546988    2574 log.go:25] "Validated CRI v1 image API"
May 26 23:43:24.549019 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.549004    2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 23:43:24.555869 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.555850    2574 fs.go:135] Filesystem UUIDs: map[6436258d-e32c-492a-b13d-5f6140b63844:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e9ade0b5-a7a5-4b1b-8ca6-f168f2965012:/dev/nvme0n1p4]
May 26 23:43:24.555940 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.555869    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 23:43:24.560041 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.559940    2574 manager.go:217] Machine: {Timestamp:2026-05-26 23:43:24.559454296 +0000 UTC m=+0.455275047 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097812 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c51d90481cbe79f738423c26705df SystemUUID:ec2c51d9-0481-cbe7-9f73-8423c26705df BootID:995302b9-1040-46f1-8693-61d7d8bf0e39 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0d:af:fc:b3:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0d:af:fc:b3:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:db:14:b8:79:36 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 23:43:24.560329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.560312    2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 23:43:24.560608 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.560595    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 23:43:24.560691 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.560678    2574 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 23:43:24.562739 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.562716    2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 23:43:24.562920 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.562741    2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 23:43:24.562997 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.562931    2574 topology_manager.go:138] "Creating topology manager with none policy"
May 26 23:43:24.562997 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.562943    2574 container_manager_linux.go:306] "Creating device plugin manager"
May 26 23:43:24.562997 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.562954    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 23:43:24.564282 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.564269    2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 23:43:24.565632 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.565620    2574 state_mem.go:36] "Initialized new in-memory state store"
May 26 23:43:24.565750 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.565740    2574 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 23:43:24.568355 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.568344    2574 kubelet.go:491] "Attempting to sync node with API server"
May 26 23:43:24.568418 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.568362    2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 23:43:24.568418 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.568377    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 23:43:24.568418 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.568391    2574 kubelet.go:397] "Adding apiserver pod source"
May 26 23:43:24.568418 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.568402    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 23:43:24.569671 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.569658    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 23:43:24.569734 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.569682    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 23:43:24.574086 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.574069    2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 23:43:24.576707 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.576692    2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 23:43:24.578987 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.578963    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 23:43:24.578987 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.578985    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.578992    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.579000    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.579011    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.579019    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.579028    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.579035    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.579044    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.579068    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.579080    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 23:43:24.579157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.579089    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 23:43:24.580223 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.580211    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 23:43:24.580283 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.580226    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 23:43:24.581322 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.581298    2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 23:43:24.581401 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.581285    2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 23:43:24.583338 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.583322    2574 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 23:43:24.583421 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.583361    2574 server.go:1295] "Started kubelet"
May 26 23:43:24.583470 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.583409    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 23:43:24.583522 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.583444    2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 23:43:24.583563 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.583541    2574 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 23:43:24.584063 ip-10-0-136-0 systemd[1]: Started Kubernetes Kubelet.
May 26 23:43:24.586874 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.586854    2574 server.go:317] "Adding debug handlers to kubelet server"
May 26 23:43:24.586967 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.586869    2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 23:43:24.593779 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.593763    2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 23:43:24.596343 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.596322    2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 23:43:24.599445 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.599423    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 23:43:24.600041 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600019    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 23:43:24.600217 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600202    2574 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 23:43:24.600312 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600303    2574 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 23:43:24.600430 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600415    2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 23:43:24.600528 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600508    2574 reconstruct.go:97] "Volume reconstruction finished"
May 26 23:43:24.600577 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600529    2574 reconciler.go:26] "Reconciler: start to sync state"
May 26 23:43:24.600616 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600602    2574 factory.go:55] Registering systemd factory
May 26 23:43:24.600691 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600618    2574 factory.go:223] Registration of the systemd container factory successfully
May 26 23:43:24.600864 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600844    2574 factory.go:153] Registering CRI-O factory
May 26 23:43:24.600864 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600865    2574 factory.go:223] Registration of the crio container factory successfully
May 26 23:43:24.601016 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600914    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 23:43:24.601016 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600932    2574 factory.go:103] Registering Raw factory
May 26 23:43:24.601016 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.600952    2574 manager.go:1196] Started watching for new ooms in manager
May 26 23:43:24.601188 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.601007    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:24.601373 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.601355    2574 manager.go:319] Starting recovery of all containers
May 26 23:43:24.604608 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.604589    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76554"
May 26 23:43:24.604814 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.604781    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 23:43:24.604900 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.604881    2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 23:43:24.605977 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.604808    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18b342250993144b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-05-26 23:43:24.583334987 +0000 UTC m=+0.479155741,LastTimestamp:2026-05-26 23:43:24.583334987 +0000 UTC m=+0.479155741,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}"
May 26 23:43:24.611806 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.611682    2574 manager.go:324] Recovery completed
May 26 23:43:24.612073 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.612036    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76554"
May 26 23:43:24.616079 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.616067    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:43:24.618349 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.618332    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:43:24.618410 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.618358    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:43:24.618410 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.618368    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID"
May 26 23:43:24.618822 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.618807    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 23:43:24.618822 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.618820    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 23:43:24.618946 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.618837    2574 state_mem.go:36] "Initialized new in-memory state store"
May 26 23:43:24.620403 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.620325    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-0.ec2.internal.18b342250ba95087  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-0.ec2.internal,UID:ip-10-0-136-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-0.ec2.internal,},FirstTimestamp:2026-05-26 23:43:24.618346631 +0000 UTC m=+0.514167382,LastTimestamp:2026-05-26 23:43:24.618346631 +0000 UTC m=+0.514167382,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-0.ec2.internal,}"
May 26 23:43:24.622333 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.622318    2574 policy_none.go:49] "None policy: Start"
May 26 23:43:24.622413 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.622341    2574 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 23:43:24.622413 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.622354    2574 state_mem.go:35] "Initializing new in-memory state store"
May 26 23:43:24.654621 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.654606    2574 manager.go:341] "Starting Device Plugin manager"
May 26 23:43:24.677425 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.654641    2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 23:43:24.677425 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.654654    2574 server.go:85] "Starting device plugin registration server"
May 26 23:43:24.677425 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.654873    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 23:43:24.677425 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.654885    2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 23:43:24.677425 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.654988    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 23:43:24.677425 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.655105    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 23:43:24.677425 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.655119    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 23:43:24.677425 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.655510    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 23:43:24.677425 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.655554    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:24.691054 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.691023    2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 23:43:24.692130 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.692113    2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 23:43:24.692225 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.692144    2574 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 23:43:24.692225 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.692163    2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 23:43:24.692225 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.692171    2574 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 23:43:24.692225 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.692204    2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 23:43:24.698987 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.698966    2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:43:24.755275 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.755223    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:43:24.756948 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.756934    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:43:24.757021 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.756961    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:43:24.757021 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.756971    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID"
May 26 23:43:24.757021 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.756989    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-0.ec2.internal"
May 26 23:43:24.765633 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.765615    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-0.ec2.internal"
May 26 23:43:24.765717 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.765636    2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-0.ec2.internal\": node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:24.780577 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.780558    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:24.792463 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.792444    2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal"]
May 26 23:43:24.792539 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.792508    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:43:24.794150 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.794134    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:43:24.794228 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.794166    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:43:24.794228 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.794179    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID"
May 26 23:43:24.795261 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.795248    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:43:24.795432 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.795418    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.795477 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.795444    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:43:24.796174 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.796160    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:43:24.796251 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.796184    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:43:24.796251 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.796198    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID"
May 26 23:43:24.796352 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.796261    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:43:24.796352 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.796282    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:43:24.796352 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.796292    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID"
May 26 23:43:24.797249 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.797233    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.797320 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.797265    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:43:24.797898 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.797884    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:43:24.797962 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.797913    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:43:24.797962 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.797925    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeHasSufficientPID"
May 26 23:43:24.801389 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.801314    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a58fbb70d755888352f12da46ad7b0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"1a58fbb70d755888352f12da46ad7b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.801389 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.801363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a58fbb70d755888352f12da46ad7b0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"1a58fbb70d755888352f12da46ad7b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.801502 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.801388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4c644e74d9922165a4478c112ee14b0-config\") pod \"kube-apiserver-proxy-ip-10-0-136-0.ec2.internal\" (UID: \"f4c644e74d9922165a4478c112ee14b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.826626 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.826604    2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-0.ec2.internal\" not found" node="ip-10-0-136-0.ec2.internal"
May 26 23:43:24.830859 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.830835    2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-0.ec2.internal\" not found" node="ip-10-0-136-0.ec2.internal"
May 26 23:43:24.881191 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.881173    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:24.901800 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.901780    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a58fbb70d755888352f12da46ad7b0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"1a58fbb70d755888352f12da46ad7b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.901888 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.901811    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a58fbb70d755888352f12da46ad7b0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"1a58fbb70d755888352f12da46ad7b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.901888 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.901836    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4c644e74d9922165a4478c112ee14b0-config\") pod \"kube-apiserver-proxy-ip-10-0-136-0.ec2.internal\" (UID: \"f4c644e74d9922165a4478c112ee14b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.901888 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.901874    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a58fbb70d755888352f12da46ad7b0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"1a58fbb70d755888352f12da46ad7b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.901888 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.901884    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a58fbb70d755888352f12da46ad7b0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal\" (UID: \"1a58fbb70d755888352f12da46ad7b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.902026 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:24.901887    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4c644e74d9922165a4478c112ee14b0-config\") pod \"kube-apiserver-proxy-ip-10-0-136-0.ec2.internal\" (UID: \"f4c644e74d9922165a4478c112ee14b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal"
May 26 23:43:24.982070 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:24.982026    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:25.082705 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:25.082674    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:25.129110 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.129090    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"
May 26 23:43:25.133453 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.133437    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal"
May 26 23:43:25.182895 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:25.182871    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:25.283352 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:25.283327    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:25.383863 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:25.383789    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:25.459805 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.459779    2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:43:25.484061 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:25.484022    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:25.499190 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.499171    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 23:43:25.499315 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.499296    2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 23:43:25.499353 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.499333    2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 23:43:25.585091 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:25.585059    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:25.600033 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.600010    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 23:43:25.612096 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.612078    2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 23:43:25.614739 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.614709    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 23:38:24 +0000 UTC" deadline="2028-03-12 02:17:11.350842444 +0000 UTC"
May 26 23:43:25.614809 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.614739    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15722h33m45.736105741s"
May 26 23:43:25.636481 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.636435    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g8c2t"
May 26 23:43:25.642557 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.642541    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g8c2t"
May 26 23:43:25.663180 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.663152    2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:43:25.683794 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:25.683771    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c644e74d9922165a4478c112ee14b0.slice/crio-5164b1fb854b8f8f816dcfbba49a326af1a0f8c905f5998c7f55a25366ec57f6 WatchSource:0}: Error finding container 5164b1fb854b8f8f816dcfbba49a326af1a0f8c905f5998c7f55a25366ec57f6: Status 404 returned error can't find the container with id 5164b1fb854b8f8f816dcfbba49a326af1a0f8c905f5998c7f55a25366ec57f6
May 26 23:43:25.684105 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:25.684089    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a58fbb70d755888352f12da46ad7b0d.slice/crio-267389966f3943d9d2bc625f6a88d9195239de2d9650e47b20c92292be77084e WatchSource:0}: Error finding container 267389966f3943d9d2bc625f6a88d9195239de2d9650e47b20c92292be77084e: Status 404 returned error can't find the container with id 267389966f3943d9d2bc625f6a88d9195239de2d9650e47b20c92292be77084e
May 26 23:43:25.685209 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:25.685191    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:25.686938 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.686924    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 23:43:25.695461 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.695428    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"1a58fbb70d755888352f12da46ad7b0d","Type":"ContainerStarted","Data":"267389966f3943d9d2bc625f6a88d9195239de2d9650e47b20c92292be77084e"}
May 26 23:43:25.696209 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.696189    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" event={"ID":"f4c644e74d9922165a4478c112ee14b0","Type":"ContainerStarted","Data":"5164b1fb854b8f8f816dcfbba49a326af1a0f8c905f5998c7f55a25366ec57f6"}
May 26 23:43:25.785622 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:25.785599    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-0.ec2.internal\" not found"
May 26 23:43:25.874412 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.874390    2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:43:25.901020 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.900950    2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"
May 26 23:43:25.914741 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.914720    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 23:43:25.915794 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.915779    2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal"
May 26 23:43:25.924465 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:25.924447    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 23:43:26.436606 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.436572    2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:43:26.569933 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.569905    2574 apiserver.go:52] "Watching apiserver"
May 26 23:43:26.576297 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.576275    2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 23:43:26.576630 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.576608    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-2ls22","openshift-multus/multus-cl9nk","openshift-multus/network-metrics-daemon-4gd6s","kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nrcpk","openshift-image-registry/node-ca-sv6wc","openshift-network-diagnostics/network-check-target-q9mxd","openshift-network-operator/iptables-alerter-q55q5","openshift-ovn-kubernetes/ovnkube-node-q2j7n","kube-system/konnectivity-agent-kqsj4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal"]
May 26 23:43:26.581289 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.581268    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.581526 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.581498    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.583525 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.583505    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:26.583623 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:26.583590    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:26.583998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.583923    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 23:43:26.583998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.583940    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 23:43:26.584170 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.584073    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2wddf\""
May 26 23:43:26.584170 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.584083    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d4pv6\""
May 26 23:43:26.584276 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.584220    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 23:43:26.584276 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.584258    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 23:43:26.584370 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.584274    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 23:43:26.584422 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.584397    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 23:43:26.585614 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.585595    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.588016 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.587810    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 23:43:26.588016 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.587851    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 23:43:26.588016 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.587899    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jswg6\""
May 26 23:43:26.590414 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.590383    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.590517 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.590484    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:26.590613 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:26.590597    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:26.592472 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.592454    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 23:43:26.592558 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.592500    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f5t2j\""
May 26 23:43:26.592558 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.592519    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 23:43:26.592657 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.592590    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 23:43:26.592973 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.592956    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.595266 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.595246    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 23:43:26.595398 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.595374    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 23:43:26.595487 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.595433    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 23:43:26.596299 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.596243    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 23:43:26.596467 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.596415    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 23:43:26.596467 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.596462    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 23:43:26.596801 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.596784    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4bhlb\""
May 26 23:43:26.600344 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.600321    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:26.600435 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.600418    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.602613 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.602592    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 23:43:26.602751 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.602729    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.602840 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.602802    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 23:43:26.602840 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.602813    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rnn6d\""
May 26 23:43:26.602946 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.602845    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 23:43:26.602946 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.602736    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 23:43:26.603062 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.603036    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 23:43:26.603325 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.603306    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-48p7d\""
May 26 23:43:26.604833 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.604802    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 23:43:26.605039 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.605020    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 23:43:26.605154 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.605070    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tb7xr\""
May 26 23:43:26.605154 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.605110    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 23:43:26.609824 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.609807    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-host\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.609918 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.609834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b99f2d83-2309-4be0-86fe-5d837c071be9-cni-binary-copy\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.609918 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.609853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-slash\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.609918 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.609873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-run-netns\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.610064 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.609928    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.610064 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.609957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-cnibin\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.610064 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.609979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-sysconfig\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.610064 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.609998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-tuned\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.610064 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9915d1c-3fad-4080-a23f-01f593cef437-serviceca\") pod \"node-ca-sv6wc\" (UID: \"d9915d1c-3fad-4080-a23f-01f593cef437\") " pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.610064 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610043    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e92b997-ff62-4a5a-a446-915d36e9e03a-agent-certs\") pod \"konnectivity-agent-kqsj4\" (UID: \"2e92b997-ff62-4a5a-a446-915d36e9e03a\") " pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:26.610329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610094    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-registration-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.610329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610139    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-system-cni-dir\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.610329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.610329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-cni-bin\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.610329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610234    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-cni-netd\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.610329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610263    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-run\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.610329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610286    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-lib-modules\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.610329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95t7w\" (UniqueName: \"kubernetes.io/projected/d9915d1c-3fad-4080-a23f-01f593cef437-kube-api-access-95t7w\") pod \"node-ca-sv6wc\" (UID: \"d9915d1c-3fad-4080-a23f-01f593cef437\") " pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610338    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4223034-5463-473f-811a-e0e3220a52a2-iptables-alerter-script\") pod \"iptables-alerter-q55q5\" (UID: \"e4223034-5463-473f-811a-e0e3220a52a2\") " pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b99f2d83-2309-4be0-86fe-5d837c071be9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-run-ovn\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnw4t\" (UniqueName: \"kubernetes.io/projected/ad5b8223-60ed-496c-9e83-ad0bf01ada03-kube-api-access-lnw4t\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610490    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-conf-dir\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610507    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvsrr\" (UniqueName: \"kubernetes.io/projected/d85d57c4-458e-4aa8-94be-930460d8bc09-kube-api-access-rvsrr\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e5b8b7-b63a-4a83-a292-4da4d6761a75-tmp\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610581    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-sys-fs\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610603    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-cnibin\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610626    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-run-systemd\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.610687 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-var-lib-cni-bin\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610697    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-hostroot\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-modprobe-d\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610742    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-kubernetes\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b7w7\" (UniqueName: \"kubernetes.io/projected/93e5b8b7-b63a-4a83-a292-4da4d6761a75-kube-api-access-4b7w7\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610793    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwjxf\" (UniqueName: \"kubernetes.io/projected/4a50c40a-ed69-44af-bbd3-ec1ee4063160-kube-api-access-lwjxf\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610817    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-os-release\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-etc-openvswitch\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610866    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-daemon-config\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610889    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-run-multus-certs\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610909    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-sys\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b99f2d83-2309-4be0-86fe-5d837c071be9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.610978    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-os-release\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611003    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-var-lib-kubelet\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611034    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-var-lib-kubelet\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611078    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9915d1c-3fad-4080-a23f-01f593cef437-host\") pod \"node-ca-sv6wc\" (UID: \"d9915d1c-3fad-4080-a23f-01f593cef437\") " pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.611293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611119    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-system-cni-dir\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611144    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e92b997-ff62-4a5a-a446-915d36e9e03a-konnectivity-ca\") pod \"konnectivity-agent-kqsj4\" (UID: \"2e92b997-ff62-4a5a-a446-915d36e9e03a\") " pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611226    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611241    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4223034-5463-473f-811a-e0e3220a52a2-host-slash\") pod \"iptables-alerter-q55q5\" (UID: \"e4223034-5463-473f-811a-e0e3220a52a2\") " pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-node-log\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-systemd\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611295    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x7bc\" (UniqueName: \"kubernetes.io/projected/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-kube-api-access-9x7bc\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-var-lib-cni-multus\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611351    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-etc-kubernetes\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-device-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxzf7\" (UniqueName: \"kubernetes.io/projected/e4223034-5463-473f-811a-e0e3220a52a2-kube-api-access-pxzf7\") pod \"iptables-alerter-q55q5\" (UID: \"e4223034-5463-473f-811a-e0e3220a52a2\") " pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611450    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-run-openvswitch\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611473    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-sysctl-conf\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611498    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-log-socket\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.611995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-socket-dir-parent\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611558    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-socket-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9vgn\" (UniqueName: \"kubernetes.io/projected/b99f2d83-2309-4be0-86fe-5d837c071be9-kube-api-access-q9vgn\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611605    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-systemd-units\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611626    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad5b8223-60ed-496c-9e83-ad0bf01ada03-env-overrides\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad5b8223-60ed-496c-9e83-ad0bf01ada03-ovnkube-script-lib\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611689    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-cni-dir\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611720    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-run-k8s-cni-cncf-io\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-kubelet\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d85d57c4-458e-4aa8-94be-930460d8bc09-cni-binary-copy\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611852    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-run-netns\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-var-lib-openvswitch\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611930    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad5b8223-60ed-496c-9e83-ad0bf01ada03-ovnkube-config\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611964    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad5b8223-60ed-496c-9e83-ad0bf01ada03-ovn-node-metrics-cert\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.612574 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.611987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-sysctl-d\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.643610 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.643588    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 23:38:25 +0000 UTC" deadline="2028-02-19 08:16:26.807290122 +0000 UTC"
May 26 23:43:26.643610 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.643609    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15200h33m0.163684097s"
May 26 23:43:26.701860 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.701791    2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 23:43:26.712560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712531    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-conf-dir\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.712661 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712570    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvsrr\" (UniqueName: \"kubernetes.io/projected/d85d57c4-458e-4aa8-94be-930460d8bc09-kube-api-access-rvsrr\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.712661 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712593    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e5b8b7-b63a-4a83-a292-4da4d6761a75-tmp\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.712661 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712639    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-conf-dir\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.712809 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712666    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-sys-fs\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.712809 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712694    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-cnibin\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.712809 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712718    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-run-systemd\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.712809 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712742    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-var-lib-cni-bin\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.712998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712851    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-hostroot\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.712998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712874    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-modprobe-d\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.712998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712773    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-cnibin\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.712998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712811    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-var-lib-cni-bin\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.712998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712777    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-sys-fs\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.712998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712929    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-hostroot\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.712998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712800    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-run-systemd\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.712998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712906    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-kubernetes\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.712998 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712990    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4b7w7\" (UniqueName: \"kubernetes.io/projected/93e5b8b7-b63a-4a83-a292-4da4d6761a75-kube-api-access-4b7w7\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.712962    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713041    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-modprobe-d\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713064    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-kubernetes\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713091    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwjxf\" (UniqueName: \"kubernetes.io/projected/4a50c40a-ed69-44af-bbd3-ec1ee4063160-kube-api-access-lwjxf\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713126    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-os-release\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713160    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-etc-openvswitch\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713188    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-daemon-config\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713202    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-os-release\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713213    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-run-multus-certs\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713231    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-etc-openvswitch\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713239    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-sys\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713296    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-sys\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713295    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b99f2d83-2309-4be0-86fe-5d837c071be9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713318    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-run-multus-certs\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713335    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-os-release\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713362    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-var-lib-kubelet\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713386    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-var-lib-kubelet\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.713403 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713408    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9915d1c-3fad-4080-a23f-01f593cef437-host\") pod \"node-ca-sv6wc\" (UID: \"d9915d1c-3fad-4080-a23f-01f593cef437\") " pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713430    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-system-cni-dir\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713437    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-var-lib-kubelet\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713441    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-os-release\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713454    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713477    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9915d1c-3fad-4080-a23f-01f593cef437-host\") pod \"node-ca-sv6wc\" (UID: \"d9915d1c-3fad-4080-a23f-01f593cef437\") " pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713501    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-var-lib-kubelet\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713525    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-system-cni-dir\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713529    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e92b997-ff62-4a5a-a446-915d36e9e03a-konnectivity-ca\") pod \"konnectivity-agent-kqsj4\" (UID: \"2e92b997-ff62-4a5a-a446-915d36e9e03a\") " pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713562    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713582    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b99f2d83-2309-4be0-86fe-5d837c071be9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713586    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713616    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4223034-5463-473f-811a-e0e3220a52a2-host-slash\") pod \"iptables-alerter-q55q5\" (UID: \"e4223034-5463-473f-811a-e0e3220a52a2\") " pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713645    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-node-log\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713676    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713690    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-node-log\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713695    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4223034-5463-473f-811a-e0e3220a52a2-host-slash\") pod \"iptables-alerter-q55q5\" (UID: \"e4223034-5463-473f-811a-e0e3220a52a2\") " pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.714214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713719    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713720    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-systemd\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713755    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9x7bc\" (UniqueName: \"kubernetes.io/projected/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-kube-api-access-9x7bc\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713760    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-systemd\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713789    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-var-lib-cni-multus\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713816    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-etc-kubernetes\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713830    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-var-lib-cni-multus\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713841    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-device-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713850    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-daemon-config\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713873    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxzf7\" (UniqueName: \"kubernetes.io/projected/e4223034-5463-473f-811a-e0e3220a52a2-kube-api-access-pxzf7\") pod \"iptables-alerter-q55q5\" (UID: \"e4223034-5463-473f-811a-e0e3220a52a2\") " pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713852    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b99f2d83-2309-4be0-86fe-5d837c071be9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713900    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-run-openvswitch\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713885    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-etc-kubernetes\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713947    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-run-openvswitch\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.713949    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-device-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714018    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e92b997-ff62-4a5a-a446-915d36e9e03a-konnectivity-ca\") pod \"konnectivity-agent-kqsj4\" (UID: \"2e92b997-ff62-4a5a-a446-915d36e9e03a\") " pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714018    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-sysctl-conf\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.714999 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714068    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-log-socket\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714096    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-socket-dir-parent\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714121    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-socket-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714138    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-log-socket\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714146    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9vgn\" (UniqueName: \"kubernetes.io/projected/b99f2d83-2309-4be0-86fe-5d837c071be9-kube-api-access-q9vgn\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714164    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-sysctl-conf\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714173    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-systemd-units\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714177    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-socket-dir-parent\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714199    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad5b8223-60ed-496c-9e83-ad0bf01ada03-env-overrides\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714216    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-systemd-units\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714222    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad5b8223-60ed-496c-9e83-ad0bf01ada03-ovnkube-script-lib\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714246    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-cni-dir\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714247    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-socket-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714303    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-run-k8s-cni-cncf-io\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714322    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-multus-cni-dir\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714331    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714365    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-kubelet\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.715826 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714377    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-run-k8s-cni-cncf-io\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714389    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d85d57c4-458e-4aa8-94be-930460d8bc09-cni-binary-copy\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714421    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-run-netns\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714424    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-kubelet\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714445    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714469    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-var-lib-openvswitch\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714493    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad5b8223-60ed-496c-9e83-ad0bf01ada03-ovnkube-config\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714560    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-host-run-netns\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714576    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad5b8223-60ed-496c-9e83-ad0bf01ada03-ovn-node-metrics-cert\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:26.714587    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714593    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad5b8223-60ed-496c-9e83-ad0bf01ada03-env-overrides\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714600    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-sysctl-d\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714613    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-var-lib-openvswitch\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714626    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-host\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:26.714681    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs podName:e4942eb9-3d0f-431a-97a5-ee6cba6a5a66 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:27.214635087 +0000 UTC m=+3.110455848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs") pod "network-metrics-daemon-4gd6s" (UID: "e4942eb9-3d0f-431a-97a5-ee6cba6a5a66") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714686    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-host\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714700    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b99f2d83-2309-4be0-86fe-5d837c071be9-cni-binary-copy\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.716560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714726    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-slash\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714749    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-run-netns\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714773    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714797    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-sysctl-d\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714800    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-cnibin\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714834    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-sysconfig\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714836    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad5b8223-60ed-496c-9e83-ad0bf01ada03-ovnkube-script-lib\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714846    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-cnibin\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714858    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-tuned\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714881    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9915d1c-3fad-4080-a23f-01f593cef437-serviceca\") pod \"node-ca-sv6wc\" (UID: \"d9915d1c-3fad-4080-a23f-01f593cef437\") " pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714906    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e92b997-ff62-4a5a-a446-915d36e9e03a-agent-certs\") pod \"konnectivity-agent-kqsj4\" (UID: \"2e92b997-ff62-4a5a-a446-915d36e9e03a\") " pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714909    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-sysconfig\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714939    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-registration-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714968    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-system-cni-dir\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714970    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d85d57c4-458e-4aa8-94be-930460d8bc09-cni-binary-copy\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.714995    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715031    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715037    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-cni-bin\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715091    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-cni-netd\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715099    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a50c40a-ed69-44af-bbd3-ec1ee4063160-registration-dir\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715121    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-run\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715144    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-lib-modules\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715147    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d85d57c4-458e-4aa8-94be-930460d8bc09-system-cni-dir\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715171    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95t7w\" (UniqueName: \"kubernetes.io/projected/d9915d1c-3fad-4080-a23f-01f593cef437-kube-api-access-95t7w\") pod \"node-ca-sv6wc\" (UID: \"d9915d1c-3fad-4080-a23f-01f593cef437\") " pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715197    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4223034-5463-473f-811a-e0e3220a52a2-iptables-alerter-script\") pod \"iptables-alerter-q55q5\" (UID: \"e4223034-5463-473f-811a-e0e3220a52a2\") " pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715202    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-cni-netd\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715239    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-cni-bin\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715246    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b99f2d83-2309-4be0-86fe-5d837c071be9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715272    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-run-ovn\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715281    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-run-netns\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715311    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnw4t\" (UniqueName: \"kubernetes.io/projected/ad5b8223-60ed-496c-9e83-ad0bf01ada03-kube-api-access-lnw4t\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715322    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-slash\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715384    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715439    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b99f2d83-2309-4be0-86fe-5d837c071be9-cni-binary-copy\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715502    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad5b8223-60ed-496c-9e83-ad0bf01ada03-run-ovn\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.717917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715814    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-lib-modules\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.718629 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715852    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4223034-5463-473f-811a-e0e3220a52a2-iptables-alerter-script\") pod \"iptables-alerter-q55q5\" (UID: \"e4223034-5463-473f-811a-e0e3220a52a2\") " pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.718629 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715862    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93e5b8b7-b63a-4a83-a292-4da4d6761a75-run\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.718629 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715873    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b99f2d83-2309-4be0-86fe-5d837c071be9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.718629 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.715908    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9915d1c-3fad-4080-a23f-01f593cef437-serviceca\") pod \"node-ca-sv6wc\" (UID: \"d9915d1c-3fad-4080-a23f-01f593cef437\") " pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.718629 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.716097    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad5b8223-60ed-496c-9e83-ad0bf01ada03-ovnkube-config\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.718629 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.717179    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e5b8b7-b63a-4a83-a292-4da4d6761a75-tmp\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.718629 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.717757    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e92b997-ff62-4a5a-a446-915d36e9e03a-agent-certs\") pod \"konnectivity-agent-kqsj4\" (UID: \"2e92b997-ff62-4a5a-a446-915d36e9e03a\") " pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:26.718629 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.717787    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad5b8223-60ed-496c-9e83-ad0bf01ada03-ovn-node-metrics-cert\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.718629 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.717909    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93e5b8b7-b63a-4a83-a292-4da4d6761a75-etc-tuned\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.720386 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:26.720348    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:43:26.720386 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:26.720372    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:43:26.720386 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:26.720384    2574 projected.go:194] Error preparing data for projected volume kube-api-access-h2fjw for pod openshift-network-diagnostics/network-check-target-q9mxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:26.720764 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.720415    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvsrr\" (UniqueName: \"kubernetes.io/projected/d85d57c4-458e-4aa8-94be-930460d8bc09-kube-api-access-rvsrr\") pod \"multus-cl9nk\" (UID: \"d85d57c4-458e-4aa8-94be-930460d8bc09\") " pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.720764 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:26.720484    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw podName:33d8c80a-1504-411a-b3e9-1834b471b952 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:27.220464937 +0000 UTC m=+3.116285676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h2fjw" (UniqueName: "kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw") pod "network-check-target-q9mxd" (UID: "33d8c80a-1504-411a-b3e9-1834b471b952") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:26.720888 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.720804    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwjxf\" (UniqueName: \"kubernetes.io/projected/4a50c40a-ed69-44af-bbd3-ec1ee4063160-kube-api-access-lwjxf\") pod \"aws-ebs-csi-driver-node-j5b22\" (UID: \"4a50c40a-ed69-44af-bbd3-ec1ee4063160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.721673 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.721640    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x7bc\" (UniqueName: \"kubernetes.io/projected/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-kube-api-access-9x7bc\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:26.722544 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.722522    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxzf7\" (UniqueName: \"kubernetes.io/projected/e4223034-5463-473f-811a-e0e3220a52a2-kube-api-access-pxzf7\") pod \"iptables-alerter-q55q5\" (UID: \"e4223034-5463-473f-811a-e0e3220a52a2\") " pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:26.722917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.722895    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b7w7\" (UniqueName: \"kubernetes.io/projected/93e5b8b7-b63a-4a83-a292-4da4d6761a75-kube-api-access-4b7w7\") pod \"tuned-nrcpk\" (UID: \"93e5b8b7-b63a-4a83-a292-4da4d6761a75\") " pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.723682 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.723650    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9vgn\" (UniqueName: \"kubernetes.io/projected/b99f2d83-2309-4be0-86fe-5d837c071be9-kube-api-access-q9vgn\") pod \"multus-additional-cni-plugins-2ls22\" (UID: \"b99f2d83-2309-4be0-86fe-5d837c071be9\") " pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.724656 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.724626    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnw4t\" (UniqueName: \"kubernetes.io/projected/ad5b8223-60ed-496c-9e83-ad0bf01ada03-kube-api-access-lnw4t\") pod \"ovnkube-node-q2j7n\" (UID: \"ad5b8223-60ed-496c-9e83-ad0bf01ada03\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.724792 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.724775    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95t7w\" (UniqueName: \"kubernetes.io/projected/d9915d1c-3fad-4080-a23f-01f593cef437-kube-api-access-95t7w\") pod \"node-ca-sv6wc\" (UID: \"d9915d1c-3fad-4080-a23f-01f593cef437\") " pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.892606 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.892575    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2ls22"
May 26 23:43:26.900342 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.900316    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cl9nk"
May 26 23:43:26.908991 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.908969    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nrcpk"
May 26 23:43:26.914512 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.914496    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sv6wc"
May 26 23:43:26.920245 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.920226    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:26.926794 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.926769    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:26.933318 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.933295    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22"
May 26 23:43:26.939812 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:26.939795    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q55q5"
May 26 23:43:27.218374 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.218348    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:27.218571 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:27.218466    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:27.218571 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:27.218530    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs podName:e4942eb9-3d0f-431a-97a5-ee6cba6a5a66 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:28.218511617 +0000 UTC m=+4.114332358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs") pod "network-metrics-daemon-4gd6s" (UID: "e4942eb9-3d0f-431a-97a5-ee6cba6a5a66") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:27.250573 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:27.250539    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9915d1c_3fad_4080_a23f_01f593cef437.slice/crio-f3b4d0a973d59c75bbc3b70b7ae1473765336d34a0ba4684d2d5fc88cf18dedb WatchSource:0}: Error finding container f3b4d0a973d59c75bbc3b70b7ae1473765336d34a0ba4684d2d5fc88cf18dedb: Status 404 returned error can't find the container with id f3b4d0a973d59c75bbc3b70b7ae1473765336d34a0ba4684d2d5fc88cf18dedb
May 26 23:43:27.251631 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:27.251593    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99f2d83_2309_4be0_86fe_5d837c071be9.slice/crio-2e3742b302685eac5bf1c6d51910bf9adb51f1432327ab6759b105168e3c3623 WatchSource:0}: Error finding container 2e3742b302685eac5bf1c6d51910bf9adb51f1432327ab6759b105168e3c3623: Status 404 returned error can't find the container with id 2e3742b302685eac5bf1c6d51910bf9adb51f1432327ab6759b105168e3c3623
May 26 23:43:27.252878 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:27.252835    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4223034_5463_473f_811a_e0e3220a52a2.slice/crio-b6d7793eada68edcd4c0b91d3901eac80fa9dc3c20d838ab919bb442f38f336a WatchSource:0}: Error finding container b6d7793eada68edcd4c0b91d3901eac80fa9dc3c20d838ab919bb442f38f336a: Status 404 returned error can't find the container with id b6d7793eada68edcd4c0b91d3901eac80fa9dc3c20d838ab919bb442f38f336a
May 26 23:43:27.255270 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:27.255117    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85d57c4_458e_4aa8_94be_930460d8bc09.slice/crio-64fe08b16838a769a30b7e51583db5f4631810c77157ea1c7fc9c64bf78d881b WatchSource:0}: Error finding container 64fe08b16838a769a30b7e51583db5f4631810c77157ea1c7fc9c64bf78d881b: Status 404 returned error can't find the container with id 64fe08b16838a769a30b7e51583db5f4631810c77157ea1c7fc9c64bf78d881b
May 26 23:43:27.256207 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:27.256189    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e92b997_ff62_4a5a_a446_915d36e9e03a.slice/crio-7cd83101e49d7ffdd4eed6403e7ede892d4a4d3f916d88122654c1e524dd01c5 WatchSource:0}: Error finding container 7cd83101e49d7ffdd4eed6403e7ede892d4a4d3f916d88122654c1e524dd01c5: Status 404 returned error can't find the container with id 7cd83101e49d7ffdd4eed6403e7ede892d4a4d3f916d88122654c1e524dd01c5
May 26 23:43:27.256986 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:27.256952    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5b8223_60ed_496c_9e83_ad0bf01ada03.slice/crio-eb2f8c60eee063759e4e6afc8e36c3700b19640d9bd7162181f9987af347b047 WatchSource:0}: Error finding container eb2f8c60eee063759e4e6afc8e36c3700b19640d9bd7162181f9987af347b047: Status 404 returned error can't find the container with id eb2f8c60eee063759e4e6afc8e36c3700b19640d9bd7162181f9987af347b047
May 26 23:43:27.258313 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:27.258160    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a50c40a_ed69_44af_bbd3_ec1ee4063160.slice/crio-c9fff15df99717180c08750e0562e7f3eb417fc53699ca18e29a634eddeccc63 WatchSource:0}: Error finding container c9fff15df99717180c08750e0562e7f3eb417fc53699ca18e29a634eddeccc63: Status 404 returned error can't find the container with id c9fff15df99717180c08750e0562e7f3eb417fc53699ca18e29a634eddeccc63
May 26 23:43:27.259092 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:27.259069    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e5b8b7_b63a_4a83_a292_4da4d6761a75.slice/crio-84a95f1d3d89f341751848d77595064f6b59de6d299dcdcf8674d78444b49e09 WatchSource:0}: Error finding container 84a95f1d3d89f341751848d77595064f6b59de6d299dcdcf8674d78444b49e09: Status 404 returned error can't find the container with id 84a95f1d3d89f341751848d77595064f6b59de6d299dcdcf8674d78444b49e09
May 26 23:43:27.319404 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.319381    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:27.319541 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:27.319525    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:43:27.319583 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:27.319558    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:43:27.319583 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:27.319570    2574 projected.go:194] Error preparing data for projected volume kube-api-access-h2fjw for pod openshift-network-diagnostics/network-check-target-q9mxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:27.319680 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:27.319619    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw podName:33d8c80a-1504-411a-b3e9-1834b471b952 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:28.319600911 +0000 UTC m=+4.215421666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2fjw" (UniqueName: "kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw") pod "network-check-target-q9mxd" (UID: "33d8c80a-1504-411a-b3e9-1834b471b952") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:27.473095 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.472823    2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:43:27.644036 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.643999    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 23:38:25 +0000 UTC" deadline="2028-03-06 15:21:54.871760724 +0000 UTC"
May 26 23:43:27.644036 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.644030    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15591h38m27.227733256s"
May 26 23:43:27.700198 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.700165    2574 generic.go:358] "Generic (PLEG): container finished" podID="1a58fbb70d755888352f12da46ad7b0d" containerID="d0c4f8c59072fb2a6990c18af1e62227a4070c40cc58ee1cf71e740247f18448" exitCode=0
May 26 23:43:27.700320 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.700241    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"1a58fbb70d755888352f12da46ad7b0d","Type":"ContainerDied","Data":"d0c4f8c59072fb2a6990c18af1e62227a4070c40cc58ee1cf71e740247f18448"}
May 26 23:43:27.701457 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.701436    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" event={"ID":"f4c644e74d9922165a4478c112ee14b0","Type":"ContainerStarted","Data":"5795ee93ba6f0454b214bd55aa4988cb9e94c97e5dbf9c921a01db958cbe1cad"}
May 26 23:43:27.702393 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.702368    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nrcpk" event={"ID":"93e5b8b7-b63a-4a83-a292-4da4d6761a75","Type":"ContainerStarted","Data":"84a95f1d3d89f341751848d77595064f6b59de6d299dcdcf8674d78444b49e09"}
May 26 23:43:27.703320 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.703300    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerStarted","Data":"eb2f8c60eee063759e4e6afc8e36c3700b19640d9bd7162181f9987af347b047"}
May 26 23:43:27.704254 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.704235    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q55q5" event={"ID":"e4223034-5463-473f-811a-e0e3220a52a2","Type":"ContainerStarted","Data":"b6d7793eada68edcd4c0b91d3901eac80fa9dc3c20d838ab919bb442f38f336a"}
May 26 23:43:27.705120 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.705104    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ls22" event={"ID":"b99f2d83-2309-4be0-86fe-5d837c071be9","Type":"ContainerStarted","Data":"2e3742b302685eac5bf1c6d51910bf9adb51f1432327ab6759b105168e3c3623"}
May 26 23:43:27.705983 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.705962    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sv6wc" event={"ID":"d9915d1c-3fad-4080-a23f-01f593cef437","Type":"ContainerStarted","Data":"f3b4d0a973d59c75bbc3b70b7ae1473765336d34a0ba4684d2d5fc88cf18dedb"}
May 26 23:43:27.706827 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.706807    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22" event={"ID":"4a50c40a-ed69-44af-bbd3-ec1ee4063160","Type":"ContainerStarted","Data":"c9fff15df99717180c08750e0562e7f3eb417fc53699ca18e29a634eddeccc63"}
May 26 23:43:27.707706 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.707680    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kqsj4" event={"ID":"2e92b997-ff62-4a5a-a446-915d36e9e03a","Type":"ContainerStarted","Data":"7cd83101e49d7ffdd4eed6403e7ede892d4a4d3f916d88122654c1e524dd01c5"}
May 26 23:43:27.708557 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.708539    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cl9nk" event={"ID":"d85d57c4-458e-4aa8-94be-930460d8bc09","Type":"ContainerStarted","Data":"64fe08b16838a769a30b7e51583db5f4631810c77157ea1c7fc9c64bf78d881b"}
May 26 23:43:27.726701 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:27.726627    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-0.ec2.internal" podStartSLOduration=2.726610879 podStartE2EDuration="2.726610879s" podCreationTimestamp="2026-05-26 23:43:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:43:27.726290639 +0000 UTC m=+3.622111399" watchObservedRunningTime="2026-05-26 23:43:27.726610879 +0000 UTC m=+3.622431641"
May 26 23:43:28.228360 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:28.227853    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:28.228360 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:28.227949    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:28.228360 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:28.228017    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs podName:e4942eb9-3d0f-431a-97a5-ee6cba6a5a66 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:30.227998223 +0000 UTC m=+6.123818978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs") pod "network-metrics-daemon-4gd6s" (UID: "e4942eb9-3d0f-431a-97a5-ee6cba6a5a66") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:28.329167 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:28.329124    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:28.329352 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:28.329338    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:43:28.329443 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:28.329358    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:43:28.329443 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:28.329371    2574 projected.go:194] Error preparing data for projected volume kube-api-access-h2fjw for pod openshift-network-diagnostics/network-check-target-q9mxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:28.329443 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:28.329427    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw podName:33d8c80a-1504-411a-b3e9-1834b471b952 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:30.329409955 +0000 UTC m=+6.225230693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2fjw" (UniqueName: "kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw") pod "network-check-target-q9mxd" (UID: "33d8c80a-1504-411a-b3e9-1834b471b952") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:28.695662 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:28.695625    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:28.696121 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:28.695772    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:28.696121 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:28.695869    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:28.696121 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:28.695936    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:28.719615 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:28.719552    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" event={"ID":"1a58fbb70d755888352f12da46ad7b0d","Type":"ContainerStarted","Data":"1640c2727817d0735d80e0fceb1740ed477bfc0069aa9d75abb97246b0037fef"}
May 26 23:43:28.731393 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:28.731348    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-0.ec2.internal" podStartSLOduration=3.731331565 podStartE2EDuration="3.731331565s" podCreationTimestamp="2026-05-26 23:43:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:43:28.730533831 +0000 UTC m=+4.626354592" watchObservedRunningTime="2026-05-26 23:43:28.731331565 +0000 UTC m=+4.627152329"
May 26 23:43:30.247359 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:30.247326    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:30.247730 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:30.247479    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:30.247730 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:30.247540    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs podName:e4942eb9-3d0f-431a-97a5-ee6cba6a5a66 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:34.247521197 +0000 UTC m=+10.143341939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs") pod "network-metrics-daemon-4gd6s" (UID: "e4942eb9-3d0f-431a-97a5-ee6cba6a5a66") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:30.347811 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:30.347750    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:30.347970 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:30.347930    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:43:30.347970 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:30.347949    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:43:30.347970 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:30.347963    2574 projected.go:194] Error preparing data for projected volume kube-api-access-h2fjw for pod openshift-network-diagnostics/network-check-target-q9mxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:30.348158 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:30.348018    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw podName:33d8c80a-1504-411a-b3e9-1834b471b952 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:34.348000066 +0000 UTC m=+10.243820807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2fjw" (UniqueName: "kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw") pod "network-check-target-q9mxd" (UID: "33d8c80a-1504-411a-b3e9-1834b471b952") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:30.693589 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:30.693556    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:30.693756 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:30.693705    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:30.694024 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:30.693558    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:30.694024 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:30.693943    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:32.694359 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:32.694324    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:32.694804 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:32.694462    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:32.694902 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:32.694883    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:32.694997 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:32.694978    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:34.274796 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:34.274576    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:34.274796 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:34.274747    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:34.275487 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:34.274813    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs podName:e4942eb9-3d0f-431a-97a5-ee6cba6a5a66 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:42.274793123 +0000 UTC m=+18.170613860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs") pod "network-metrics-daemon-4gd6s" (UID: "e4942eb9-3d0f-431a-97a5-ee6cba6a5a66") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:34.375386 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:34.375352    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:34.375572 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:34.375506    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:43:34.375572 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:34.375529    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:43:34.375572 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:34.375543    2574 projected.go:194] Error preparing data for projected volume kube-api-access-h2fjw for pod openshift-network-diagnostics/network-check-target-q9mxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:34.375730 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:34.375600    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw podName:33d8c80a-1504-411a-b3e9-1834b471b952 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:42.37558528 +0000 UTC m=+18.271406022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2fjw" (UniqueName: "kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw") pod "network-check-target-q9mxd" (UID: "33d8c80a-1504-411a-b3e9-1834b471b952") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:34.693983 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:34.693952    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:34.694167 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:34.694083    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:34.694438 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:34.694417    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:34.694548 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:34.694529    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:36.692648 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:36.692619    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:36.693114 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:36.692657    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:36.693114 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:36.692745    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:36.693114 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:36.692871    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:38.692970 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:38.692929    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:38.693458 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:38.692938    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:38.693458 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:38.693084    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:38.693458 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:38.693124    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:40.693233 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:40.693192    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:40.693702 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:40.693210    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:40.693702 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:40.693340    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:40.693702 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:40.693436    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:42.329240 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:42.329192    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:42.329624 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:42.329351    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:42.329624 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:42.329439    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs podName:e4942eb9-3d0f-431a-97a5-ee6cba6a5a66 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:58.329413789 +0000 UTC m=+34.225234536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs") pod "network-metrics-daemon-4gd6s" (UID: "e4942eb9-3d0f-431a-97a5-ee6cba6a5a66") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:42.430284 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:42.430245    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:42.430444 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:42.430406    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:43:42.430444 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:42.430426    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:43:42.430444 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:42.430436    2574 projected.go:194] Error preparing data for projected volume kube-api-access-h2fjw for pod openshift-network-diagnostics/network-check-target-q9mxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:42.430587 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:42.430494    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw podName:33d8c80a-1504-411a-b3e9-1834b471b952 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:58.430477784 +0000 UTC m=+34.326298525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2fjw" (UniqueName: "kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw") pod "network-check-target-q9mxd" (UID: "33d8c80a-1504-411a-b3e9-1834b471b952") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:42.692954 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:42.692873    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:42.693141 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:42.692873    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:42.693141 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:42.693015    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:42.693141 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:42.693113    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:44.693380 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:44.693347    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:44.693824 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:44.693445    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:44.693824 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:44.693518    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:44.693824 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:44.693595    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:45.748857 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.748419    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nrcpk" event={"ID":"93e5b8b7-b63a-4a83-a292-4da4d6761a75","Type":"ContainerStarted","Data":"c6346e1eddf5f67acf44399270df5558a468a4a5993c22687fb225dabc819eb0"}
May 26 23:43:45.750677 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.750655    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:43:45.751021 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.751000    2574 generic.go:358] "Generic (PLEG): container finished" podID="ad5b8223-60ed-496c-9e83-ad0bf01ada03" containerID="34256073f2f58d72145648229a95608dce2fa885f3d09905fa0786e56ccab040" exitCode=1
May 26 23:43:45.751109 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.751073    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerStarted","Data":"bd01e3031ef89b49b206f1c46d3b6755f3feaeef7f5101ef112b5e948aa0715d"}
May 26 23:43:45.751109 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.751099    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerStarted","Data":"40a9aa849701a59fdef8dd8795eeb5eff120c2b51e8af4462541aee19db9929a"}
May 26 23:43:45.751109 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.751109    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerDied","Data":"34256073f2f58d72145648229a95608dce2fa885f3d09905fa0786e56ccab040"}
May 26 23:43:45.751237 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.751120    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerStarted","Data":"a632d055416ff78e6c0666882dd2fa302a92b090b0847a0156f8e01ca39e3be9"}
May 26 23:43:45.752458 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.752432    2574 generic.go:358] "Generic (PLEG): container finished" podID="b99f2d83-2309-4be0-86fe-5d837c071be9" containerID="c7cb1777cf5fb7d807dccd3e08f92f8f12dfed5e7cfe848528b9ae27f090c0fc" exitCode=0
May 26 23:43:45.752555 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.752521    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ls22" event={"ID":"b99f2d83-2309-4be0-86fe-5d837c071be9","Type":"ContainerDied","Data":"c7cb1777cf5fb7d807dccd3e08f92f8f12dfed5e7cfe848528b9ae27f090c0fc"}
May 26 23:43:45.753812 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.753784    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sv6wc" event={"ID":"d9915d1c-3fad-4080-a23f-01f593cef437","Type":"ContainerStarted","Data":"9c654ea3ed4b03f230970d7a9dae6807e8a8eaf745c77286b6ff2c74e3b89536"}
May 26 23:43:45.755063 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.755030    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22" event={"ID":"4a50c40a-ed69-44af-bbd3-ec1ee4063160","Type":"ContainerStarted","Data":"d65aaef7cc96d90f7a2d4441819d014c992fa5ccacec8791f99ca4522ed08480"}
May 26 23:43:45.756275 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.756254    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kqsj4" event={"ID":"2e92b997-ff62-4a5a-a446-915d36e9e03a","Type":"ContainerStarted","Data":"e713a0edb857c687f1058fbb05424a6041b6b45b72718b31634563b16a0b26a5"}
May 26 23:43:45.757602 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.757542    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cl9nk" event={"ID":"d85d57c4-458e-4aa8-94be-930460d8bc09","Type":"ContainerStarted","Data":"a2f54f8a503666a6f55ce08210c9adb58ba6c11858856706f465e5edce8e5114"}
May 26 23:43:45.766400 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.766358    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nrcpk" podStartSLOduration=4.114630926 podStartE2EDuration="21.766345327s" podCreationTimestamp="2026-05-26 23:43:24 +0000 UTC" firstStartedPulling="2026-05-26 23:43:27.282375657 +0000 UTC m=+3.178196396" lastFinishedPulling="2026-05-26 23:43:44.934090051 +0000 UTC m=+20.829910797" observedRunningTime="2026-05-26 23:43:45.764451729 +0000 UTC m=+21.660272491" watchObservedRunningTime="2026-05-26 23:43:45.766345327 +0000 UTC m=+21.662166110"
May 26 23:43:45.805433 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.805386    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-cl9nk" podStartSLOduration=4.115866587 podStartE2EDuration="21.805370935s" podCreationTimestamp="2026-05-26 23:43:24 +0000 UTC" firstStartedPulling="2026-05-26 23:43:27.257223905 +0000 UTC m=+3.153044644" lastFinishedPulling="2026-05-26 23:43:44.946728254 +0000 UTC m=+20.842548992" observedRunningTime="2026-05-26 23:43:45.803742324 +0000 UTC m=+21.699563085" watchObservedRunningTime="2026-05-26 23:43:45.805370935 +0000 UTC m=+21.701191716"
May 26 23:43:45.818085 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.818021    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sv6wc" podStartSLOduration=4.138734269 podStartE2EDuration="21.818006257s" podCreationTimestamp="2026-05-26 23:43:24 +0000 UTC" firstStartedPulling="2026-05-26 23:43:27.252659515 +0000 UTC m=+3.148480259" lastFinishedPulling="2026-05-26 23:43:44.931931496 +0000 UTC m=+20.827752247" observedRunningTime="2026-05-26 23:43:45.817976084 +0000 UTC m=+21.713796845" watchObservedRunningTime="2026-05-26 23:43:45.818006257 +0000 UTC m=+21.713827018"
May 26 23:43:45.829356 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:45.829307    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kqsj4" podStartSLOduration=8.937488073 podStartE2EDuration="21.829295182s" podCreationTimestamp="2026-05-26 23:43:24 +0000 UTC" firstStartedPulling="2026-05-26 23:43:27.258309388 +0000 UTC m=+3.154130128" lastFinishedPulling="2026-05-26 23:43:40.150116499 +0000 UTC m=+16.045937237" observedRunningTime="2026-05-26 23:43:45.828731261 +0000 UTC m=+21.724552022" watchObservedRunningTime="2026-05-26 23:43:45.829295182 +0000 UTC m=+21.725115943"
May 26 23:43:46.352673 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.352646    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 23:43:46.498991 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.498905    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:46.500090 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.500067    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:46.666850 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.666745    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T23:43:46.352668436Z","UUID":"a534a06b-98f2-4911-b694-7b839648e06a","Handler":null,"Name":"","Endpoint":""}
May 26 23:43:46.669916 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.669892    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 23:43:46.670075 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.669924    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 23:43:46.692669 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.692644    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:46.692819 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.692645    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:46.692819 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:46.692759    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:46.692933 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:46.692830    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:46.763096 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.763067    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:43:46.763520 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.763480    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerStarted","Data":"58839ef6d4e9ceb08182910c895b368d1bd07f36ab8e68ab7b1013e9562dccc8"}
May 26 23:43:46.763578 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.763521    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerStarted","Data":"5b69186038c66fe90438c5667425a77bb91022823bed150499f75516c238e40a"}
May 26 23:43:46.764926 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.764898    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q55q5" event={"ID":"e4223034-5463-473f-811a-e0e3220a52a2","Type":"ContainerStarted","Data":"1c312607f18437dbe5a373ae8ed0ad6d672d6156db658dd1c054c588d9fbf327"}
May 26 23:43:46.766646 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.766613    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22" event={"ID":"4a50c40a-ed69-44af-bbd3-ec1ee4063160","Type":"ContainerStarted","Data":"4b7dc3cc298c91873da7683568fcbb251a5d30182e0ada9c78a6cbf2d150ad1b"}
May 26 23:43:46.767242 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.767213    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:46.767553 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.767525    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kqsj4"
May 26 23:43:46.811577 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:46.811526    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q55q5" podStartSLOduration=4.135509513 podStartE2EDuration="21.811510169s" podCreationTimestamp="2026-05-26 23:43:25 +0000 UTC" firstStartedPulling="2026-05-26 23:43:27.254840014 +0000 UTC m=+3.150660765" lastFinishedPulling="2026-05-26 23:43:44.930840681 +0000 UTC m=+20.826661421" observedRunningTime="2026-05-26 23:43:46.788791241 +0000 UTC m=+22.684612004" watchObservedRunningTime="2026-05-26 23:43:46.811510169 +0000 UTC m=+22.707330927"
May 26 23:43:47.770974 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.770931    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22" event={"ID":"4a50c40a-ed69-44af-bbd3-ec1ee4063160","Type":"ContainerStarted","Data":"e2a9cef80d2933962d44b4c73be7ce25156e9896ebf26a3a884c40330197d307"}
May 26 23:43:47.772380 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.772346    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-psbmk"]
May 26 23:43:47.787582 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.787536    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5b22" podStartSLOduration=3.673699961 podStartE2EDuration="23.787520121s" podCreationTimestamp="2026-05-26 23:43:24 +0000 UTC" firstStartedPulling="2026-05-26 23:43:27.282363254 +0000 UTC m=+3.178183991" lastFinishedPulling="2026-05-26 23:43:47.396183408 +0000 UTC m=+23.292004151" observedRunningTime="2026-05-26 23:43:47.787111301 +0000 UTC m=+23.682932062" watchObservedRunningTime="2026-05-26 23:43:47.787520121 +0000 UTC m=+23.683340878"
May 26 23:43:47.788328 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.788308    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:47.790476 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.790454    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nmd5t\""
May 26 23:43:47.790607 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.790481    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 23:43:47.790607 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.790458    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 23:43:47.869134 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.869069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwb6x\" (UniqueName: \"kubernetes.io/projected/fd9846b6-4187-4335-869d-21c8dc444a11-kube-api-access-nwb6x\") pod \"node-resolver-psbmk\" (UID: \"fd9846b6-4187-4335-869d-21c8dc444a11\") " pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:47.869294 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.869174    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd9846b6-4187-4335-869d-21c8dc444a11-tmp-dir\") pod \"node-resolver-psbmk\" (UID: \"fd9846b6-4187-4335-869d-21c8dc444a11\") " pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:47.869366 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.869347    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd9846b6-4187-4335-869d-21c8dc444a11-hosts-file\") pod \"node-resolver-psbmk\" (UID: \"fd9846b6-4187-4335-869d-21c8dc444a11\") " pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:47.970372 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.970337    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd9846b6-4187-4335-869d-21c8dc444a11-hosts-file\") pod \"node-resolver-psbmk\" (UID: \"fd9846b6-4187-4335-869d-21c8dc444a11\") " pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:47.970372 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.970378    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwb6x\" (UniqueName: \"kubernetes.io/projected/fd9846b6-4187-4335-869d-21c8dc444a11-kube-api-access-nwb6x\") pod \"node-resolver-psbmk\" (UID: \"fd9846b6-4187-4335-869d-21c8dc444a11\") " pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:47.970625 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.970404    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd9846b6-4187-4335-869d-21c8dc444a11-tmp-dir\") pod \"node-resolver-psbmk\" (UID: \"fd9846b6-4187-4335-869d-21c8dc444a11\") " pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:47.970625 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.970476    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd9846b6-4187-4335-869d-21c8dc444a11-hosts-file\") pod \"node-resolver-psbmk\" (UID: \"fd9846b6-4187-4335-869d-21c8dc444a11\") " pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:47.970770 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.970750    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd9846b6-4187-4335-869d-21c8dc444a11-tmp-dir\") pod \"node-resolver-psbmk\" (UID: \"fd9846b6-4187-4335-869d-21c8dc444a11\") " pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:47.980440 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:47.980417    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwb6x\" (UniqueName: \"kubernetes.io/projected/fd9846b6-4187-4335-869d-21c8dc444a11-kube-api-access-nwb6x\") pod \"node-resolver-psbmk\" (UID: \"fd9846b6-4187-4335-869d-21c8dc444a11\") " pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:48.097720 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:48.097692    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-psbmk"
May 26 23:43:48.109215 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:43:48.109183    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9846b6_4187_4335_869d_21c8dc444a11.slice/crio-86cd65e536e7ae5d018b095e5d3b0a096394bae008136e07657587a887558583 WatchSource:0}: Error finding container 86cd65e536e7ae5d018b095e5d3b0a096394bae008136e07657587a887558583: Status 404 returned error can't find the container with id 86cd65e536e7ae5d018b095e5d3b0a096394bae008136e07657587a887558583
May 26 23:43:48.692609 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:48.692404    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:48.692789 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:48.692405    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:48.692789 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:48.692717    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:48.692884 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:48.692810    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:48.776681 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:48.776649    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:43:48.777212 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:48.777071    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerStarted","Data":"5348bc1376faf52e457ad1fbdda85c482b7104d3c87aba99aff1e995a3c9f289"}
May 26 23:43:48.778586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:48.778517    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-psbmk" event={"ID":"fd9846b6-4187-4335-869d-21c8dc444a11","Type":"ContainerStarted","Data":"fa81866c6402b8be37e6825b93b873345ecb5772d57480c5e5eedfea1614844d"}
May 26 23:43:48.778586 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:48.778557    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-psbmk" event={"ID":"fd9846b6-4187-4335-869d-21c8dc444a11","Type":"ContainerStarted","Data":"86cd65e536e7ae5d018b095e5d3b0a096394bae008136e07657587a887558583"}
May 26 23:43:48.792894 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:48.792836    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-psbmk" podStartSLOduration=1.7928210249999998 podStartE2EDuration="1.792821025s" podCreationTimestamp="2026-05-26 23:43:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:43:48.792581008 +0000 UTC m=+24.688401768" watchObservedRunningTime="2026-05-26 23:43:48.792821025 +0000 UTC m=+24.688641790"
May 26 23:43:50.692789 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.692534    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:50.692789 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.692533    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:50.693529 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:50.692790    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:50.693529 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:50.692852    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:50.784591 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.784565    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:43:50.784928 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.784901    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerStarted","Data":"c245db3f8d4bbb94b5cefba1a1608989b1a989514d3c0a1cbacc35063b359fe5"}
May 26 23:43:50.785360 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.785335    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:50.785479 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.785369    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:50.785479 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.785461    2574 scope.go:117] "RemoveContainer" containerID="34256073f2f58d72145648229a95608dce2fa885f3d09905fa0786e56ccab040"
May 26 23:43:50.786580 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.786551    2574 generic.go:358] "Generic (PLEG): container finished" podID="b99f2d83-2309-4be0-86fe-5d837c071be9" containerID="15ac628c94c6bb459ef70491601c3e6d72a05835a7d59a0485f7d5b3272dda23" exitCode=0
May 26 23:43:50.786660 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.786602    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ls22" event={"ID":"b99f2d83-2309-4be0-86fe-5d837c071be9","Type":"ContainerDied","Data":"15ac628c94c6bb459ef70491601c3e6d72a05835a7d59a0485f7d5b3272dda23"}
May 26 23:43:50.802148 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:50.802128    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:51.791501 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:51.791477    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:43:51.791871 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:51.791844    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" event={"ID":"ad5b8223-60ed-496c-9e83-ad0bf01ada03","Type":"ContainerStarted","Data":"c74bbc00237e356dab6f32c3d4e02b12244c8041cc1608a88652b56f120e2fd8"}
May 26 23:43:51.792272 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:51.792252    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:51.793845 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:51.793817    2574 generic.go:358] "Generic (PLEG): container finished" podID="b99f2d83-2309-4be0-86fe-5d837c071be9" containerID="807c7248410dc79cc34c394a3054f35f789bcecaae610b24f016c8271c5d938c" exitCode=0
May 26 23:43:51.793953 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:51.793848    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ls22" event={"ID":"b99f2d83-2309-4be0-86fe-5d837c071be9","Type":"ContainerDied","Data":"807c7248410dc79cc34c394a3054f35f789bcecaae610b24f016c8271c5d938c"}
May 26 23:43:51.807515 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:51.807495    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:43:51.818728 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:51.818688    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n" podStartSLOduration=10.115838957 podStartE2EDuration="27.81867465s" podCreationTimestamp="2026-05-26 23:43:24 +0000 UTC" firstStartedPulling="2026-05-26 23:43:27.279905374 +0000 UTC m=+3.175726112" lastFinishedPulling="2026-05-26 23:43:44.982741054 +0000 UTC m=+20.878561805" observedRunningTime="2026-05-26 23:43:51.818192009 +0000 UTC m=+27.714012770" watchObservedRunningTime="2026-05-26 23:43:51.81867465 +0000 UTC m=+27.714495410"
May 26 23:43:52.189491 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:52.189458    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q9mxd"]
May 26 23:43:52.189658 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:52.189581    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:52.189743 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:52.189661    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:52.192169 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:52.192146    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4gd6s"]
May 26 23:43:52.192266 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:52.192242    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:52.192336 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:52.192318    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:52.797507 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:52.797472    2574 generic.go:358] "Generic (PLEG): container finished" podID="b99f2d83-2309-4be0-86fe-5d837c071be9" containerID="e8aac4f54f1a327e59a3cca011af8bdf688f725aa317efd385138265bd748a69" exitCode=0
May 26 23:43:52.797906 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:52.797570    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ls22" event={"ID":"b99f2d83-2309-4be0-86fe-5d837c071be9","Type":"ContainerDied","Data":"e8aac4f54f1a327e59a3cca011af8bdf688f725aa317efd385138265bd748a69"}
May 26 23:43:53.692626 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:53.692592    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:53.692813 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:53.692712    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:53.692813 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:53.692803    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:53.692925 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:53.692899    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:55.693414 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:55.693178    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:55.694027 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:55.693186    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:55.694027 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:55.693513    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:55.694027 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:55.693615    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:56.810862 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:56.810779    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jnpf6"]
May 26 23:43:56.841437 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:56.841410    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jnpf6"]
May 26 23:43:56.841582 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:56.841530    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:56.841620 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:56.841599    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jnpf6" podUID="375b33ce-fc77-46c7-b25d-b3b7a5e69a0c"
May 26 23:43:56.934479 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:56.934446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-dbus\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:56.934619 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:56.934511    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-kubelet-config\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:56.934669 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:56.934612    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:57.035919 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.035888    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-kubelet-config\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:57.036117 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.035945    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:57.036117 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.035993    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-dbus\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:57.036117 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.036028    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-kubelet-config\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:57.036263 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:57.036147    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 23:43:57.036263 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:57.036226    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret podName:375b33ce-fc77-46c7-b25d-b3b7a5e69a0c nodeName:}" failed. No retries permitted until 2026-05-26 23:43:57.536204539 +0000 UTC m=+33.432025291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret") pod "global-pull-secret-syncer-jnpf6" (UID: "375b33ce-fc77-46c7-b25d-b3b7a5e69a0c") : object "kube-system"/"original-pull-secret" not registered
May 26 23:43:57.036384 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.036261    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-dbus\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:57.541848 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.541807    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:57.542139 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:57.541965    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 23:43:57.542139 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:57.542042    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret podName:375b33ce-fc77-46c7-b25d-b3b7a5e69a0c nodeName:}" failed. No retries permitted until 2026-05-26 23:43:58.542022797 +0000 UTC m=+34.437843553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret") pod "global-pull-secret-syncer-jnpf6" (UID: "375b33ce-fc77-46c7-b25d-b3b7a5e69a0c") : object "kube-system"/"original-pull-secret" not registered
May 26 23:43:57.692730 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.692701    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:57.692848 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.692702    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:57.692848 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:57.692808    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:43:57.692960 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:57.692910    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9mxd" podUID="33d8c80a-1504-411a-b3e9-1834b471b952"
May 26 23:43:57.885847 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.885774    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-0.ec2.internal" event="NodeReady"
May 26 23:43:57.886398 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.885891    2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 23:43:57.917741 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.917713    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b6484bd8b-x5mgw"]
May 26 23:43:57.923416 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.923397    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:57.925700 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.925675    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 23:43:57.925802 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.925682    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t75lz\""
May 26 23:43:57.926172 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.925954    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 23:43:57.926172 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.926122    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 23:43:57.931956 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.931937    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 23:43:57.935266 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.935248    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b6484bd8b-x5mgw"]
May 26 23:43:57.939209 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.939190    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"]
May 26 23:43:57.942515 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.942496    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9svlm"]
May 26 23:43:57.942651 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.942636    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:43:57.945106 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.945087    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 26 23:43:57.945189 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.945107    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 26 23:43:57.945189 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.945184    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wst9v\""
May 26 23:43:57.945752 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.945738    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9svlm"
May 26 23:43:57.947780 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.947744    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 23:43:57.947984 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.947747    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pnjl\""
May 26 23:43:57.948123 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.948104    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 23:43:57.948778 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.948615    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"]
May 26 23:43:57.952084 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.952025    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9svlm"]
May 26 23:43:57.954941 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.954662    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7mddt"]
May 26 23:43:57.963507 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.963490    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:43:57.965775 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.965754    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7mddt"]
May 26 23:43:57.966150 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.966133    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 23:43:57.966239 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.966133    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gx4rr\""
May 26 23:43:57.966435 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.966419    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 23:43:57.966594 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:57.966579    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 23:43:58.044214 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044178    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/208668b1-eb68-483d-ab6b-cb1bca830afe-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:43:58.044356 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044222    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-trusted-ca\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.044356 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044253    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k8db\" (UniqueName: \"kubernetes.io/projected/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-kube-api-access-7k8db\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.044356 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044297    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-tmp-dir\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.044356 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-registry-certificates\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.044526 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044376    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97fx7\" (UniqueName: \"kubernetes.io/projected/86fa870e-3474-4da6-b96b-ac91909598a2-kube-api-access-97fx7\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:43:58.044526 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.044526 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044462    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.044526 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-config-volume\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.044526 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044502    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04d8454d-67c0-4e20-9719-375325841023-ca-trust-extracted\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.044760 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-image-registry-private-configuration\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.044760 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-installation-pull-secrets\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.044760 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044688    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:43:58.044760 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49njh\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-kube-api-access-49njh\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.044916 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044762    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-bound-sa-token\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.044916 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.044786    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:43:58.146183 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146098    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.146183 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146168    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146192    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-config-volume\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146216    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04d8454d-67c0-4e20-9719-375325841023-ca-trust-extracted\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.146236    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146245    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-image-registry-private-configuration\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.146257    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6484bd8b-x5mgw: secret "image-registry-tls" not found
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.146320    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls podName:04d8454d-67c0-4e20-9719-375325841023 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:58.646301584 +0000 UTC m=+34.542122341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls") pod "image-registry-5b6484bd8b-x5mgw" (UID: "04d8454d-67c0-4e20-9719-375325841023") : secret "image-registry-tls" not found
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.146329    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146341    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-installation-pull-secrets\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146374    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:43:58.146410 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.146386    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls podName:43c7e54b-86c1-404f-938c-8c0a45ab4e0e nodeName:}" failed. No retries permitted until 2026-05-26 23:43:58.646368614 +0000 UTC m=+34.542189373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls") pod "dns-default-9svlm" (UID: "43c7e54b-86c1-404f-938c-8c0a45ab4e0e") : secret "dns-default-metrics-tls" not found
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.146439    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.146477    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert podName:208668b1-eb68-483d-ab6b-cb1bca830afe nodeName:}" failed. No retries permitted until 2026-05-26 23:43:58.646464641 +0000 UTC m=+34.542285392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-84lxj" (UID: "208668b1-eb68-483d-ab6b-cb1bca830afe") : secret "networking-console-plugin-cert" not found
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146436    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49njh\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-kube-api-access-49njh\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146520    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-bound-sa-token\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146544    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146571    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/208668b1-eb68-483d-ab6b-cb1bca830afe-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146595    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-trusted-ca\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146615    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k8db\" (UniqueName: \"kubernetes.io/projected/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-kube-api-access-7k8db\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146636    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04d8454d-67c0-4e20-9719-375325841023-ca-trust-extracted\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146652    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-tmp-dir\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146694    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-registry-certificates\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.146728    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146746    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97fx7\" (UniqueName: \"kubernetes.io/projected/86fa870e-3474-4da6-b96b-ac91909598a2-kube-api-access-97fx7\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.146778    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert podName:86fa870e-3474-4da6-b96b-ac91909598a2 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:58.646762904 +0000 UTC m=+34.542583665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert") pod "ingress-canary-7mddt" (UID: "86fa870e-3474-4da6-b96b-ac91909598a2") : secret "canary-serving-cert" not found
May 26 23:43:58.146861 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.146787    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-config-volume\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.147520 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.147247    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-tmp-dir\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.147520 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.147302    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-registry-certificates\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.147611 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.147584    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-trusted-ca\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.147671 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.147650    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/208668b1-eb68-483d-ab6b-cb1bca830afe-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:43:58.151161 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.151123    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-installation-pull-secrets\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.151161 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.151134    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-image-registry-private-configuration\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.155562 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.155540    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-bound-sa-token\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.155562 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.155551    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49njh\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-kube-api-access-49njh\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.155722 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.155575    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k8db\" (UniqueName: \"kubernetes.io/projected/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-kube-api-access-7k8db\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.155722 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.155619    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97fx7\" (UniqueName: \"kubernetes.io/projected/86fa870e-3474-4da6-b96b-ac91909598a2-kube-api-access-97fx7\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:43:58.348509 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.348453    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:58.348680 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.348621    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:58.348739 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.348711    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs podName:e4942eb9-3d0f-431a-97a5-ee6cba6a5a66 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:30.348681922 +0000 UTC m=+66.244502666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs") pod "network-metrics-daemon-4gd6s" (UID: "e4942eb9-3d0f-431a-97a5-ee6cba6a5a66") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:43:58.448985 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.448894    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:58.449176 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.449060    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:43:58.449176 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.449097    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:43:58.449176 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.449118    2574 projected.go:194] Error preparing data for projected volume kube-api-access-h2fjw for pod openshift-network-diagnostics/network-check-target-q9mxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:58.449176 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.449182    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw podName:33d8c80a-1504-411a-b3e9-1834b471b952 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:30.449161897 +0000 UTC m=+66.344982636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2fjw" (UniqueName: "kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw") pod "network-check-target-q9mxd" (UID: "33d8c80a-1504-411a-b3e9-1834b471b952") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:43:58.549399 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.549348    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:58.549567 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.549499    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 23:43:58.549617 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.549572    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret podName:375b33ce-fc77-46c7-b25d-b3b7a5e69a0c nodeName:}" failed. No retries permitted until 2026-05-26 23:44:00.549555764 +0000 UTC m=+36.445376521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret") pod "global-pull-secret-syncer-jnpf6" (UID: "375b33ce-fc77-46c7-b25d-b3b7a5e69a0c") : object "kube-system"/"original-pull-secret" not registered
May 26 23:43:58.650190 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.650153    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:58.650369 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.650224    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:58.650369 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.650281    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:43:58.650369 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.650316    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 23:43:58.650369 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.650341    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6484bd8b-x5mgw: secret "image-registry-tls" not found
May 26 23:43:58.650369 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.650351    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:43:58.650613 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.650328    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:43:58.650613 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.650402    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls podName:04d8454d-67c0-4e20-9719-375325841023 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:59.650382667 +0000 UTC m=+35.546203405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls") pod "image-registry-5b6484bd8b-x5mgw" (UID: "04d8454d-67c0-4e20-9719-375325841023") : secret "image-registry-tls" not found
May 26 23:43:58.650613 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.650405    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:43:58.650613 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.650434    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 23:43:58.650613 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.650462    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls podName:43c7e54b-86c1-404f-938c-8c0a45ab4e0e nodeName:}" failed. No retries permitted until 2026-05-26 23:43:59.650446573 +0000 UTC m=+35.546267315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls") pod "dns-default-9svlm" (UID: "43c7e54b-86c1-404f-938c-8c0a45ab4e0e") : secret "dns-default-metrics-tls" not found
May 26 23:43:58.650613 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.650500    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert podName:86fa870e-3474-4da6-b96b-ac91909598a2 nodeName:}" failed. No retries permitted until 2026-05-26 23:43:59.650481912 +0000 UTC m=+35.546302656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert") pod "ingress-canary-7mddt" (UID: "86fa870e-3474-4da6-b96b-ac91909598a2") : secret "canary-serving-cert" not found
May 26 23:43:58.650613 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:58.650528    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert podName:208668b1-eb68-483d-ab6b-cb1bca830afe nodeName:}" failed. No retries permitted until 2026-05-26 23:43:59.650517566 +0000 UTC m=+35.546338313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-84lxj" (UID: "208668b1-eb68-483d-ab6b-cb1bca830afe") : secret "networking-console-plugin-cert" not found
May 26 23:43:58.692529 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.692500    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:43:58.695024 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:58.695007    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 23:43:59.657917 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.657891    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.657930    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.657977    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.658017    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:59.658069    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:59.658126    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:59.658128    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls podName:43c7e54b-86c1-404f-938c-8c0a45ab4e0e nodeName:}" failed. No retries permitted until 2026-05-26 23:44:01.658113178 +0000 UTC m=+37.553933916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls") pod "dns-default-9svlm" (UID: "43c7e54b-86c1-404f-938c-8c0a45ab4e0e") : secret "dns-default-metrics-tls" not found
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:59.658072    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:59.658181    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert podName:86fa870e-3474-4da6-b96b-ac91909598a2 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:01.658165618 +0000 UTC m=+37.553986355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert") pod "ingress-canary-7mddt" (UID: "86fa870e-3474-4da6-b96b-ac91909598a2") : secret "canary-serving-cert" not found
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:59.658181    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6484bd8b-x5mgw: secret "image-registry-tls" not found
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:59.658210    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls podName:04d8454d-67c0-4e20-9719-375325841023 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:01.658203384 +0000 UTC m=+37.554024122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls") pod "image-registry-5b6484bd8b-x5mgw" (UID: "04d8454d-67c0-4e20-9719-375325841023") : secret "image-registry-tls" not found
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:59.658165    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 23:43:59.658421 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:43:59.658235    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert podName:208668b1-eb68-483d-ab6b-cb1bca830afe nodeName:}" failed. No retries permitted until 2026-05-26 23:44:01.658228998 +0000 UTC m=+37.554049737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-84lxj" (UID: "208668b1-eb68-483d-ab6b-cb1bca830afe") : secret "networking-console-plugin-cert" not found
May 26 23:43:59.692930 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.692900    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:43:59.693033 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.692905    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:43:59.695316 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.695301    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 23:43:59.696009 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.695944    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 23:43:59.696009 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.695980    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88rwp\""
May 26 23:43:59.696009 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.695989    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9n4z9\""
May 26 23:43:59.696288 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.696207    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 23:43:59.816199 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.816177    2574 generic.go:358] "Generic (PLEG): container finished" podID="b99f2d83-2309-4be0-86fe-5d837c071be9" containerID="eff296a5b6510b202c2f6247645a2741b16b44c5144183d49457eee61f4f7c18" exitCode=0
May 26 23:43:59.816310 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:43:59.816217    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ls22" event={"ID":"b99f2d83-2309-4be0-86fe-5d837c071be9","Type":"ContainerDied","Data":"eff296a5b6510b202c2f6247645a2741b16b44c5144183d49457eee61f4f7c18"}
May 26 23:44:00.563708 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:00.563672    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:44:00.565825 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:00.565802    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/375b33ce-fc77-46c7-b25d-b3b7a5e69a0c-original-pull-secret\") pod \"global-pull-secret-syncer-jnpf6\" (UID: \"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c\") " pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:44:00.804144 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:00.804117    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jnpf6"
May 26 23:44:00.820562 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:00.820508    2574 generic.go:358] "Generic (PLEG): container finished" podID="b99f2d83-2309-4be0-86fe-5d837c071be9" containerID="5b89913fbf27ab49abd95c68bf44f691e2e94d893f0759a7b5789f923c2c17c4" exitCode=0
May 26 23:44:00.820562 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:00.820550    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ls22" event={"ID":"b99f2d83-2309-4be0-86fe-5d837c071be9","Type":"ContainerDied","Data":"5b89913fbf27ab49abd95c68bf44f691e2e94d893f0759a7b5789f923c2c17c4"}
May 26 23:44:00.983749 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:00.983604    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jnpf6"]
May 26 23:44:01.673781 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.673742    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:44:01.673943 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.673798    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:44:01.673943 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.673825    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:44:01.673943 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.673862    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:44:01.673943 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:01.673890    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:01.673943 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:01.673945    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 23:44:01.674125 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:01.673967    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert podName:86fa870e-3474-4da6-b96b-ac91909598a2 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:05.673947431 +0000 UTC m=+41.569768173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert") pod "ingress-canary-7mddt" (UID: "86fa870e-3474-4da6-b96b-ac91909598a2") : secret "canary-serving-cert" not found
May 26 23:44:01.674125 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:01.673966    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 23:44:01.674125 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:01.673982    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6484bd8b-x5mgw: secret "image-registry-tls" not found
May 26 23:44:01.674125 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:01.673988    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:01.674125 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:01.674003    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert podName:208668b1-eb68-483d-ab6b-cb1bca830afe nodeName:}" failed. No retries permitted until 2026-05-26 23:44:05.673988632 +0000 UTC m=+41.569809374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-84lxj" (UID: "208668b1-eb68-483d-ab6b-cb1bca830afe") : secret "networking-console-plugin-cert" not found
May 26 23:44:01.674125 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:01.674020    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls podName:04d8454d-67c0-4e20-9719-375325841023 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:05.674011721 +0000 UTC m=+41.569832459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls") pod "image-registry-5b6484bd8b-x5mgw" (UID: "04d8454d-67c0-4e20-9719-375325841023") : secret "image-registry-tls" not found
May 26 23:44:01.674125 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:01.674078    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls podName:43c7e54b-86c1-404f-938c-8c0a45ab4e0e nodeName:}" failed. No retries permitted until 2026-05-26 23:44:05.674063859 +0000 UTC m=+41.569884614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls") pod "dns-default-9svlm" (UID: "43c7e54b-86c1-404f-938c-8c0a45ab4e0e") : secret "dns-default-metrics-tls" not found
May 26 23:44:01.826112 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.826075    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ls22" event={"ID":"b99f2d83-2309-4be0-86fe-5d837c071be9","Type":"ContainerStarted","Data":"07854c49d4d6d0a9611a333628539f8b8cf098fa0e7616f086ba22ee8cf3c417"}
May 26 23:44:01.827366 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.827337    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jnpf6" event={"ID":"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c","Type":"ContainerStarted","Data":"40523ddeb82060fc14c975104824ca3ddb2366724e4f37c4b0a8b3fb0dc9befb"}
May 26 23:44:01.849307 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.849238    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2ls22" podStartSLOduration=5.900008887 podStartE2EDuration="37.849226023s" podCreationTimestamp="2026-05-26 23:43:24 +0000 UTC" firstStartedPulling="2026-05-26 23:43:27.253871616 +0000 UTC m=+3.149692368" lastFinishedPulling="2026-05-26 23:43:59.203088749 +0000 UTC m=+35.098909504" observedRunningTime="2026-05-26 23:44:01.847823102 +0000 UTC m=+37.743643862" watchObservedRunningTime="2026-05-26 23:44:01.849226023 +0000 UTC m=+37.745046804"
May 26 23:44:01.957779 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.957684    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"]
May 26 23:44:01.968069 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.968029    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"]
May 26 23:44:01.968207 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.968171    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"
May 26 23:44:01.970590 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.970564    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 23:44:01.970706 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.970593    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 23:44:01.970706 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.970597    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 26 23:44:01.970867 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.970850    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 23:44:01.970926 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.970868    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xdpmx\""
May 26 23:44:01.978363 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.978344    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"]
May 26 23:44:01.978857 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.978592    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:01.980621 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.980600    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 26 23:44:01.987071 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.987034    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"]
May 26 23:44:01.987156 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.987075    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"]
May 26 23:44:01.987156 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.987089    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"]
May 26 23:44:01.987222 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.987175    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:01.989288 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.989270    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 26 23:44:01.989371 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.989288    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 26 23:44:01.989371 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.989277    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 26 23:44:01.989545 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:01.989532    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 26 23:44:02.076288 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.076460 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076308    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/486304c5-0827-4543-849b-f081514694cb-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.076460 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c658ca5-3bac-485c-ab96-42eba18da605-tmp\") pod \"klusterlet-addon-workmgr-7f8996969c-9gxtd\" (UID: \"0c658ca5-3bac-485c-ab96-42eba18da605\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.076460 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076361    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjg84\" (UniqueName: \"kubernetes.io/projected/c1ecc94e-b73e-4ebe-b82d-bb8251232e59-kube-api-access-sjg84\") pod \"managed-serviceaccount-addon-agent-6c7d9bd56-f29r5\" (UID: \"c1ecc94e-b73e-4ebe-b82d-bb8251232e59\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"
May 26 23:44:02.076460 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.076460 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-647dt\" (UniqueName: \"kubernetes.io/projected/486304c5-0827-4543-849b-f081514694cb-kube-api-access-647dt\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.076460 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076440    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1ecc94e-b73e-4ebe-b82d-bb8251232e59-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c7d9bd56-f29r5\" (UID: \"c1ecc94e-b73e-4ebe-b82d-bb8251232e59\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"
May 26 23:44:02.076732 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076519    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-ca\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.076732 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-hub\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.076732 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076581    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64r45\" (UniqueName: \"kubernetes.io/projected/0c658ca5-3bac-485c-ab96-42eba18da605-kube-api-access-64r45\") pod \"klusterlet-addon-workmgr-7f8996969c-9gxtd\" (UID: \"0c658ca5-3bac-485c-ab96-42eba18da605\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.076732 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.076606    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0c658ca5-3bac-485c-ab96-42eba18da605-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f8996969c-9gxtd\" (UID: \"0c658ca5-3bac-485c-ab96-42eba18da605\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.177904 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.177866    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1ecc94e-b73e-4ebe-b82d-bb8251232e59-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c7d9bd56-f29r5\" (UID: \"c1ecc94e-b73e-4ebe-b82d-bb8251232e59\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"
May 26 23:44:02.178059 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.177922    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-ca\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.178059 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.177941    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-hub\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.178059 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.177979    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64r45\" (UniqueName: \"kubernetes.io/projected/0c658ca5-3bac-485c-ab96-42eba18da605-kube-api-access-64r45\") pod \"klusterlet-addon-workmgr-7f8996969c-9gxtd\" (UID: \"0c658ca5-3bac-485c-ab96-42eba18da605\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.178059 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.178003    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0c658ca5-3bac-485c-ab96-42eba18da605-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f8996969c-9gxtd\" (UID: \"0c658ca5-3bac-485c-ab96-42eba18da605\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.178059 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.178040    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.178324 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.178095    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/486304c5-0827-4543-849b-f081514694cb-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.178324 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.178129    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c658ca5-3bac-485c-ab96-42eba18da605-tmp\") pod \"klusterlet-addon-workmgr-7f8996969c-9gxtd\" (UID: \"0c658ca5-3bac-485c-ab96-42eba18da605\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.178324 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.178156    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjg84\" (UniqueName: \"kubernetes.io/projected/c1ecc94e-b73e-4ebe-b82d-bb8251232e59-kube-api-access-sjg84\") pod \"managed-serviceaccount-addon-agent-6c7d9bd56-f29r5\" (UID: \"c1ecc94e-b73e-4ebe-b82d-bb8251232e59\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"
May 26 23:44:02.178324 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.178207    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.178324 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.178235    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-647dt\" (UniqueName: \"kubernetes.io/projected/486304c5-0827-4543-849b-f081514694cb-kube-api-access-647dt\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.178881 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.178854    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c658ca5-3bac-485c-ab96-42eba18da605-tmp\") pod \"klusterlet-addon-workmgr-7f8996969c-9gxtd\" (UID: \"0c658ca5-3bac-485c-ab96-42eba18da605\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.179112 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.179088    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/486304c5-0827-4543-849b-f081514694cb-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.183104 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.182949    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-ca\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.183200 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.183026    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0c658ca5-3bac-485c-ab96-42eba18da605-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f8996969c-9gxtd\" (UID: \"0c658ca5-3bac-485c-ab96-42eba18da605\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.184849 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.184814    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-hub\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.184964 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.184922    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.185454 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.185413    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/486304c5-0827-4543-849b-f081514694cb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.187219 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.187175    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjg84\" (UniqueName: \"kubernetes.io/projected/c1ecc94e-b73e-4ebe-b82d-bb8251232e59-kube-api-access-sjg84\") pod \"managed-serviceaccount-addon-agent-6c7d9bd56-f29r5\" (UID: \"c1ecc94e-b73e-4ebe-b82d-bb8251232e59\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"
May 26 23:44:02.187324 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.187217    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1ecc94e-b73e-4ebe-b82d-bb8251232e59-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c7d9bd56-f29r5\" (UID: \"c1ecc94e-b73e-4ebe-b82d-bb8251232e59\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"
May 26 23:44:02.187666 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.187646    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-647dt\" (UniqueName: \"kubernetes.io/projected/486304c5-0827-4543-849b-f081514694cb-kube-api-access-647dt\") pod \"cluster-proxy-proxy-agent-95849c4df-8qj8k\" (UID: \"486304c5-0827-4543-849b-f081514694cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.187809 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.187790    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64r45\" (UniqueName: \"kubernetes.io/projected/0c658ca5-3bac-485c-ab96-42eba18da605-kube-api-access-64r45\") pod \"klusterlet-addon-workmgr-7f8996969c-9gxtd\" (UID: \"0c658ca5-3bac-485c-ab96-42eba18da605\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.289835 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.289812    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"
May 26 23:44:02.299605 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.299490    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:02.306002 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.305946    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:44:02.461404 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.461361    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5"]
May 26 23:44:02.479273 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.479228    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"]
May 26 23:44:02.483824 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:44:02.483800    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod486304c5_0827_4543_849b_f081514694cb.slice/crio-e6b3a8cc65455d224b7c6f55d74db0afc544a019b605bc140dcddd68a34f7b2b WatchSource:0}: Error finding container e6b3a8cc65455d224b7c6f55d74db0afc544a019b605bc140dcddd68a34f7b2b: Status 404 returned error can't find the container with id e6b3a8cc65455d224b7c6f55d74db0afc544a019b605bc140dcddd68a34f7b2b
May 26 23:44:02.488562 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.488498    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"]
May 26 23:44:02.493369 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:44:02.493335    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c658ca5_3bac_485c_ab96_42eba18da605.slice/crio-5e4c57f693fea40121533cbecbf1d3ba92e8eb428d4c5414405b44f22364bf73 WatchSource:0}: Error finding container 5e4c57f693fea40121533cbecbf1d3ba92e8eb428d4c5414405b44f22364bf73: Status 404 returned error can't find the container with id 5e4c57f693fea40121533cbecbf1d3ba92e8eb428d4c5414405b44f22364bf73
May 26 23:44:02.829778 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.829746    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd" event={"ID":"0c658ca5-3bac-485c-ab96-42eba18da605","Type":"ContainerStarted","Data":"5e4c57f693fea40121533cbecbf1d3ba92e8eb428d4c5414405b44f22364bf73"}
May 26 23:44:02.830622 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.830603    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" event={"ID":"486304c5-0827-4543-849b-f081514694cb","Type":"ContainerStarted","Data":"e6b3a8cc65455d224b7c6f55d74db0afc544a019b605bc140dcddd68a34f7b2b"}
May 26 23:44:02.831504 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:02.831481    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5" event={"ID":"c1ecc94e-b73e-4ebe-b82d-bb8251232e59","Type":"ContainerStarted","Data":"ec1c968bf5bf3e6d15b87cd25ce361cab62d6e92747da2d70d7f06f512a0a589"}
May 26 23:44:05.713402 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:05.713368    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:05.713439    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:05.713508    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:05.713553    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:05.713614    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:05.713619    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert podName:86fa870e-3474-4da6-b96b-ac91909598a2 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:13.71359961 +0000 UTC m=+49.609420352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert") pod "ingress-canary-7mddt" (UID: "86fa870e-3474-4da6-b96b-ac91909598a2") : secret "canary-serving-cert" not found
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:05.713665    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls podName:43c7e54b-86c1-404f-938c-8c0a45ab4e0e nodeName:}" failed. No retries permitted until 2026-05-26 23:44:13.713653028 +0000 UTC m=+49.609473776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls") pod "dns-default-9svlm" (UID: "43c7e54b-86c1-404f-938c-8c0a45ab4e0e") : secret "dns-default-metrics-tls" not found
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:05.713676    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:05.713686    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:05.713746    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert podName:208668b1-eb68-483d-ab6b-cb1bca830afe nodeName:}" failed. No retries permitted until 2026-05-26 23:44:13.713725657 +0000 UTC m=+49.609546399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-84lxj" (UID: "208668b1-eb68-483d-ab6b-cb1bca830afe") : secret "networking-console-plugin-cert" not found
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:05.713802    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:05.713814    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6484bd8b-x5mgw: secret "image-registry-tls" not found
May 26 23:44:05.714104 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:05.713847    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls podName:04d8454d-67c0-4e20-9719-375325841023 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:13.713835969 +0000 UTC m=+49.609656707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls") pod "image-registry-5b6484bd8b-x5mgw" (UID: "04d8454d-67c0-4e20-9719-375325841023") : secret "image-registry-tls" not found
May 26 23:44:12.853757 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:12.853716    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5" event={"ID":"c1ecc94e-b73e-4ebe-b82d-bb8251232e59","Type":"ContainerStarted","Data":"0214512bac5fe4eb35b952f12c1fdc0720ae46d9bc776bf8b790aec49ceece8f"}
May 26 23:44:12.854973 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:12.854943    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jnpf6" event={"ID":"375b33ce-fc77-46c7-b25d-b3b7a5e69a0c","Type":"ContainerStarted","Data":"d86d6866eb45134ec52ba809d3b01bc295a2ce3476917e775b212113346123fb"}
May 26 23:44:12.856238 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:12.856211    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd" event={"ID":"0c658ca5-3bac-485c-ab96-42eba18da605","Type":"ContainerStarted","Data":"8aafcaddc57c48db0268102857517be1d599ba3c88dbc70108f4baeb5e804bdb"}
May 26 23:44:12.856346 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:12.856333    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:12.857421 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:12.857397    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" event={"ID":"486304c5-0827-4543-849b-f081514694cb","Type":"ContainerStarted","Data":"a57705189d0a17881648f186554516c10eeb6b5d583dd8793fcb859181eb84fe"}
May 26 23:44:12.858129 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:12.858113    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:44:12.869414 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:12.869373    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5" podStartSLOduration=2.4367875 podStartE2EDuration="11.869361929s" podCreationTimestamp="2026-05-26 23:44:01 +0000 UTC" firstStartedPulling="2026-05-26 23:44:02.468107807 +0000 UTC m=+38.363928544" lastFinishedPulling="2026-05-26 23:44:11.900682221 +0000 UTC m=+47.796502973" observedRunningTime="2026-05-26 23:44:12.868116165 +0000 UTC m=+48.763936925" watchObservedRunningTime="2026-05-26 23:44:12.869361929 +0000 UTC m=+48.765182685"
May 26 23:44:12.895958 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:12.895922    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jnpf6" podStartSLOduration=5.993261259 podStartE2EDuration="16.895912155s" podCreationTimestamp="2026-05-26 23:43:56 +0000 UTC" firstStartedPulling="2026-05-26 23:44:00.990281008 +0000 UTC m=+36.886101747" lastFinishedPulling="2026-05-26 23:44:11.8929319 +0000 UTC m=+47.788752643" observedRunningTime="2026-05-26 23:44:12.881865122 +0000 UTC m=+48.777685881" watchObservedRunningTime="2026-05-26 23:44:12.895912155 +0000 UTC m=+48.791732914"
May 26 23:44:12.896280 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:12.896258    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd" podStartSLOduration=2.499652932 podStartE2EDuration="11.896252314s" podCreationTimestamp="2026-05-26 23:44:01 +0000 UTC" firstStartedPulling="2026-05-26 23:44:02.495283775 +0000 UTC m=+38.391104513" lastFinishedPulling="2026-05-26 23:44:11.891883142 +0000 UTC m=+47.787703895" observedRunningTime="2026-05-26 23:44:12.895653309 +0000 UTC m=+48.791474072" watchObservedRunningTime="2026-05-26 23:44:12.896252314 +0000 UTC m=+48.792073093"
May 26 23:44:13.780028 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:13.779988    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:44:13.780237 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:13.780161    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:13.780237 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:13.780164    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:44:13.780360 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:13.780232    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert podName:86fa870e-3474-4da6-b96b-ac91909598a2 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:29.78021322 +0000 UTC m=+65.676033975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert") pod "ingress-canary-7mddt" (UID: "86fa870e-3474-4da6-b96b-ac91909598a2") : secret "canary-serving-cert" not found
May 26 23:44:13.780360 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:13.780251    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:13.780360 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:13.780301    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls podName:43c7e54b-86c1-404f-938c-8c0a45ab4e0e nodeName:}" failed. No retries permitted until 2026-05-26 23:44:29.780286755 +0000 UTC m=+65.676107498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls") pod "dns-default-9svlm" (UID: "43c7e54b-86c1-404f-938c-8c0a45ab4e0e") : secret "dns-default-metrics-tls" not found
May 26 23:44:13.780360 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:13.780325    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:44:13.780560 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:13.780384    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:44:13.780560 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:13.780496    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 23:44:13.780560 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:13.780495    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 23:44:13.780560 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:13.780507    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6484bd8b-x5mgw: secret "image-registry-tls" not found
May 26 23:44:13.780560 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:13.780554    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert podName:208668b1-eb68-483d-ab6b-cb1bca830afe nodeName:}" failed. No retries permitted until 2026-05-26 23:44:29.780539821 +0000 UTC m=+65.676360571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-84lxj" (UID: "208668b1-eb68-483d-ab6b-cb1bca830afe") : secret "networking-console-plugin-cert" not found
May 26 23:44:13.780778 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:13.780575    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls podName:04d8454d-67c0-4e20-9719-375325841023 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:29.780564661 +0000 UTC m=+65.676385399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls") pod "image-registry-5b6484bd8b-x5mgw" (UID: "04d8454d-67c0-4e20-9719-375325841023") : secret "image-registry-tls" not found
May 26 23:44:14.866516 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:14.866483    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" event={"ID":"486304c5-0827-4543-849b-f081514694cb","Type":"ContainerStarted","Data":"d1f104f4292b79f2bce533c12a4844102ea0aec1acaaafe7c5f39ea9083e93d6"}
May 26 23:44:14.866516 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:14.866521    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" event={"ID":"486304c5-0827-4543-849b-f081514694cb","Type":"ContainerStarted","Data":"7ed17c905e4547f75b211158b6b05d3c74860b86ccd3abb7582ed27d72e57dbb"}
May 26 23:44:14.883825 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:14.883786    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" podStartSLOduration=1.717750721 podStartE2EDuration="13.883773902s" podCreationTimestamp="2026-05-26 23:44:01 +0000 UTC" firstStartedPulling="2026-05-26 23:44:02.48573535 +0000 UTC m=+38.381556089" lastFinishedPulling="2026-05-26 23:44:14.651758532 +0000 UTC m=+50.547579270" observedRunningTime="2026-05-26 23:44:14.883738941 +0000 UTC m=+50.779559702" watchObservedRunningTime="2026-05-26 23:44:14.883773902 +0000 UTC m=+50.779594662"
May 26 23:44:23.818298 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:23.818270    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2j7n"
May 26 23:44:29.802185 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:29.802149    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:29.802199    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:29.802227    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:29.802261    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:29.802296    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:29.802345    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:29.802358    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6484bd8b-x5mgw: secret "image-registry-tls" not found
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:29.802366    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:29.802389    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert podName:86fa870e-3474-4da6-b96b-ac91909598a2 nodeName:}" failed. No retries permitted until 2026-05-26 23:45:01.802371462 +0000 UTC m=+97.698192204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert") pod "ingress-canary-7mddt" (UID: "86fa870e-3474-4da6-b96b-ac91909598a2") : secret "canary-serving-cert" not found
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:29.802412    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls podName:43c7e54b-86c1-404f-938c-8c0a45ab4e0e nodeName:}" failed. No retries permitted until 2026-05-26 23:45:01.802399425 +0000 UTC m=+97.698220163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls") pod "dns-default-9svlm" (UID: "43c7e54b-86c1-404f-938c-8c0a45ab4e0e") : secret "dns-default-metrics-tls" not found
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:29.802426    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls podName:04d8454d-67c0-4e20-9719-375325841023 nodeName:}" failed. No retries permitted until 2026-05-26 23:45:01.802419959 +0000 UTC m=+97.698240697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls") pod "image-registry-5b6484bd8b-x5mgw" (UID: "04d8454d-67c0-4e20-9719-375325841023") : secret "image-registry-tls" not found
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:29.802366    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 23:44:29.802607 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:29.802459    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert podName:208668b1-eb68-483d-ab6b-cb1bca830afe nodeName:}" failed. No retries permitted until 2026-05-26 23:45:01.802453452 +0000 UTC m=+97.698274190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-84lxj" (UID: "208668b1-eb68-483d-ab6b-cb1bca830afe") : secret "networking-console-plugin-cert" not found
May 26 23:44:30.407668 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.407634    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:44:30.409995 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.409977    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 23:44:30.418832 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:30.418817    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 23:44:30.418890 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:44:30.418868    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs podName:e4942eb9-3d0f-431a-97a5-ee6cba6a5a66 nodeName:}" failed. No retries permitted until 2026-05-26 23:45:34.418853662 +0000 UTC m=+130.314674400 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs") pod "network-metrics-daemon-4gd6s" (UID: "e4942eb9-3d0f-431a-97a5-ee6cba6a5a66") : secret "metrics-daemon-secret" not found
May 26 23:44:30.508044 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.508017    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:44:30.510215 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.510197    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 23:44:30.520856 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.520839    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 23:44:30.532225 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.532203    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2fjw\" (UniqueName: \"kubernetes.io/projected/33d8c80a-1504-411a-b3e9-1834b471b952-kube-api-access-h2fjw\") pod \"network-check-target-q9mxd\" (UID: \"33d8c80a-1504-411a-b3e9-1834b471b952\") " pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:44:30.605239 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.605213    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88rwp\""
May 26 23:44:30.613153 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.613136    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:44:30.733208 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.733173    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q9mxd"]
May 26 23:44:30.736977 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:44:30.736954    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d8c80a_1504_411a_b3e9_1834b471b952.slice/crio-4e69725266e0428c750821be2c3104dcb1fb26a722460f96c2ffeaa1aff7ef0d WatchSource:0}: Error finding container 4e69725266e0428c750821be2c3104dcb1fb26a722460f96c2ffeaa1aff7ef0d: Status 404 returned error can't find the container with id 4e69725266e0428c750821be2c3104dcb1fb26a722460f96c2ffeaa1aff7ef0d
May 26 23:44:30.903219 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:30.903181    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q9mxd" event={"ID":"33d8c80a-1504-411a-b3e9-1834b471b952","Type":"ContainerStarted","Data":"4e69725266e0428c750821be2c3104dcb1fb26a722460f96c2ffeaa1aff7ef0d"}
May 26 23:44:34.915809 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:34.915771    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q9mxd" event={"ID":"33d8c80a-1504-411a-b3e9-1834b471b952","Type":"ContainerStarted","Data":"a0d407459cb2dcf39829c09e9366b297677fa3e86cf24e8a9378420531465384"}
May 26 23:44:34.916238 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:34.915906    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:44:34.930410 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:44:34.930362    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q9mxd" podStartSLOduration=67.633312276 podStartE2EDuration="1m10.930349325s" podCreationTimestamp="2026-05-26 23:43:24 +0000 UTC" firstStartedPulling="2026-05-26 23:44:30.738871478 +0000 UTC m=+66.634692215" lastFinishedPulling="2026-05-26 23:44:34.035908516 +0000 UTC m=+69.931729264" observedRunningTime="2026-05-26 23:44:34.929193385 +0000 UTC m=+70.825014159" watchObservedRunningTime="2026-05-26 23:44:34.930349325 +0000 UTC m=+70.826170084"
May 26 23:45:01.833801 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:45:01.833766    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:45:01.833812    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:45:01.833849    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:45:01.833882    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:01.833921    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:01.833966    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:01.833996    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:01.834009    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls podName:43c7e54b-86c1-404f-938c-8c0a45ab4e0e nodeName:}" failed. No retries permitted until 2026-05-26 23:46:05.833989516 +0000 UTC m=+161.729810259 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls") pod "dns-default-9svlm" (UID: "43c7e54b-86c1-404f-938c-8c0a45ab4e0e") : secret "dns-default-metrics-tls" not found
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:01.834028    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert podName:86fa870e-3474-4da6-b96b-ac91909598a2 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:05.834020959 +0000 UTC m=+161.729841700 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert") pod "ingress-canary-7mddt" (UID: "86fa870e-3474-4da6-b96b-ac91909598a2") : secret "canary-serving-cert" not found
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:01.834003    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:01.834084    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert podName:208668b1-eb68-483d-ab6b-cb1bca830afe nodeName:}" failed. No retries permitted until 2026-05-26 23:46:05.834065403 +0000 UTC m=+161.729886159 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-84lxj" (UID: "208668b1-eb68-483d-ab6b-cb1bca830afe") : secret "networking-console-plugin-cert" not found
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:01.834087    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6484bd8b-x5mgw: secret "image-registry-tls" not found
May 26 23:45:01.834272 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:01.834128    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls podName:04d8454d-67c0-4e20-9719-375325841023 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:05.834116504 +0000 UTC m=+161.729937255 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls") pod "image-registry-5b6484bd8b-x5mgw" (UID: "04d8454d-67c0-4e20-9719-375325841023") : secret "image-registry-tls" not found
May 26 23:45:05.920719 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:45:05.920685    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q9mxd"
May 26 23:45:34.488201 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:45:34.488165    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:45:34.488654 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:34.488326    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 23:45:34.488654 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:45:34.488386    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs podName:e4942eb9-3d0f-431a-97a5-ee6cba6a5a66 nodeName:}" failed. No retries permitted until 2026-05-26 23:47:36.488369007 +0000 UTC m=+252.384189751 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs") pod "network-metrics-daemon-4gd6s" (UID: "e4942eb9-3d0f-431a-97a5-ee6cba6a5a66") : secret "metrics-daemon-secret" not found
May 26 23:46:00.936609 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:00.936569    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw" podUID="04d8454d-67c0-4e20-9719-375325841023"
May 26 23:46:00.955188 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:00.955162    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj" podUID="208668b1-eb68-483d-ab6b-cb1bca830afe"
May 26 23:46:00.963339 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:00.963308    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9svlm" podUID="43c7e54b-86c1-404f-938c-8c0a45ab4e0e"
May 26 23:46:00.974621 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:00.974600    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7mddt" podUID="86fa870e-3474-4da6-b96b-ac91909598a2"
May 26 23:46:01.114205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:01.114176    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9svlm"
May 26 23:46:01.114205 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:01.114197    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:46:01.114373 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:01.114176    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:46:01.114373 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:01.114176    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:46:02.706826 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:02.706791    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4gd6s" podUID="e4942eb9-3d0f-431a-97a5-ee6cba6a5a66"
May 26 23:46:04.695734 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:04.695706    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-psbmk_fd9846b6-4187-4335-869d-21c8dc444a11/dns-node-resolver/0.log"
May 26 23:46:05.695963 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:05.695931    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sv6wc_d9915d1c-3fad-4080-a23f-01f593cef437/node-ca/0.log"
May 26 23:46:05.914892 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:05.914863    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:46:05.915042 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:05.914900    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:46:05.915042 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:05.914927    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:46:05.915042 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:05.914955    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") pod \"image-registry-5b6484bd8b-x5mgw\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") " pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:46:05.915042 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:05.915007    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:46:05.915205 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:05.915032    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 23:46:05.915205 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:05.915082    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b6484bd8b-x5mgw: secret "image-registry-tls" not found
May 26 23:46:05.915205 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:05.915085    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 23:46:05.915205 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:05.915017    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:46:05.915205 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:05.915117    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert podName:86fa870e-3474-4da6-b96b-ac91909598a2 nodeName:}" failed. No retries permitted until 2026-05-26 23:48:07.915095812 +0000 UTC m=+283.810916561 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert") pod "ingress-canary-7mddt" (UID: "86fa870e-3474-4da6-b96b-ac91909598a2") : secret "canary-serving-cert" not found
May 26 23:46:05.915205 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:05.915135    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert podName:208668b1-eb68-483d-ab6b-cb1bca830afe nodeName:}" failed. No retries permitted until 2026-05-26 23:48:07.915125252 +0000 UTC m=+283.810945990 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-84lxj" (UID: "208668b1-eb68-483d-ab6b-cb1bca830afe") : secret "networking-console-plugin-cert" not found
May 26 23:46:05.915205 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:05.915152    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls podName:04d8454d-67c0-4e20-9719-375325841023 nodeName:}" failed. No retries permitted until 2026-05-26 23:48:07.915144197 +0000 UTC m=+283.810964935 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls") pod "image-registry-5b6484bd8b-x5mgw" (UID: "04d8454d-67c0-4e20-9719-375325841023") : secret "image-registry-tls" not found
May 26 23:46:05.915205 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:05.915166    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls podName:43c7e54b-86c1-404f-938c-8c0a45ab4e0e nodeName:}" failed. No retries permitted until 2026-05-26 23:48:07.91515805 +0000 UTC m=+283.810978796 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls") pod "dns-default-9svlm" (UID: "43c7e54b-86c1-404f-938c-8c0a45ab4e0e") : secret "dns-default-metrics-tls" not found
May 26 23:46:12.137968 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:12.137937    2574 generic.go:358] "Generic (PLEG): container finished" podID="0c658ca5-3bac-485c-ab96-42eba18da605" containerID="8aafcaddc57c48db0268102857517be1d599ba3c88dbc70108f4baeb5e804bdb" exitCode=1
May 26 23:46:12.138297 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:12.138015    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd" event={"ID":"0c658ca5-3bac-485c-ab96-42eba18da605","Type":"ContainerDied","Data":"8aafcaddc57c48db0268102857517be1d599ba3c88dbc70108f4baeb5e804bdb"}
May 26 23:46:12.138337 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:12.138326    2574 scope.go:117] "RemoveContainer" containerID="8aafcaddc57c48db0268102857517be1d599ba3c88dbc70108f4baeb5e804bdb"
May 26 23:46:12.291201 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:12.291158    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5" podUID="c1ecc94e-b73e-4ebe-b82d-bb8251232e59" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/healthz\": dial tcp 10.132.0.10:8000: connect: connection refused"
May 26 23:46:12.300641 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:12.300615    2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:46:12.856867 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:12.856822    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:46:13.141528 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:13.141438    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd" event={"ID":"0c658ca5-3bac-485c-ab96-42eba18da605","Type":"ContainerStarted","Data":"ea388265f00fdffd67c2dff24d495019db23ad760dcfc00070104798877d858b"}
May 26 23:46:13.141961 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:13.141623    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:46:13.142810 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:13.142782    2574 generic.go:358] "Generic (PLEG): container finished" podID="c1ecc94e-b73e-4ebe-b82d-bb8251232e59" containerID="0214512bac5fe4eb35b952f12c1fdc0720ae46d9bc776bf8b790aec49ceece8f" exitCode=255
May 26 23:46:13.142933 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:13.142816    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5" event={"ID":"c1ecc94e-b73e-4ebe-b82d-bb8251232e59","Type":"ContainerDied","Data":"0214512bac5fe4eb35b952f12c1fdc0720ae46d9bc776bf8b790aec49ceece8f"}
May 26 23:46:13.143163 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:13.143141    2574 scope.go:117] "RemoveContainer" containerID="0214512bac5fe4eb35b952f12c1fdc0720ae46d9bc776bf8b790aec49ceece8f"
May 26 23:46:13.143262 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:13.143205    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8996969c-9gxtd"
May 26 23:46:14.146619 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:14.146579    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7d9bd56-f29r5" event={"ID":"c1ecc94e-b73e-4ebe-b82d-bb8251232e59","Type":"ContainerStarted","Data":"5e37f4197f042b4dd014e7502e789a2b1548fbd5758267c2732c65ff7138fbcc"}
May 26 23:46:16.692784 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:16.692751    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:46:36.820643 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.820606    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xbbzd"]
May 26 23:46:36.823505 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.823480    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:36.825931 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.825910    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 23:46:36.826061 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.825919    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 23:46:36.826964 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.826945    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 23:46:36.826964 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.826945    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 23:46:36.827134 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.827008    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xdcqh\""
May 26 23:46:36.837810 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.837788    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xbbzd"]
May 26 23:46:36.953925 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.953895    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ff6d659-32ac-4472-9e70-7b57fc79aa23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:36.954169 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.953959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ff6d659-32ac-4472-9e70-7b57fc79aa23-crio-socket\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:36.954169 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.953994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ff6d659-32ac-4472-9e70-7b57fc79aa23-data-volume\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:36.954169 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.954016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lcxv\" (UniqueName: \"kubernetes.io/projected/5ff6d659-32ac-4472-9e70-7b57fc79aa23-kube-api-access-8lcxv\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:36.954169 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:36.954146    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ff6d659-32ac-4472-9e70-7b57fc79aa23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.054646 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.054590    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ff6d659-32ac-4472-9e70-7b57fc79aa23-data-volume\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.054646 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.054644    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lcxv\" (UniqueName: \"kubernetes.io/projected/5ff6d659-32ac-4472-9e70-7b57fc79aa23-kube-api-access-8lcxv\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.054862 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.054703    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ff6d659-32ac-4472-9e70-7b57fc79aa23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.054862 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.054724    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ff6d659-32ac-4472-9e70-7b57fc79aa23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.054942 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.054900    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ff6d659-32ac-4472-9e70-7b57fc79aa23-crio-socket\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.055035 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.055017    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ff6d659-32ac-4472-9e70-7b57fc79aa23-data-volume\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.055098 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.055023    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ff6d659-32ac-4472-9e70-7b57fc79aa23-crio-socket\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.055276 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.055250    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ff6d659-32ac-4472-9e70-7b57fc79aa23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.057125 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.057100    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ff6d659-32ac-4472-9e70-7b57fc79aa23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.062674 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.062648    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lcxv\" (UniqueName: \"kubernetes.io/projected/5ff6d659-32ac-4472-9e70-7b57fc79aa23-kube-api-access-8lcxv\") pod \"insights-runtime-extractor-xbbzd\" (UID: \"5ff6d659-32ac-4472-9e70-7b57fc79aa23\") " pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.132683 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.132607    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xbbzd"
May 26 23:46:37.253261 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:37.253228    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xbbzd"]
May 26 23:46:37.256145 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:46:37.256119    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff6d659_32ac_4472_9e70_7b57fc79aa23.slice/crio-1044f8da62a25585a4eec5be80c7b063b5c8fd57ed355ab064db4faead998190 WatchSource:0}: Error finding container 1044f8da62a25585a4eec5be80c7b063b5c8fd57ed355ab064db4faead998190: Status 404 returned error can't find the container with id 1044f8da62a25585a4eec5be80c7b063b5c8fd57ed355ab064db4faead998190
May 26 23:46:38.199392 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:38.199308    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbbzd" event={"ID":"5ff6d659-32ac-4472-9e70-7b57fc79aa23","Type":"ContainerStarted","Data":"d948e4f9ac83294d6798bd3dd0942205ccf885c236582aad09afe2489fd5d832"}
May 26 23:46:38.199392 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:38.199344    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbbzd" event={"ID":"5ff6d659-32ac-4472-9e70-7b57fc79aa23","Type":"ContainerStarted","Data":"a59471d331f85fd37226b0fe46d98d8f957ac70025f9ab228c557966bdc35ee7"}
May 26 23:46:38.199392 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:38.199354    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbbzd" event={"ID":"5ff6d659-32ac-4472-9e70-7b57fc79aa23","Type":"ContainerStarted","Data":"1044f8da62a25585a4eec5be80c7b063b5c8fd57ed355ab064db4faead998190"}
May 26 23:46:40.205334 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:40.205293    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbbzd" event={"ID":"5ff6d659-32ac-4472-9e70-7b57fc79aa23","Type":"ContainerStarted","Data":"18d17a26a17b201314a9813f7a4354939be6bcb8f9b352b2a41addc1e333a8e5"}
May 26 23:46:40.224987 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:40.224945    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xbbzd" podStartSLOduration=2.215943782 podStartE2EDuration="4.224933293s" podCreationTimestamp="2026-05-26 23:46:36 +0000 UTC" firstStartedPulling="2026-05-26 23:46:37.306460332 +0000 UTC m=+193.202281069" lastFinishedPulling="2026-05-26 23:46:39.315449842 +0000 UTC m=+195.211270580" observedRunningTime="2026-05-26 23:46:40.223527997 +0000 UTC m=+196.119348757" watchObservedRunningTime="2026-05-26 23:46:40.224933293 +0000 UTC m=+196.120754053"
May 26 23:46:44.629350 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.629314    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vqc9j"]
May 26 23:46:44.632443 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.632422    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.635176 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.635147    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v42w5\""
May 26 23:46:44.635275 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.635160    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 23:46:44.635275 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.635252    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 23:46:44.636107 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.636093    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 23:46:44.636162 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.636120    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 23:46:44.636162 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.636137    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 23:46:44.636162 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.636123    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 23:46:44.708881 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.708848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-textfile\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.709073 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.708892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abc9ecde-b366-4c07-ac90-5eedb80be916-metrics-client-ca\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.709073 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.708930    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd69n\" (UniqueName: \"kubernetes.io/projected/abc9ecde-b366-4c07-ac90-5eedb80be916-kube-api-access-dd69n\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.709073 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.708952    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-tls\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.709073 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.708974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abc9ecde-b366-4c07-ac90-5eedb80be916-sys\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.709073 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.709012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.709073 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.709066    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/abc9ecde-b366-4c07-ac90-5eedb80be916-root\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.709274 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.709087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.709274 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.709103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-wtmp\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810272 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810236    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810433 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810322    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/abc9ecde-b366-4c07-ac90-5eedb80be916-root\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810433 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810358    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810433 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810392    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-wtmp\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810433 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810420    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-textfile\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810639 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810429    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/abc9ecde-b366-4c07-ac90-5eedb80be916-root\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810639 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810458    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abc9ecde-b366-4c07-ac90-5eedb80be916-metrics-client-ca\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810639 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810576    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-wtmp\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810639 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810591    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dd69n\" (UniqueName: \"kubernetes.io/projected/abc9ecde-b366-4c07-ac90-5eedb80be916-kube-api-access-dd69n\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810639 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810632    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-tls\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810886 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810660    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abc9ecde-b366-4c07-ac90-5eedb80be916-sys\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810886 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:44.810758    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 26 23:46:44.810886 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810782    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-textfile\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810886 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810762    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abc9ecde-b366-4c07-ac90-5eedb80be916-sys\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.810886 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:44.810818    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-tls podName:abc9ecde-b366-4c07-ac90-5eedb80be916 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:45.310800942 +0000 UTC m=+201.206621682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-tls") pod "node-exporter-vqc9j" (UID: "abc9ecde-b366-4c07-ac90-5eedb80be916") : secret "node-exporter-tls" not found
May 26 23:46:44.811185 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.810998    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.811185 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.811175    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abc9ecde-b366-4c07-ac90-5eedb80be916-metrics-client-ca\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.812519 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.812495    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:44.820296 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:44.820275    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd69n\" (UniqueName: \"kubernetes.io/projected/abc9ecde-b366-4c07-ac90-5eedb80be916-kube-api-access-dd69n\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:45.316004 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:45.315975    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-tls\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:45.318210 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:45.318180    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/abc9ecde-b366-4c07-ac90-5eedb80be916-node-exporter-tls\") pod \"node-exporter-vqc9j\" (UID: \"abc9ecde-b366-4c07-ac90-5eedb80be916\") " pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:45.540919 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:45.540894    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqc9j"
May 26 23:46:45.550532 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:46:45.550505    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc9ecde_b366_4c07_ac90_5eedb80be916.slice/crio-adfd6177f2acbc98b2b7869dafd65f1bfb9518a75c70806e75083c97ba2e1562 WatchSource:0}: Error finding container adfd6177f2acbc98b2b7869dafd65f1bfb9518a75c70806e75083c97ba2e1562: Status 404 returned error can't find the container with id adfd6177f2acbc98b2b7869dafd65f1bfb9518a75c70806e75083c97ba2e1562
May 26 23:46:46.219908 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:46.219861    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqc9j" event={"ID":"abc9ecde-b366-4c07-ac90-5eedb80be916","Type":"ContainerStarted","Data":"adfd6177f2acbc98b2b7869dafd65f1bfb9518a75c70806e75083c97ba2e1562"}
May 26 23:46:47.224316 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:47.224281    2574 generic.go:358] "Generic (PLEG): container finished" podID="abc9ecde-b366-4c07-ac90-5eedb80be916" containerID="e5b89d5a8712bb4a8222e00d3141a630023d116f09961ace02e4683103e8e64e" exitCode=0
May 26 23:46:47.224662 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:47.224352    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqc9j" event={"ID":"abc9ecde-b366-4c07-ac90-5eedb80be916","Type":"ContainerDied","Data":"e5b89d5a8712bb4a8222e00d3141a630023d116f09961ace02e4683103e8e64e"}
May 26 23:46:48.228651 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:48.228612    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqc9j" event={"ID":"abc9ecde-b366-4c07-ac90-5eedb80be916","Type":"ContainerStarted","Data":"7575934b780fa07c2ed186ba85defdaedef7675dc8ac0268f1e336f31c975f0c"}
May 26 23:46:48.228651 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:48.228656    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqc9j" event={"ID":"abc9ecde-b366-4c07-ac90-5eedb80be916","Type":"ContainerStarted","Data":"b21431e1b033b7c8397576f7e41a97246f0341d8961454577ec13dcfff7d7a95"}
May 26 23:46:48.247119 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:48.247077    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vqc9j" podStartSLOduration=3.259727515 podStartE2EDuration="4.247043124s" podCreationTimestamp="2026-05-26 23:46:44 +0000 UTC" firstStartedPulling="2026-05-26 23:46:45.552410631 +0000 UTC m=+201.448231370" lastFinishedPulling="2026-05-26 23:46:46.539726241 +0000 UTC m=+202.435546979" observedRunningTime="2026-05-26 23:46:48.24552006 +0000 UTC m=+204.141340831" watchObservedRunningTime="2026-05-26 23:46:48.247043124 +0000 UTC m=+204.142863899"
May 26 23:46:52.307307 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:52.307269    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" podUID="486304c5-0827-4543-849b-f081514694cb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 23:46:59.011619 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.011585    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b6484bd8b-x5mgw"]
May 26 23:46:59.012079 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:46:59.011732    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw" podUID="04d8454d-67c0-4e20-9719-375325841023"
May 26 23:46:59.254771 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.254742    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:46:59.258820 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.258794    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:46:59.322930 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.322861    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-installation-pull-secrets\") pod \"04d8454d-67c0-4e20-9719-375325841023\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") "
May 26 23:46:59.322930 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.322892    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-registry-certificates\") pod \"04d8454d-67c0-4e20-9719-375325841023\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") "
May 26 23:46:59.322930 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.322913    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-image-registry-private-configuration\") pod \"04d8454d-67c0-4e20-9719-375325841023\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") "
May 26 23:46:59.323177 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.322963    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49njh\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-kube-api-access-49njh\") pod \"04d8454d-67c0-4e20-9719-375325841023\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") "
May 26 23:46:59.323177 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.322983    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04d8454d-67c0-4e20-9719-375325841023-ca-trust-extracted\") pod \"04d8454d-67c0-4e20-9719-375325841023\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") "
May 26 23:46:59.323177 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.323008    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-trusted-ca\") pod \"04d8454d-67c0-4e20-9719-375325841023\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") "
May 26 23:46:59.323177 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.323070    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-bound-sa-token\") pod \"04d8454d-67c0-4e20-9719-375325841023\" (UID: \"04d8454d-67c0-4e20-9719-375325841023\") "
May 26 23:46:59.323379 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.323319    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d8454d-67c0-4e20-9719-375325841023-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "04d8454d-67c0-4e20-9719-375325841023" (UID: "04d8454d-67c0-4e20-9719-375325841023"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 23:46:59.323379 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.323314    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "04d8454d-67c0-4e20-9719-375325841023" (UID: "04d8454d-67c0-4e20-9719-375325841023"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:46:59.323536 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.323514    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "04d8454d-67c0-4e20-9719-375325841023" (UID: "04d8454d-67c0-4e20-9719-375325841023"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:46:59.325241 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.325209    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-kube-api-access-49njh" (OuterVolumeSpecName: "kube-api-access-49njh") pod "04d8454d-67c0-4e20-9719-375325841023" (UID: "04d8454d-67c0-4e20-9719-375325841023"). InnerVolumeSpecName "kube-api-access-49njh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:46:59.325357 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.325251    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "04d8454d-67c0-4e20-9719-375325841023" (UID: "04d8454d-67c0-4e20-9719-375325841023"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:46:59.325449 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.325426    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "04d8454d-67c0-4e20-9719-375325841023" (UID: "04d8454d-67c0-4e20-9719-375325841023"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:46:59.325511 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.325473    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "04d8454d-67c0-4e20-9719-375325841023" (UID: "04d8454d-67c0-4e20-9719-375325841023"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:46:59.423932 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.423899    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-trusted-ca\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:46:59.423932 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.423928    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-bound-sa-token\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:46:59.423932 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.423938    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-installation-pull-secrets\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:46:59.424121 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.423948    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04d8454d-67c0-4e20-9719-375325841023-registry-certificates\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:46:59.424121 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.423958    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04d8454d-67c0-4e20-9719-375325841023-image-registry-private-configuration\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:46:59.424121 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.423967    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49njh\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-kube-api-access-49njh\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:46:59.424121 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:46:59.423977    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04d8454d-67c0-4e20-9719-375325841023-ca-trust-extracted\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:47:00.256522 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:00.256489    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6484bd8b-x5mgw"
May 26 23:47:00.293474 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:00.293449    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b6484bd8b-x5mgw"]
May 26 23:47:00.296830 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:00.296809    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b6484bd8b-x5mgw"]
May 26 23:47:00.332257 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:00.332231    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04d8454d-67c0-4e20-9719-375325841023-registry-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:47:00.696502 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:00.696468    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d8454d-67c0-4e20-9719-375325841023" path="/var/lib/kubelet/pods/04d8454d-67c0-4e20-9719-375325841023/volumes"
May 26 23:47:02.307839 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:02.307800    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" podUID="486304c5-0827-4543-849b-f081514694cb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 23:47:12.307762 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:12.307725    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" podUID="486304c5-0827-4543-849b-f081514694cb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 23:47:12.308257 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:12.307797    2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k"
May 26 23:47:12.308257 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:12.308223    2574 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d1f104f4292b79f2bce533c12a4844102ea0aec1acaaafe7c5f39ea9083e93d6"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 26 23:47:12.308334 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:12.308280    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" podUID="486304c5-0827-4543-849b-f081514694cb" containerName="service-proxy" containerID="cri-o://d1f104f4292b79f2bce533c12a4844102ea0aec1acaaafe7c5f39ea9083e93d6" gracePeriod=30
May 26 23:47:13.286692 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:13.286659    2574 generic.go:358] "Generic (PLEG): container finished" podID="486304c5-0827-4543-849b-f081514694cb" containerID="d1f104f4292b79f2bce533c12a4844102ea0aec1acaaafe7c5f39ea9083e93d6" exitCode=2
May 26 23:47:13.286860 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:13.286733    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" event={"ID":"486304c5-0827-4543-849b-f081514694cb","Type":"ContainerDied","Data":"d1f104f4292b79f2bce533c12a4844102ea0aec1acaaafe7c5f39ea9083e93d6"}
May 26 23:47:13.286860 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:13.286774    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-95849c4df-8qj8k" event={"ID":"486304c5-0827-4543-849b-f081514694cb","Type":"ContainerStarted","Data":"b632e630fbb63622ce6b58f4ca9812f0bb6a07db374b33805dfb14c9cf0eba90"}
May 26 23:47:36.506468 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:36.506375    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:47:36.508732 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:36.508706    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4942eb9-3d0f-431a-97a5-ee6cba6a5a66-metrics-certs\") pod \"network-metrics-daemon-4gd6s\" (UID: \"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66\") " pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:47:36.795518 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:36.795484    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9n4z9\""
May 26 23:47:36.803499 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:36.803477    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4gd6s"
May 26 23:47:36.921293 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:36.921267    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4gd6s"]
May 26 23:47:36.925075 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:47:36.925027    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4942eb9_3d0f_431a_97a5_ee6cba6a5a66.slice/crio-755ce4ac32f00efc35c0071461c4cc646f0ae5666522373e4407e36e09385276 WatchSource:0}: Error finding container 755ce4ac32f00efc35c0071461c4cc646f0ae5666522373e4407e36e09385276: Status 404 returned error can't find the container with id 755ce4ac32f00efc35c0071461c4cc646f0ae5666522373e4407e36e09385276
May 26 23:47:37.344353 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:37.344318    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4gd6s" event={"ID":"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66","Type":"ContainerStarted","Data":"755ce4ac32f00efc35c0071461c4cc646f0ae5666522373e4407e36e09385276"}
May 26 23:47:38.348026 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:38.347989    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4gd6s" event={"ID":"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66","Type":"ContainerStarted","Data":"4c67f6f14682e103de6dbcc4c986222683082a92428abec53295d7a12d8d8162"}
May 26 23:47:38.348026 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:38.348025    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4gd6s" event={"ID":"e4942eb9-3d0f-431a-97a5-ee6cba6a5a66","Type":"ContainerStarted","Data":"42ead8e9e1371df371f5b49299705511080341a5ea7202e6872402965da69c1d"}
May 26 23:47:38.363968 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:47:38.363919    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4gd6s" podStartSLOduration=253.135096689 podStartE2EDuration="4m14.363907172s" podCreationTimestamp="2026-05-26 23:43:24 +0000 UTC" firstStartedPulling="2026-05-26 23:47:36.926738779 +0000 UTC m=+252.822559518" lastFinishedPulling="2026-05-26 23:47:38.155549247 +0000 UTC m=+254.051370001" observedRunningTime="2026-05-26 23:47:38.362714801 +0000 UTC m=+254.258535560" watchObservedRunningTime="2026-05-26 23:47:38.363907172 +0000 UTC m=+254.259727931"
May 26 23:48:04.115253 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:48:04.115211    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj" podUID="208668b1-eb68-483d-ab6b-cb1bca830afe"
May 26 23:48:04.115253 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:48:04.115245    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7mddt" podUID="86fa870e-3474-4da6-b96b-ac91909598a2"
May 26 23:48:04.115690 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:48:04.115245    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9svlm" podUID="43c7e54b-86c1-404f-938c-8c0a45ab4e0e"
May 26 23:48:04.415097 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:04.415011    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:48:04.415225 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:04.415014    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:48:04.415225 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:04.415014    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9svlm"
May 26 23:48:07.947159 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:07.947115    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:48:07.947159 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:07.947167    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:48:07.947758 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:07.947210    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:48:07.949524 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:07.949501    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c7e54b-86c1-404f-938c-8c0a45ab4e0e-metrics-tls\") pod \"dns-default-9svlm\" (UID: \"43c7e54b-86c1-404f-938c-8c0a45ab4e0e\") " pod="openshift-dns/dns-default-9svlm"
May 26 23:48:07.949645 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:07.949628    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fa870e-3474-4da6-b96b-ac91909598a2-cert\") pod \"ingress-canary-7mddt\" (UID: \"86fa870e-3474-4da6-b96b-ac91909598a2\") " pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:48:07.949767 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:07.949744    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/208668b1-eb68-483d-ab6b-cb1bca830afe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-84lxj\" (UID: \"208668b1-eb68-483d-ab6b-cb1bca830afe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:48:08.018525 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.018505    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gx4rr\""
May 26 23:48:08.018647 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.018505    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wst9v\""
May 26 23:48:08.018647 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.018505    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pnjl\""
May 26 23:48:08.026445 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.026422    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7mddt"
May 26 23:48:08.026445 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.026442    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9svlm"
May 26 23:48:08.026602 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.026513    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"
May 26 23:48:08.166787 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.166476    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7mddt"]
May 26 23:48:08.169502 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:48:08.169474    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fa870e_3474_4da6_b96b_ac91909598a2.slice/crio-a2a7442709485e3bd2e313dd5090d73f7e06f818e78cae7fa4a429c093565f4e WatchSource:0}: Error finding container a2a7442709485e3bd2e313dd5090d73f7e06f818e78cae7fa4a429c093565f4e: Status 404 returned error can't find the container with id a2a7442709485e3bd2e313dd5090d73f7e06f818e78cae7fa4a429c093565f4e
May 26 23:48:08.181834 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.181812    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj"]
May 26 23:48:08.185251 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:48:08.185227    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208668b1_eb68_483d_ab6b_cb1bca830afe.slice/crio-ae92d288b72dfc9b19669a6b8468db8adcedc54ad39616e8deab9f114d1296d2 WatchSource:0}: Error finding container ae92d288b72dfc9b19669a6b8468db8adcedc54ad39616e8deab9f114d1296d2: Status 404 returned error can't find the container with id ae92d288b72dfc9b19669a6b8468db8adcedc54ad39616e8deab9f114d1296d2
May 26 23:48:08.200551 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.200481    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9svlm"]
May 26 23:48:08.204659 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:48:08.204634    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c7e54b_86c1_404f_938c_8c0a45ab4e0e.slice/crio-8d08d1dcd38b4f80ec443d04b66fd988539839d99c88c7819042b91a52ce760c WatchSource:0}: Error finding container 8d08d1dcd38b4f80ec443d04b66fd988539839d99c88c7819042b91a52ce760c: Status 404 returned error can't find the container with id 8d08d1dcd38b4f80ec443d04b66fd988539839d99c88c7819042b91a52ce760c
May 26 23:48:08.425329 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.425297    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9svlm" event={"ID":"43c7e54b-86c1-404f-938c-8c0a45ab4e0e","Type":"ContainerStarted","Data":"8d08d1dcd38b4f80ec443d04b66fd988539839d99c88c7819042b91a52ce760c"}
May 26 23:48:08.426233 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.426212    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7mddt" event={"ID":"86fa870e-3474-4da6-b96b-ac91909598a2","Type":"ContainerStarted","Data":"a2a7442709485e3bd2e313dd5090d73f7e06f818e78cae7fa4a429c093565f4e"}
May 26 23:48:08.427078 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:08.427042    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj" event={"ID":"208668b1-eb68-483d-ab6b-cb1bca830afe","Type":"ContainerStarted","Data":"ae92d288b72dfc9b19669a6b8468db8adcedc54ad39616e8deab9f114d1296d2"}
May 26 23:48:11.436539 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:11.436502    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9svlm" event={"ID":"43c7e54b-86c1-404f-938c-8c0a45ab4e0e","Type":"ContainerStarted","Data":"d279dbf4201929e6a866111832b2175bdae2add26f67585f32d1b8831d7b56f3"}
May 26 23:48:11.436539 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:11.436537    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9svlm" event={"ID":"43c7e54b-86c1-404f-938c-8c0a45ab4e0e","Type":"ContainerStarted","Data":"92e7228f2d94960b5eeb167ae3e57cfbcb2c50b3fae70b8b36179f266876330b"}
May 26 23:48:11.437007 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:11.436603    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9svlm"
May 26 23:48:11.437840 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:11.437808    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7mddt" event={"ID":"86fa870e-3474-4da6-b96b-ac91909598a2","Type":"ContainerStarted","Data":"5dbc059fe5d4a26eecdcd573e0e17d677c1efc2378396402481ba44fcdb84e2d"}
May 26 23:48:11.439004 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:11.438982    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj" event={"ID":"208668b1-eb68-483d-ab6b-cb1bca830afe","Type":"ContainerStarted","Data":"75bdaf8cc7678a7e9b3c100ad2ed7143adb1328a91b8e02e1aaa8a169e705e3b"}
May 26 23:48:11.452397 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:11.452345    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-9svlm" podStartSLOduration=252.204775969 podStartE2EDuration="4m14.452329484s" podCreationTimestamp="2026-05-26 23:43:57 +0000 UTC" firstStartedPulling="2026-05-26 23:48:08.206399797 +0000 UTC m=+284.102220536" lastFinishedPulling="2026-05-26 23:48:10.453953313 +0000 UTC m=+286.349774051" observedRunningTime="2026-05-26 23:48:11.451166792 +0000 UTC m=+287.346987552" watchObservedRunningTime="2026-05-26 23:48:11.452329484 +0000 UTC m=+287.348150246"
May 26 23:48:11.467950 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:11.467910    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-84lxj" podStartSLOduration=261.202542335 podStartE2EDuration="4m23.467899133s" podCreationTimestamp="2026-05-26 23:43:48 +0000 UTC" firstStartedPulling="2026-05-26 23:48:08.187412561 +0000 UTC m=+284.083233299" lastFinishedPulling="2026-05-26 23:48:10.452769342 +0000 UTC m=+286.348590097" observedRunningTime="2026-05-26 23:48:11.466222404 +0000 UTC m=+287.362043164" watchObservedRunningTime="2026-05-26 23:48:11.467899133 +0000 UTC m=+287.363719892"
May 26 23:48:11.482370 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:11.482324    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7mddt" podStartSLOduration=252.195757245 podStartE2EDuration="4m14.482313225s" podCreationTimestamp="2026-05-26 23:43:57 +0000 UTC" firstStartedPulling="2026-05-26 23:48:08.171427444 +0000 UTC m=+284.067248196" lastFinishedPulling="2026-05-26 23:48:10.457983425 +0000 UTC m=+286.353804176" observedRunningTime="2026-05-26 23:48:11.481590375 +0000 UTC m=+287.377411149" watchObservedRunningTime="2026-05-26 23:48:11.482313225 +0000 UTC m=+287.378133985"
May 26 23:48:21.444934 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:21.444901    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9svlm"
May 26 23:48:24.611125 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:24.611091    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:48:24.612865 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:24.612841    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:48:24.616123 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:48:24.616106    2574 kubelet.go:1628] "Image garbage collection succeeded"
May 26 23:53:24.630238 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:53:24.630208    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:53:24.630882 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:53:24.630855    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:57:26.502092 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.502038    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-r5q9w"]
May 26 23:57:26.505107 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.505084    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-r5q9w"
May 26 23:57:26.507176 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.507152    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 23:57:26.507390 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.507369    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-q2hb2\""
May 26 23:57:26.507962 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.507948    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 23:57:26.513116 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.513097    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-r5q9w"]
May 26 23:57:26.623277 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.623237    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s892d\" (UniqueName: \"kubernetes.io/projected/db3adafe-9638-4014-933b-96b783ca1a9a-kube-api-access-s892d\") pod \"redis-854544c579-r5q9w\" (UID: \"db3adafe-9638-4014-933b-96b783ca1a9a\") " pod="test-ns-feast/redis-854544c579-r5q9w"
May 26 23:57:26.724277 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.724242    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s892d\" (UniqueName: \"kubernetes.io/projected/db3adafe-9638-4014-933b-96b783ca1a9a-kube-api-access-s892d\") pod \"redis-854544c579-r5q9w\" (UID: \"db3adafe-9638-4014-933b-96b783ca1a9a\") " pod="test-ns-feast/redis-854544c579-r5q9w"
May 26 23:57:26.731875 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.731850    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s892d\" (UniqueName: \"kubernetes.io/projected/db3adafe-9638-4014-933b-96b783ca1a9a-kube-api-access-s892d\") pod \"redis-854544c579-r5q9w\" (UID: \"db3adafe-9638-4014-933b-96b783ca1a9a\") " pod="test-ns-feast/redis-854544c579-r5q9w"
May 26 23:57:26.814093 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.814040    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-r5q9w"
May 26 23:57:26.933176 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.933146    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-r5q9w"]
May 26 23:57:26.936507 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:57:26.936469    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb3adafe_9638_4014_933b_96b783ca1a9a.slice/crio-c177c7ef7a5e917183cc8e4f5f464eae75b3d855e153f8dd5609dae41df2715f WatchSource:0}: Error finding container c177c7ef7a5e917183cc8e4f5f464eae75b3d855e153f8dd5609dae41df2715f: Status 404 returned error can't find the container with id c177c7ef7a5e917183cc8e4f5f464eae75b3d855e153f8dd5609dae41df2715f
May 26 23:57:26.938527 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:26.938512    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 23:57:27.811505 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:27.811457    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-r5q9w" event={"ID":"db3adafe-9638-4014-933b-96b783ca1a9a","Type":"ContainerStarted","Data":"c177c7ef7a5e917183cc8e4f5f464eae75b3d855e153f8dd5609dae41df2715f"}
May 26 23:57:28.814935 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:28.814895    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-r5q9w" event={"ID":"db3adafe-9638-4014-933b-96b783ca1a9a","Type":"ContainerStarted","Data":"6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add"}
May 26 23:57:28.829443 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:57:28.829402    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-r5q9w" podStartSLOduration=1.533611621 podStartE2EDuration="2.829387982s" podCreationTimestamp="2026-05-26 23:57:26 +0000 UTC" firstStartedPulling="2026-05-26 23:57:26.938632793 +0000 UTC m=+842.834453530" lastFinishedPulling="2026-05-26 23:57:28.234409149 +0000 UTC m=+844.130229891" observedRunningTime="2026-05-26 23:57:28.828641242 +0000 UTC m=+844.724462003" watchObservedRunningTime="2026-05-26 23:57:28.829387982 +0000 UTC m=+844.725208741"
May 26 23:58:00.008344 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.008308    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-g9vqr"]
May 26 23:58:00.013601 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.013582    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-g9vqr"
May 26 23:58:00.019420 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.019398    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 26 23:58:00.019527 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.019479    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-bd8gf\""
May 26 23:58:00.024101 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.024079    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-g9vqr"]
May 26 23:58:00.046128 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.046105    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc98w\" (UniqueName: \"kubernetes.io/projected/f03ab4b3-35a5-4e62-9988-d1b9eb6fafde-kube-api-access-vc98w\") pod \"feast-test-apply-g9vqr\" (UID: \"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde\") " pod="test-ns-feast/feast-test-apply-g9vqr"
May 26 23:58:00.146359 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.146330    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc98w\" (UniqueName: \"kubernetes.io/projected/f03ab4b3-35a5-4e62-9988-d1b9eb6fafde-kube-api-access-vc98w\") pod \"feast-test-apply-g9vqr\" (UID: \"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde\") " pod="test-ns-feast/feast-test-apply-g9vqr"
May 26 23:58:00.153561 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.153537    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc98w\" (UniqueName: \"kubernetes.io/projected/f03ab4b3-35a5-4e62-9988-d1b9eb6fafde-kube-api-access-vc98w\") pod \"feast-test-apply-g9vqr\" (UID: \"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde\") " pod="test-ns-feast/feast-test-apply-g9vqr"
May 26 23:58:00.349419 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.349337    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-g9vqr"
May 26 23:58:00.462533 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.462501    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-g9vqr"]
May 26 23:58:00.465229 ip-10-0-136-0 kubenswrapper[2574]: W0526 23:58:00.465201    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf03ab4b3_35a5_4e62_9988_d1b9eb6fafde.slice/crio-f70712e0ec08c5e414d594d2c428165228182290a89f7225378e48dfeaafee04 WatchSource:0}: Error finding container f70712e0ec08c5e414d594d2c428165228182290a89f7225378e48dfeaafee04: Status 404 returned error can't find the container with id f70712e0ec08c5e414d594d2c428165228182290a89f7225378e48dfeaafee04
May 26 23:58:00.897777 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:00.897744    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-g9vqr" event={"ID":"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde","Type":"ContainerStarted","Data":"f70712e0ec08c5e414d594d2c428165228182290a89f7225378e48dfeaafee04"}
May 26 23:58:05.913138 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:05.913094    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-g9vqr" event={"ID":"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde","Type":"ContainerStarted","Data":"7bcfbb0c9e85a6fada0bb68fe8bbb2a9db3f3c264e4b93376b5bd82ed06e282e"}
May 26 23:58:11.930692 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:11.930659    2574 generic.go:358] "Generic (PLEG): container finished" podID="f03ab4b3-35a5-4e62-9988-d1b9eb6fafde" containerID="7bcfbb0c9e85a6fada0bb68fe8bbb2a9db3f3c264e4b93376b5bd82ed06e282e" exitCode=0
May 26 23:58:11.931077 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:11.930738    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-g9vqr" event={"ID":"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde","Type":"ContainerDied","Data":"7bcfbb0c9e85a6fada0bb68fe8bbb2a9db3f3c264e4b93376b5bd82ed06e282e"}
May 26 23:58:12.934465 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:12.934428    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-g9vqr" event={"ID":"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde","Type":"ContainerStarted","Data":"17306f32d303608102b4cd2fe633811e190dc905165f43b47bc6d2f2b75cf0e1"}
May 26 23:58:12.950770 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:12.950727    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-g9vqr" podStartSLOduration=9.07186831 podStartE2EDuration="13.950714968s" podCreationTimestamp="2026-05-26 23:57:59 +0000 UTC" firstStartedPulling="2026-05-26 23:58:00.466904575 +0000 UTC m=+876.362725313" lastFinishedPulling="2026-05-26 23:58:05.345751227 +0000 UTC m=+881.241571971" observedRunningTime="2026-05-26 23:58:12.948962342 +0000 UTC m=+888.844783101" watchObservedRunningTime="2026-05-26 23:58:12.950714968 +0000 UTC m=+888.846535727"
May 26 23:58:20.955770 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:20.955737    2574 generic.go:358] "Generic (PLEG): container finished" podID="f03ab4b3-35a5-4e62-9988-d1b9eb6fafde" containerID="17306f32d303608102b4cd2fe633811e190dc905165f43b47bc6d2f2b75cf0e1" exitCode=0
May 26 23:58:20.956155 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:20.955810    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-g9vqr" event={"ID":"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde","Type":"ContainerDied","Data":"17306f32d303608102b4cd2fe633811e190dc905165f43b47bc6d2f2b75cf0e1"}
May 26 23:58:22.073672 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:22.073651    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-g9vqr"
May 26 23:58:22.198029 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:22.197998    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc98w\" (UniqueName: \"kubernetes.io/projected/f03ab4b3-35a5-4e62-9988-d1b9eb6fafde-kube-api-access-vc98w\") pod \"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde\" (UID: \"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde\") "
May 26 23:58:22.199947 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:22.199921    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03ab4b3-35a5-4e62-9988-d1b9eb6fafde-kube-api-access-vc98w" (OuterVolumeSpecName: "kube-api-access-vc98w") pod "f03ab4b3-35a5-4e62-9988-d1b9eb6fafde" (UID: "f03ab4b3-35a5-4e62-9988-d1b9eb6fafde"). InnerVolumeSpecName "kube-api-access-vc98w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:58:22.298694 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:22.298677    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc98w\" (UniqueName: \"kubernetes.io/projected/f03ab4b3-35a5-4e62-9988-d1b9eb6fafde-kube-api-access-vc98w\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:58:22.962392 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:22.962324    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-g9vqr"
May 26 23:58:22.962528 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:22.962319    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-g9vqr" event={"ID":"f03ab4b3-35a5-4e62-9988-d1b9eb6fafde","Type":"ContainerDied","Data":"f70712e0ec08c5e414d594d2c428165228182290a89f7225378e48dfeaafee04"}
May 26 23:58:22.962528 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:22.962425    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f70712e0ec08c5e414d594d2c428165228182290a89f7225378e48dfeaafee04"
May 26 23:58:23.157217 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:23.157187    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-g9vqr_f03ab4b3-35a5-4e62-9988-d1b9eb6fafde/feast-0/0.log"
May 26 23:58:23.162157 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:23.162138    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-g9vqr_f03ab4b3-35a5-4e62-9988-d1b9eb6fafde/feast-1/0.log"
May 26 23:58:24.652575 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:24.652551    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:58:24.652986 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:24.652611    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 26 23:58:58.338603 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:58.338563    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-g9vqr"]
May 26 23:58:58.347125 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:58.347092    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-g9vqr"]
May 26 23:58:58.357961 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:58.357939    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-r5q9w"]
May 26 23:58:58.358165 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:58.358142    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-r5q9w" podUID="db3adafe-9638-4014-933b-96b783ca1a9a" containerName="redis" containerID="cri-o://6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add" gracePeriod=30
May 26 23:58:58.592685 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:58.592633    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-r5q9w"
May 26 23:58:58.696307 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:58.696275    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03ab4b3-35a5-4e62-9988-d1b9eb6fafde" path="/var/lib/kubelet/pods/f03ab4b3-35a5-4e62-9988-d1b9eb6fafde/volumes"
May 26 23:58:58.750162 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:58.750138    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s892d\" (UniqueName: \"kubernetes.io/projected/db3adafe-9638-4014-933b-96b783ca1a9a-kube-api-access-s892d\") pod \"db3adafe-9638-4014-933b-96b783ca1a9a\" (UID: \"db3adafe-9638-4014-933b-96b783ca1a9a\") "
May 26 23:58:58.752066 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:58.752030    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db3adafe-9638-4014-933b-96b783ca1a9a-kube-api-access-s892d" (OuterVolumeSpecName: "kube-api-access-s892d") pod "db3adafe-9638-4014-933b-96b783ca1a9a" (UID: "db3adafe-9638-4014-933b-96b783ca1a9a"). InnerVolumeSpecName "kube-api-access-s892d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:58:58.851178 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:58.851112    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s892d\" (UniqueName: \"kubernetes.io/projected/db3adafe-9638-4014-933b-96b783ca1a9a-kube-api-access-s892d\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 26 23:58:59.055674 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:59.055638    2574 generic.go:358] "Generic (PLEG): container finished" podID="db3adafe-9638-4014-933b-96b783ca1a9a" containerID="6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add" exitCode=0
May 26 23:58:59.055856 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:59.055697    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-r5q9w"
May 26 23:58:59.055856 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:59.055703    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-r5q9w" event={"ID":"db3adafe-9638-4014-933b-96b783ca1a9a","Type":"ContainerDied","Data":"6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add"}
May 26 23:58:59.055856 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:59.055731    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-r5q9w" event={"ID":"db3adafe-9638-4014-933b-96b783ca1a9a","Type":"ContainerDied","Data":"c177c7ef7a5e917183cc8e4f5f464eae75b3d855e153f8dd5609dae41df2715f"}
May 26 23:58:59.055856 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:59.055745    2574 scope.go:117] "RemoveContainer" containerID="6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add"
May 26 23:58:59.063799 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:59.063784    2574 scope.go:117] "RemoveContainer" containerID="6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add"
May 26 23:58:59.064088 ip-10-0-136-0 kubenswrapper[2574]: E0526 23:58:59.064042    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add\": container with ID starting with 6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add not found: ID does not exist" containerID="6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add"
May 26 23:58:59.064182 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:59.064094    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add"} err="failed to get container status \"6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add\": rpc error: code = NotFound desc = could not find container \"6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add\": container with ID starting with 6f929425d32a0fb99f560e7f883244772f17104352a9c0496edb46831d6a8add not found: ID does not exist"
May 26 23:58:59.074230 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:59.074206    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-r5q9w"]
May 26 23:58:59.077377 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:58:59.077357    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-r5q9w"]
May 26 23:59:00.696064 ip-10-0-136-0 kubenswrapper[2574]: I0526 23:59:00.696014    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db3adafe-9638-4014-933b-96b783ca1a9a" path="/var/lib/kubelet/pods/db3adafe-9638-4014-933b-96b783ca1a9a/volumes"
May 27 00:03:24.668960 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:24.668928    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 27 00:03:24.670206 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:24.670183    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 27 00:03:33.082155 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.082121    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"]
May 27 00:03:33.082497 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.082341    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03ab4b3-35a5-4e62-9988-d1b9eb6fafde" containerName="feast-0"
May 27 00:03:33.082497 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.082351    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03ab4b3-35a5-4e62-9988-d1b9eb6fafde" containerName="feast-0"
May 27 00:03:33.082497 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.082360    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db3adafe-9638-4014-933b-96b783ca1a9a" containerName="redis"
May 27 00:03:33.082497 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.082365    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="db3adafe-9638-4014-933b-96b783ca1a9a" containerName="redis"
May 27 00:03:33.082497 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.082376    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03ab4b3-35a5-4e62-9988-d1b9eb6fafde" containerName="feast-1"
May 27 00:03:33.082497 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.082381    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03ab4b3-35a5-4e62-9988-d1b9eb6fafde" containerName="feast-1"
May 27 00:03:33.082497 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.082423    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="db3adafe-9638-4014-933b-96b783ca1a9a" containerName="redis"
May 27 00:03:33.082497 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.082431    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="f03ab4b3-35a5-4e62-9988-d1b9eb6fafde" containerName="feast-1"
May 27 00:03:33.085140 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.085122    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"
May 27 00:03:33.087169 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.087148    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 27 00:03:33.087980 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.087962    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 27 00:03:33.088082 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.087966    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-j5lmh\""
May 27 00:03:33.100787 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.100768    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"]
May 27 00:03:33.157617 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.157586    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z8s6\" (UniqueName: \"kubernetes.io/projected/52274c76-b0d5-4653-acaa-4a3f9a88b97e-kube-api-access-7z8s6\") pod \"feast-operator-controller-manager-cf99db75-lnf7m\" (UID: \"52274c76-b0d5-4653-acaa-4a3f9a88b97e\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"
May 27 00:03:33.258441 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.258402    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7z8s6\" (UniqueName: \"kubernetes.io/projected/52274c76-b0d5-4653-acaa-4a3f9a88b97e-kube-api-access-7z8s6\") pod \"feast-operator-controller-manager-cf99db75-lnf7m\" (UID: \"52274c76-b0d5-4653-acaa-4a3f9a88b97e\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"
May 27 00:03:33.267783 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.267757    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z8s6\" (UniqueName: \"kubernetes.io/projected/52274c76-b0d5-4653-acaa-4a3f9a88b97e-kube-api-access-7z8s6\") pod \"feast-operator-controller-manager-cf99db75-lnf7m\" (UID: \"52274c76-b0d5-4653-acaa-4a3f9a88b97e\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"
May 27 00:03:33.394582 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.394522    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"
May 27 00:03:33.511015 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.510988    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"]
May 27 00:03:33.514094 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:03:33.514066    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52274c76_b0d5_4653_acaa_4a3f9a88b97e.slice/crio-e841e64a0aba8572d5dc5a7599d74d290916d4939cad0810800be95dffe7c494 WatchSource:0}: Error finding container e841e64a0aba8572d5dc5a7599d74d290916d4939cad0810800be95dffe7c494: Status 404 returned error can't find the container with id e841e64a0aba8572d5dc5a7599d74d290916d4939cad0810800be95dffe7c494
May 27 00:03:33.515831 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.515813    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 00:03:33.758913 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:33.758883    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m" event={"ID":"52274c76-b0d5-4653-acaa-4a3f9a88b97e","Type":"ContainerStarted","Data":"e841e64a0aba8572d5dc5a7599d74d290916d4939cad0810800be95dffe7c494"}
May 27 00:03:36.767594 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:36.767496    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m" event={"ID":"52274c76-b0d5-4653-acaa-4a3f9a88b97e","Type":"ContainerStarted","Data":"7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2"}
May 27 00:03:36.768017 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:36.767595    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"
May 27 00:03:36.783063 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:36.783004    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m" podStartSLOduration=0.788640966 podStartE2EDuration="3.782994148s" podCreationTimestamp="2026-05-27 00:03:33 +0000 UTC" firstStartedPulling="2026-05-27 00:03:33.515992444 +0000 UTC m=+1209.411813185" lastFinishedPulling="2026-05-27 00:03:36.510345629 +0000 UTC m=+1212.406166367" observedRunningTime="2026-05-27 00:03:36.781735147 +0000 UTC m=+1212.677555906" watchObservedRunningTime="2026-05-27 00:03:36.782994148 +0000 UTC m=+1212.678814908"
May 27 00:03:47.773699 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:47.773672    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"
May 27 00:03:49.884501 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.884465    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"]
May 27 00:03:49.888006 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.887984    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:49.890301 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.890267    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 27 00:03:49.890301 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.890296    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 27 00:03:49.890448 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.890307    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 27 00:03:49.890448 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.890297    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-cjph5\""
May 27 00:03:49.891135 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.891118    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 27 00:03:49.891214 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.891118    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 27 00:03:49.891270 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.891220    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 27 00:03:49.899381 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.899360    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"]
May 27 00:03:49.981069 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.981030    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:49.981189 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.981076    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:49.981189 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.981135    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:49.981189 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.981179    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:49.981310 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.981206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48a0470e-c5f3-4186-97f1-764005e232b7-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:49.981310 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:49.981272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8mrp\" (UniqueName: \"kubernetes.io/projected/48a0470e-c5f3-4186-97f1-764005e232b7-kube-api-access-j8mrp\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.081961 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.081931    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8mrp\" (UniqueName: \"kubernetes.io/projected/48a0470e-c5f3-4186-97f1-764005e232b7-kube-api-access-j8mrp\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.082072 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.081969    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.082072 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.081988    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.082146 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.082114    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.082180 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.082153    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.082225 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.082187    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48a0470e-c5f3-4186-97f1-764005e232b7-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.082539 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.082516    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48a0470e-c5f3-4186-97f1-764005e232b7-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.084465 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.084433    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.084582 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.084562    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.084639 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.084579    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.084675 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.084639    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.089119 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.089100    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8mrp\" (UniqueName: \"kubernetes.io/projected/48a0470e-c5f3-4186-97f1-764005e232b7-kube-api-access-j8mrp\") pod \"feast-simple-feast-setup-664fcfcc58-7n52w\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.197363 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.197290    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:03:50.320014 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.319805    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"]
May 27 00:03:50.322949 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:03:50.322915    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48a0470e_c5f3_4186_97f1_764005e232b7.slice/crio-9d09bd310c475dbdd7a14cf995e383b83c8cff9164bf7dbd3358dcccd23e9039 WatchSource:0}: Error finding container 9d09bd310c475dbdd7a14cf995e383b83c8cff9164bf7dbd3358dcccd23e9039: Status 404 returned error can't find the container with id 9d09bd310c475dbdd7a14cf995e383b83c8cff9164bf7dbd3358dcccd23e9039
May 27 00:03:50.805504 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:03:50.805475    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerStarted","Data":"9d09bd310c475dbdd7a14cf995e383b83c8cff9164bf7dbd3358dcccd23e9039"}
May 27 00:04:06.853072 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:06.853016    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerStarted","Data":"2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82"}
May 27 00:04:11.867488 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:11.867453    2574 generic.go:358] "Generic (PLEG): container finished" podID="48a0470e-c5f3-4186-97f1-764005e232b7" containerID="2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82" exitCode=0
May 27 00:04:11.867901 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:11.867526    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerDied","Data":"2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82"}
May 27 00:04:12.871366 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:12.871332    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerStarted","Data":"201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6"}
May 27 00:04:17.889519 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:17.889483    2574 generic.go:358] "Generic (PLEG): container finished" podID="48a0470e-c5f3-4186-97f1-764005e232b7" containerID="201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6" exitCode=0
May 27 00:04:17.889917 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:17.889543    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerDied","Data":"201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6"}
May 27 00:04:18.896908 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:18.896863    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerStarted","Data":"3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45"}
May 27 00:04:18.897419 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:18.896920    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerStarted","Data":"421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259"}
May 27 00:04:18.897419 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:18.896936    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerStarted","Data":"bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6"}
May 27 00:04:18.897419 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:18.896949    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerStarted","Data":"b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161"}
May 27 00:04:18.920394 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:18.920280    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podStartSLOduration=13.877442948 podStartE2EDuration="29.920260347s" podCreationTimestamp="2026-05-27 00:03:49 +0000 UTC" firstStartedPulling="2026-05-27 00:03:50.324645234 +0000 UTC m=+1226.220465973" lastFinishedPulling="2026-05-27 00:04:06.367462631 +0000 UTC m=+1242.263283372" observedRunningTime="2026-05-27 00:04:18.918645547 +0000 UTC m=+1254.814466308" watchObservedRunningTime="2026-05-27 00:04:18.920260347 +0000 UTC m=+1254.816081108"
May 27 00:04:20.198171 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.197987    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:20.198171 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.198039    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:20.198171 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.198072    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:20.198171 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.198088    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:20.198171 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.198100    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:20.198857 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.198563    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:20.198857 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.198591    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:20.198857 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.198607    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:20.200379 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.200291    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 27 00:04:20.200379 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.200306    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 00:04:20.200379 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.200317    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused"
May 27 00:04:20.200618 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:20.200379    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 00:04:23.198594 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:23.198540    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 27 00:04:23.199167 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:23.198628    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 00:04:23.199167 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:23.198559    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused"
May 27 00:04:23.199167 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:23.198555    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 00:04:24.676147 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:24.676116    2574 scope.go:117] "RemoveContainer" containerID="17306f32d303608102b4cd2fe633811e190dc905165f43b47bc6d2f2b75cf0e1"
May 27 00:04:24.683426 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:24.683406    2574 scope.go:117] "RemoveContainer" containerID="7bcfbb0c9e85a6fada0bb68fe8bbb2a9db3f3c264e4b93376b5bd82ed06e282e"
May 27 00:04:26.198652 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:26.198622    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:26.199030 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:26.198718    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:26.199030 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:26.198930    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:26.199455 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:26.199431    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:26.199582 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:26.199536    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:26.199880 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:26.199866    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:26.203273 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:26.203254    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:04:26.923157 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:04:26.923126    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:05:29.200615 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.200577    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"]
May 27 00:05:29.203659 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.201009    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="registry" containerID="cri-o://b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161" gracePeriod=30
May 27 00:05:29.203659 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.201083    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="offline" containerID="cri-o://421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259" gracePeriod=30
May 27 00:05:29.203659 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.201092    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="online" containerID="cri-o://bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6" gracePeriod=30
May 27 00:05:29.203659 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.201195    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="ui" containerID="cri-o://3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45" gracePeriod=30
May 27 00:05:29.583071 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.583011    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"]
May 27 00:05:29.586319 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.586293    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.588590 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.588568    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-q7tj8\""
May 27 00:05:29.597687 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.597661    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"]
May 27 00:05:29.725844 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.725818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.725963 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.725862    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.725963 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.725883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/455addf0-feb5-4e2a-be05-f3e4d2977574-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.726066 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.725962    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.726109 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.726065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs424\" (UniqueName: \"kubernetes.io/projected/455addf0-feb5-4e2a-be05-f3e4d2977574-kube-api-access-qs424\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.726144 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.726134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.827157 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.827131    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.827240 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.827172    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.827240 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.827208    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.827240 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.827227    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/455addf0-feb5-4e2a-be05-f3e4d2977574-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.827384 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.827244    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.827384 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.827280    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qs424\" (UniqueName: \"kubernetes.io/projected/455addf0-feb5-4e2a-be05-f3e4d2977574-kube-api-access-qs424\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.827384 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:05:29.827369    2574 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 27 00:05:29.827535 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:05:29.827463    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-online-tls podName:455addf0-feb5-4e2a-be05-f3e4d2977574 nodeName:}" failed. No retries permitted until 2026-05-27 00:05:30.327438887 +0000 UTC m=+1326.223259629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-online-tls") pod "feast-simple-feast-setup-664fcfcc58-hc575" (UID: "455addf0-feb5-4e2a-be05-f3e4d2977574") : secret "feast-simple-feast-setup-online-tls" not found
May 27 00:05:29.827684 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.827656    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/455addf0-feb5-4e2a-be05-f3e4d2977574-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.829569 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.829542    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.829726 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.829706    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.829726 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.829716    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:29.837232 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:29.837179    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs424\" (UniqueName: \"kubernetes.io/projected/455addf0-feb5-4e2a-be05-f3e4d2977574-kube-api-access-qs424\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:30.088778 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:30.088698    2574 generic.go:358] "Generic (PLEG): container finished" podID="48a0470e-c5f3-4186-97f1-764005e232b7" containerID="3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45" exitCode=0
May 27 00:05:30.088778 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:30.088725    2574 generic.go:358] "Generic (PLEG): container finished" podID="48a0470e-c5f3-4186-97f1-764005e232b7" containerID="bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6" exitCode=0
May 27 00:05:30.088946 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:30.088770    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerDied","Data":"3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45"}
May 27 00:05:30.088946 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:30.088805    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerDied","Data":"bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6"}
May 27 00:05:30.331789 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:30.331752    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:30.334111 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:30.334093    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hc575\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:30.498646 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:30.498574    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:30.622533 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:30.622507    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"]
May 27 00:05:30.624324 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:05:30.624301    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod455addf0_feb5_4e2a_be05_f3e4d2977574.slice/crio-b008aea9ced823c093b285c206b3da36e48ed4bff79807c2466b041016b1ca03 WatchSource:0}: Error finding container b008aea9ced823c093b285c206b3da36e48ed4bff79807c2466b041016b1ca03: Status 404 returned error can't find the container with id b008aea9ced823c093b285c206b3da36e48ed4bff79807c2466b041016b1ca03
May 27 00:05:31.093377 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:31.093336    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerStarted","Data":"1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3"}
May 27 00:05:31.093377 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:31.093375    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerStarted","Data":"b008aea9ced823c093b285c206b3da36e48ed4bff79807c2466b041016b1ca03"}
May 27 00:05:36.108229 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:36.108194    2574 generic.go:358] "Generic (PLEG): container finished" podID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerID="1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3" exitCode=0
May 27 00:05:36.108610 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:36.108245    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerDied","Data":"1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3"}
May 27 00:05:36.200234 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:36.200191    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 00:05:36.921433 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:36.921389    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 00:05:37.112405 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:37.112373    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerStarted","Data":"6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a"}
May 27 00:05:42.127190 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:42.127154    2574 generic.go:358] "Generic (PLEG): container finished" podID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerID="6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a" exitCode=0
May 27 00:05:42.127551 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:42.127230    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerDied","Data":"6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a"}
May 27 00:05:43.135025 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:43.134972    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerStarted","Data":"1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952"}
May 27 00:05:43.135494 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:43.135035    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerStarted","Data":"6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283"}
May 27 00:05:43.135494 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:43.135075    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerStarted","Data":"afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b"}
May 27 00:05:43.135494 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:43.135089    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerStarted","Data":"e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6"}
May 27 00:05:43.158116 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:43.158002    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podStartSLOduration=14.157984375 podStartE2EDuration="14.157984375s" podCreationTimestamp="2026-05-27 00:05:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 00:05:43.15774409 +0000 UTC m=+1339.053564863" watchObservedRunningTime="2026-05-27 00:05:43.157984375 +0000 UTC m=+1339.053805136"
May 27 00:05:45.499025 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:45.498978    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:45.499025 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:45.499029    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:45.499565 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:45.499042    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:45.499565 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:45.499079    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:45.501058 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:45.501010    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 27 00:05:45.501207 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:45.501036    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.18:8816: connect: connection refused"
May 27 00:05:45.501207 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:45.501068    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 27 00:05:45.501207 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:45.501134    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.18:6571: connect: connection refused"
May 27 00:05:46.200218 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:46.200173    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 00:05:46.921652 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:46.921602    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 00:05:48.499415 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.499370    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:48.499798 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.499511    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:48.499798 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.499726    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:48.500045 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.500023    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:48.500205 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.500192    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:48.500276 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.500224    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:48.500334 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.500286    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:48.500376 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.500336    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:48.500446 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.500428    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:48.503891 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:48.503875    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:49.153707 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:49.153674    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:49.156461 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:49.156442    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:05:56.199453 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:56.199413    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 27 00:05:56.199878 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:56.199523    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:05:56.920471 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:56.920436    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 27 00:05:56.920656 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:56.920550    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:05:59.847671 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.847651    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:05:59.974535 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.974472    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8mrp\" (UniqueName: \"kubernetes.io/projected/48a0470e-c5f3-4186-97f1-764005e232b7-kube-api-access-j8mrp\") pod \"48a0470e-c5f3-4186-97f1-764005e232b7\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") "
May 27 00:05:59.974535 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.974511    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48a0470e-c5f3-4186-97f1-764005e232b7-feast-data\") pod \"48a0470e-c5f3-4186-97f1-764005e232b7\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") "
May 27 00:05:59.974535 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.974538    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-offline-tls\") pod \"48a0470e-c5f3-4186-97f1-764005e232b7\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") "
May 27 00:05:59.974769 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.974564    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-online-tls\") pod \"48a0470e-c5f3-4186-97f1-764005e232b7\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") "
May 27 00:05:59.974769 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.974583    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-registry-tls\") pod \"48a0470e-c5f3-4186-97f1-764005e232b7\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") "
May 27 00:05:59.974769 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.974631    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-ui-tls\") pod \"48a0470e-c5f3-4186-97f1-764005e232b7\" (UID: \"48a0470e-c5f3-4186-97f1-764005e232b7\") "
May 27 00:05:59.975104 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.975079    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a0470e-c5f3-4186-97f1-764005e232b7-feast-data" (OuterVolumeSpecName: "feast-data") pod "48a0470e-c5f3-4186-97f1-764005e232b7" (UID: "48a0470e-c5f3-4186-97f1-764005e232b7"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 00:05:59.976853 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.976819    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-online-tls" (OuterVolumeSpecName: "online-tls") pod "48a0470e-c5f3-4186-97f1-764005e232b7" (UID: "48a0470e-c5f3-4186-97f1-764005e232b7"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:05:59.977171 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.977128    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a0470e-c5f3-4186-97f1-764005e232b7-kube-api-access-j8mrp" (OuterVolumeSpecName: "kube-api-access-j8mrp") pod "48a0470e-c5f3-4186-97f1-764005e232b7" (UID: "48a0470e-c5f3-4186-97f1-764005e232b7"). InnerVolumeSpecName "kube-api-access-j8mrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 00:05:59.977272 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.977174    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "48a0470e-c5f3-4186-97f1-764005e232b7" (UID: "48a0470e-c5f3-4186-97f1-764005e232b7"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:05:59.977272 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.977194    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "48a0470e-c5f3-4186-97f1-764005e232b7" (UID: "48a0470e-c5f3-4186-97f1-764005e232b7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:05:59.977355 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:05:59.977341    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "48a0470e-c5f3-4186-97f1-764005e232b7" (UID: "48a0470e-c5f3-4186-97f1-764005e232b7"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:06:00.075120 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.075087    2574 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-ui-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:06:00.075120 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.075112    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8mrp\" (UniqueName: \"kubernetes.io/projected/48a0470e-c5f3-4186-97f1-764005e232b7-kube-api-access-j8mrp\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:06:00.075120 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.075124    2574 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48a0470e-c5f3-4186-97f1-764005e232b7-feast-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:06:00.075324 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.075135    2574 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-offline-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:06:00.075324 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.075143    2574 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-online-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:06:00.075324 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.075151    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48a0470e-c5f3-4186-97f1-764005e232b7-registry-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:06:00.183100 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.183044    2574 generic.go:358] "Generic (PLEG): container finished" podID="48a0470e-c5f3-4186-97f1-764005e232b7" containerID="421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259" exitCode=137
May 27 00:06:00.183100 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.183088    2574 generic.go:358] "Generic (PLEG): container finished" podID="48a0470e-c5f3-4186-97f1-764005e232b7" containerID="b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161" exitCode=137
May 27 00:06:00.183265 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.183140    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"
May 27 00:06:00.183265 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.183141    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerDied","Data":"421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259"}
May 27 00:06:00.183265 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.183179    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerDied","Data":"b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161"}
May 27 00:06:00.183265 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.183189    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w" event={"ID":"48a0470e-c5f3-4186-97f1-764005e232b7","Type":"ContainerDied","Data":"9d09bd310c475dbdd7a14cf995e383b83c8cff9164bf7dbd3358dcccd23e9039"}
May 27 00:06:00.183265 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.183204    2574 scope.go:117] "RemoveContainer" containerID="3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45"
May 27 00:06:00.191366 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.191321    2574 scope.go:117] "RemoveContainer" containerID="421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259"
May 27 00:06:00.197937 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.197923    2574 scope.go:117] "RemoveContainer" containerID="bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6"
May 27 00:06:00.204092 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.204069    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"]
May 27 00:06:00.204854 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.204841    2574 scope.go:117] "RemoveContainer" containerID="b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161"
May 27 00:06:00.207426 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.207406    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7n52w"]
May 27 00:06:00.212000 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.211798    2574 scope.go:117] "RemoveContainer" containerID="201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6"
May 27 00:06:00.218106 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.218090    2574 scope.go:117] "RemoveContainer" containerID="2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82"
May 27 00:06:00.224294 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.224279    2574 scope.go:117] "RemoveContainer" containerID="3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45"
May 27 00:06:00.224528 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:06:00.224511    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45\": container with ID starting with 3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45 not found: ID does not exist" containerID="3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45"
May 27 00:06:00.224584 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.224536    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45"} err="failed to get container status \"3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45\": rpc error: code = NotFound desc = could not find container \"3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45\": container with ID starting with 3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45 not found: ID does not exist"
May 27 00:06:00.224584 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.224554    2574 scope.go:117] "RemoveContainer" containerID="421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259"
May 27 00:06:00.224770 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:06:00.224755    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259\": container with ID starting with 421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259 not found: ID does not exist" containerID="421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259"
May 27 00:06:00.224813 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.224776    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259"} err="failed to get container status \"421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259\": rpc error: code = NotFound desc = could not find container \"421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259\": container with ID starting with 421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259 not found: ID does not exist"
May 27 00:06:00.224813 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.224797    2574 scope.go:117] "RemoveContainer" containerID="bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6"
May 27 00:06:00.225016 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:06:00.224999    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6\": container with ID starting with bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6 not found: ID does not exist" containerID="bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6"
May 27 00:06:00.225080 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225021    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6"} err="failed to get container status \"bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6\": rpc error: code = NotFound desc = could not find container \"bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6\": container with ID starting with bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6 not found: ID does not exist"
May 27 00:06:00.225080 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225036    2574 scope.go:117] "RemoveContainer" containerID="b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161"
May 27 00:06:00.225270 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:06:00.225253    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161\": container with ID starting with b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161 not found: ID does not exist" containerID="b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161"
May 27 00:06:00.225330 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225278    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161"} err="failed to get container status \"b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161\": rpc error: code = NotFound desc = could not find container \"b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161\": container with ID starting with b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161 not found: ID does not exist"
May 27 00:06:00.225330 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225299    2574 scope.go:117] "RemoveContainer" containerID="201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6"
May 27 00:06:00.225516 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:06:00.225502    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6\": container with ID starting with 201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6 not found: ID does not exist" containerID="201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6"
May 27 00:06:00.225554 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225520    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6"} err="failed to get container status \"201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6\": rpc error: code = NotFound desc = could not find container \"201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6\": container with ID starting with 201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6 not found: ID does not exist"
May 27 00:06:00.225554 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225531    2574 scope.go:117] "RemoveContainer" containerID="2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82"
May 27 00:06:00.225725 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:06:00.225710    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82\": container with ID starting with 2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82 not found: ID does not exist" containerID="2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82"
May 27 00:06:00.225761 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225731    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82"} err="failed to get container status \"2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82\": rpc error: code = NotFound desc = could not find container \"2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82\": container with ID starting with 2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82 not found: ID does not exist"
May 27 00:06:00.225761 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225744    2574 scope.go:117] "RemoveContainer" containerID="3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45"
May 27 00:06:00.225941 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225922    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45"} err="failed to get container status \"3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45\": rpc error: code = NotFound desc = could not find container \"3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45\": container with ID starting with 3ad9b4de0a432900ab8c74564c0e83416af1f97172f9d8a056da125b76471d45 not found: ID does not exist"
May 27 00:06:00.225984 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.225942    2574 scope.go:117] "RemoveContainer" containerID="421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259"
May 27 00:06:00.226141 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.226122    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259"} err="failed to get container status \"421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259\": rpc error: code = NotFound desc = could not find container \"421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259\": container with ID starting with 421a77673e0574a7ac11cc982209af786e2612d9a667f4c405e2a3910e5c2259 not found: ID does not exist"
May 27 00:06:00.226141 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.226139    2574 scope.go:117] "RemoveContainer" containerID="bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6"
May 27 00:06:00.226366 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.226348    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6"} err="failed to get container status \"bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6\": rpc error: code = NotFound desc = could not find container \"bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6\": container with ID starting with bcffae7f845476ae2517916d3225716d048dc52255327ca3c88845276b01f5b6 not found: ID does not exist"
May 27 00:06:00.226417 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.226369    2574 scope.go:117] "RemoveContainer" containerID="b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161"
May 27 00:06:00.226578 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.226554    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161"} err="failed to get container status \"b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161\": rpc error: code = NotFound desc = could not find container \"b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161\": container with ID starting with b2e2e1cae20b15cbe7f2458aa5dfc4dadf04d0184dfa93e2ba3660f284712161 not found: ID does not exist"
May 27 00:06:00.226578 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.226570    2574 scope.go:117] "RemoveContainer" containerID="201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6"
May 27 00:06:00.226812 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.226793    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6"} err="failed to get container status \"201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6\": rpc error: code = NotFound desc = could not find container \"201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6\": container with ID starting with 201426ee64e6a87dcfed4b8b3b049b421fb63774db1f73275fd570c892a58ec6 not found: ID does not exist"
May 27 00:06:00.226858 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.226813    2574 scope.go:117] "RemoveContainer" containerID="2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82"
May 27 00:06:00.227027 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.227008    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82"} err="failed to get container status \"2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82\": rpc error: code = NotFound desc = could not find container \"2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82\": container with ID starting with 2c5d0a6f71c11d4a8bc883e229bfea590c0480f5d841f99586904c053901fd82 not found: ID does not exist"
May 27 00:06:00.696015 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:00.695982    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" path="/var/lib/kubelet/pods/48a0470e-c5f3-4186-97f1-764005e232b7/volumes"
May 27 00:06:51.438391 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438353    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"]
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438695    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="registry"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438712    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="registry"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438729    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="online"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438739    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="online"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438752    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="feast-init"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438761    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="feast-init"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438771    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="feast-apply"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438777    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="feast-apply"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438784    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="ui"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438789    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="ui"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438801    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="offline"
May 27 00:06:51.438830 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438807    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="offline"
May 27 00:06:51.439232 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438854    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="online"
May 27 00:06:51.439232 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438861    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="ui"
May 27 00:06:51.439232 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438870    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="registry"
May 27 00:06:51.439232 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.438876    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="48a0470e-c5f3-4186-97f1-764005e232b7" containerName="offline"
May 27 00:06:51.442007 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.441991    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.444156 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.444133    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 27 00:06:51.444288 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.444168    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 27 00:06:51.444288 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.444210    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 27 00:06:51.444288 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.444172    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-tq8kh\""
May 27 00:06:51.444449 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.444313    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 27 00:06:51.444832 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.444817    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 27 00:06:51.444874 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.444838    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 27 00:06:51.450092 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.450071    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"]
May 27 00:06:51.616183 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.616154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.616183 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.616185    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.616360 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.616212    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97f6t\" (UniqueName: \"kubernetes.io/projected/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-kube-api-access-97f6t\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.616360 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.616242    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.616360 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.616277    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.616360 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.616337    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.716835 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.716772    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.716835 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.716805    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.717006 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.716841    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97f6t\" (UniqueName: \"kubernetes.io/projected/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-kube-api-access-97f6t\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.717006 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.716868    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.717006 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.716906    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.717006 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:06:51.716915    2574 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
May 27 00:06:51.717006 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.716952    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.717006 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:06:51.716974    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-offline-tls podName:fe3d38ae-6ad8-44c7-9050-ad0828b3d186 nodeName:}" failed. No retries permitted until 2026-05-27 00:06:52.216954165 +0000 UTC m=+1408.112774905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-offline-tls") pod "feast-simple-feast-remote-setup-5cff94746b-7h8lh" (UID: "fe3d38ae-6ad8-44c7-9050-ad0828b3d186") : secret "feast-simple-feast-remote-setup-offline-tls" not found
May 27 00:06:51.717305 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.717184    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.717567 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.717550    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.719329 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.719301    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.719428 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.719339    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:51.724897 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:51.724872    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97f6t\" (UniqueName: \"kubernetes.io/projected/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-kube-api-access-97f6t\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:52.220549 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:52.220499    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:52.222865 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:52.222832    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-7h8lh\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:52.352111 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:52.352082    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:06:52.474474 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:52.474335    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"]
May 27 00:06:52.476615 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:06:52.476585    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe3d38ae_6ad8_44c7_9050_ad0828b3d186.slice/crio-c452326e86d2aa1d4fa749ad8584995a6abb7033ae4cb1c49dee15479971eb81 WatchSource:0}: Error finding container c452326e86d2aa1d4fa749ad8584995a6abb7033ae4cb1c49dee15479971eb81: Status 404 returned error can't find the container with id c452326e86d2aa1d4fa749ad8584995a6abb7033ae4cb1c49dee15479971eb81
May 27 00:06:53.318614 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:53.318577    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerStarted","Data":"67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81"}
May 27 00:06:53.318614 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:53.318616    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerStarted","Data":"c452326e86d2aa1d4fa749ad8584995a6abb7033ae4cb1c49dee15479971eb81"}
May 27 00:06:57.330573 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:57.330481    2574 generic.go:358] "Generic (PLEG): container finished" podID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerID="67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81" exitCode=0
May 27 00:06:57.330573 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:57.330544    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerDied","Data":"67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81"}
May 27 00:06:58.335571 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:06:58.335534    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerStarted","Data":"18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c"}
May 27 00:07:03.353404 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:03.353364    2574 generic.go:358] "Generic (PLEG): container finished" podID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerID="18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c" exitCode=0
May 27 00:07:03.353870 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:03.353426    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerDied","Data":"18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c"}
May 27 00:07:04.359949 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:04.359904    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerStarted","Data":"1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6"}
May 27 00:07:04.359949 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:04.359947    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerStarted","Data":"a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662"}
May 27 00:07:04.359949 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:04.359958    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerStarted","Data":"4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6"}
May 27 00:07:04.381415 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:04.381359    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podStartSLOduration=13.381344837 podStartE2EDuration="13.381344837s" podCreationTimestamp="2026-05-27 00:06:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 00:07:04.379865478 +0000 UTC m=+1420.275686237" watchObservedRunningTime="2026-05-27 00:07:04.381344837 +0000 UTC m=+1420.277165597"
May 27 00:07:07.352512 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:07.352475    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:07.352974 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:07.352747    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:07.352974 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:07.352773    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:07.354586 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:07.354554    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.19:8816: connect: connection refused"
May 27 00:07:07.354717 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:07.354606    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 27 00:07:07.354717 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:07.354574    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 27 00:07:10.353327 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:10.353297    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:10.353808 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:10.353763    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:10.353808 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:10.353794    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:10.354078 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:10.354036    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:10.357479 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:10.357456    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:10.380107 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:10.380089    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:10.380257 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:10.380238    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:10.380485 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:10.380462    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:07:10.382777 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:07:10.382757    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:08:12.672352 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:12.672311    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"]
May 27 00:08:12.672946 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:12.672727    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="online" containerID="cri-o://4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6" gracePeriod=30
May 27 00:08:12.672946 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:12.672897    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="offline" containerID="cri-o://a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662" gracePeriod=30
May 27 00:08:12.673146 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:12.672952    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="ui" containerID="cri-o://1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6" gracePeriod=30
May 27 00:08:12.817483 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:12.815697    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"]
May 27 00:08:12.817483 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:12.816119    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="registry" containerID="cri-o://e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6" gracePeriod=30
May 27 00:08:12.817483 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:12.816495    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="ui" containerID="cri-o://1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952" gracePeriod=30
May 27 00:08:12.817483 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:12.816592    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="offline" containerID="cri-o://6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283" gracePeriod=30
May 27 00:08:12.817483 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:12.816655    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="online" containerID="cri-o://afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b" gracePeriod=30
May 27 00:08:13.550858 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:13.550829    2574 generic.go:358] "Generic (PLEG): container finished" podID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerID="1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6" exitCode=0
May 27 00:08:13.550858 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:13.550852    2574 generic.go:358] "Generic (PLEG): container finished" podID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerID="4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6" exitCode=0
May 27 00:08:13.551012 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:13.550900    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerDied","Data":"1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6"}
May 27 00:08:13.551012 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:13.550934    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerDied","Data":"4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6"}
May 27 00:08:13.553377 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:13.553348    2574 generic.go:358] "Generic (PLEG): container finished" podID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerID="1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952" exitCode=0
May 27 00:08:13.553377 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:13.553365    2574 generic.go:358] "Generic (PLEG): container finished" podID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerID="afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b" exitCode=0
May 27 00:08:13.553505 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:13.553407    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerDied","Data":"1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952"}
May 27 00:08:13.553505 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:13.553430    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerDied","Data":"afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b"}
May 27 00:08:18.500733 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:18.500682    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 27 00:08:19.154112 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:19.154039    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 27 00:08:20.354252 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:20.354208    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 27 00:08:20.380967 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:20.380928    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 27 00:08:24.690555 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:24.690525    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 27 00:08:24.692194 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:24.692173    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 27 00:08:28.501209 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:28.501151    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 27 00:08:29.154733 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:29.154694    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 27 00:08:30.354525 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:30.354483    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 27 00:08:30.380576 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:30.380549    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 27 00:08:38.500995 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:38.500910    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 27 00:08:38.501407 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:38.501073    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:08:39.154829 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:39.154795    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 27 00:08:39.154926 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:39.154916    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:08:40.354203 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:40.354163    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 27 00:08:40.354564 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:40.354296    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:08:40.380733 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:40.380702    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 27 00:08:40.380880 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:40.380804    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:08:42.850317 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.850296    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:08:42.912201 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.912177    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-offline-tls\") pod \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") "
May 27 00:08:42.912201 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.912210    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-registry-tls\") pod \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") "
May 27 00:08:42.912395 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.912231    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-online-tls\") pod \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") "
May 27 00:08:42.912395 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.912288    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97f6t\" (UniqueName: \"kubernetes.io/projected/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-kube-api-access-97f6t\") pod \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") "
May 27 00:08:42.912395 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.912314    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-ui-tls\") pod \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") "
May 27 00:08:42.912395 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.912342    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-feast-data\") pod \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\" (UID: \"fe3d38ae-6ad8-44c7-9050-ad0828b3d186\") "
May 27 00:08:42.912704 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.912574    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fe3d38ae-6ad8-44c7-9050-ad0828b3d186" (UID: "fe3d38ae-6ad8-44c7-9050-ad0828b3d186"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 00:08:42.912902 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.912857    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-feast-data" (OuterVolumeSpecName: "feast-data") pod "fe3d38ae-6ad8-44c7-9050-ad0828b3d186" (UID: "fe3d38ae-6ad8-44c7-9050-ad0828b3d186"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 00:08:42.914406 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.914384    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "fe3d38ae-6ad8-44c7-9050-ad0828b3d186" (UID: "fe3d38ae-6ad8-44c7-9050-ad0828b3d186"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:08:42.914509 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.914407    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "fe3d38ae-6ad8-44c7-9050-ad0828b3d186" (UID: "fe3d38ae-6ad8-44c7-9050-ad0828b3d186"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:08:42.914719 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.914704    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-online-tls" (OuterVolumeSpecName: "online-tls") pod "fe3d38ae-6ad8-44c7-9050-ad0828b3d186" (UID: "fe3d38ae-6ad8-44c7-9050-ad0828b3d186"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:08:42.914778 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:42.914753    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-kube-api-access-97f6t" (OuterVolumeSpecName: "kube-api-access-97f6t") pod "fe3d38ae-6ad8-44c7-9050-ad0828b3d186" (UID: "fe3d38ae-6ad8-44c7-9050-ad0828b3d186"). InnerVolumeSpecName "kube-api-access-97f6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 00:08:43.013219 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.013182    2574 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-offline-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.013219 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.013218    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-registry-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.013384 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.013228    2574 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-online-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.013384 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.013237    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97f6t\" (UniqueName: \"kubernetes.io/projected/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-kube-api-access-97f6t\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.013384 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.013248    2574 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-ui-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.013384 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.013257    2574 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fe3d38ae-6ad8-44c7-9050-ad0828b3d186-feast-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.455607 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.455584    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:08:43.516123 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.516091    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-ui-tls\") pod \"455addf0-feb5-4e2a-be05-f3e4d2977574\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") "
May 27 00:08:43.516123 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.516130    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs424\" (UniqueName: \"kubernetes.io/projected/455addf0-feb5-4e2a-be05-f3e4d2977574-kube-api-access-qs424\") pod \"455addf0-feb5-4e2a-be05-f3e4d2977574\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") "
May 27 00:08:43.516335 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.516158    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/455addf0-feb5-4e2a-be05-f3e4d2977574-feast-data\") pod \"455addf0-feb5-4e2a-be05-f3e4d2977574\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") "
May 27 00:08:43.516335 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.516205    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-registry-tls\") pod \"455addf0-feb5-4e2a-be05-f3e4d2977574\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") "
May 27 00:08:43.516335 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.516252    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-online-tls\") pod \"455addf0-feb5-4e2a-be05-f3e4d2977574\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") "
May 27 00:08:43.516335 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.516278    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-offline-tls\") pod \"455addf0-feb5-4e2a-be05-f3e4d2977574\" (UID: \"455addf0-feb5-4e2a-be05-f3e4d2977574\") "
May 27 00:08:43.516764 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.516726    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455addf0-feb5-4e2a-be05-f3e4d2977574-feast-data" (OuterVolumeSpecName: "feast-data") pod "455addf0-feb5-4e2a-be05-f3e4d2977574" (UID: "455addf0-feb5-4e2a-be05-f3e4d2977574"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 00:08:43.518405 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.518377    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "455addf0-feb5-4e2a-be05-f3e4d2977574" (UID: "455addf0-feb5-4e2a-be05-f3e4d2977574"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:08:43.518819 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.518787    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "455addf0-feb5-4e2a-be05-f3e4d2977574" (UID: "455addf0-feb5-4e2a-be05-f3e4d2977574"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:08:43.518866 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.518809    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-online-tls" (OuterVolumeSpecName: "online-tls") pod "455addf0-feb5-4e2a-be05-f3e4d2977574" (UID: "455addf0-feb5-4e2a-be05-f3e4d2977574"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:08:43.518897 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.518865    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "455addf0-feb5-4e2a-be05-f3e4d2977574" (UID: "455addf0-feb5-4e2a-be05-f3e4d2977574"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:08:43.518897 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.518873    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/455addf0-feb5-4e2a-be05-f3e4d2977574-kube-api-access-qs424" (OuterVolumeSpecName: "kube-api-access-qs424") pod "455addf0-feb5-4e2a-be05-f3e4d2977574" (UID: "455addf0-feb5-4e2a-be05-f3e4d2977574"). InnerVolumeSpecName "kube-api-access-qs424". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 00:08:43.617285 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.617204    2574 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-online-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.617285 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.617245    2574 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-offline-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.617285 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.617253    2574 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-ui-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.617285 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.617262    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs424\" (UniqueName: \"kubernetes.io/projected/455addf0-feb5-4e2a-be05-f3e4d2977574-kube-api-access-qs424\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.617285 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.617270    2574 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/455addf0-feb5-4e2a-be05-f3e4d2977574-feast-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.617285 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.617279    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/455addf0-feb5-4e2a-be05-f3e4d2977574-registry-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:08:43.638380 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.638353    2574 generic.go:358] "Generic (PLEG): container finished" podID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerID="a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662" exitCode=137
May 27 00:08:43.638504 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.638424    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"
May 27 00:08:43.638558 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.638424    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerDied","Data":"a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662"}
May 27 00:08:43.638558 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.638539    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh" event={"ID":"fe3d38ae-6ad8-44c7-9050-ad0828b3d186","Type":"ContainerDied","Data":"c452326e86d2aa1d4fa749ad8584995a6abb7033ae4cb1c49dee15479971eb81"}
May 27 00:08:43.638678 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.638570    2574 scope.go:117] "RemoveContainer" containerID="1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6"
May 27 00:08:43.640782 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.640761    2574 generic.go:358] "Generic (PLEG): container finished" podID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerID="6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283" exitCode=137
May 27 00:08:43.640782 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.640780    2574 generic.go:358] "Generic (PLEG): container finished" podID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerID="e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6" exitCode=137
May 27 00:08:43.640928 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.640830    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"
May 27 00:08:43.640928 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.640846    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerDied","Data":"6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283"}
May 27 00:08:43.640928 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.640865    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerDied","Data":"e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6"}
May 27 00:08:43.640928 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.640879    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575" event={"ID":"455addf0-feb5-4e2a-be05-f3e4d2977574","Type":"ContainerDied","Data":"b008aea9ced823c093b285c206b3da36e48ed4bff79807c2466b041016b1ca03"}
May 27 00:08:43.648411 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.648393    2574 scope.go:117] "RemoveContainer" containerID="a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662"
May 27 00:08:43.655953 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.655935    2574 scope.go:117] "RemoveContainer" containerID="4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6"
May 27 00:08:43.663012 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.662991    2574 scope.go:117] "RemoveContainer" containerID="18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c"
May 27 00:08:43.663507 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.663484    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"]
May 27 00:08:43.668591 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.668565    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hc575"]
May 27 00:08:43.670138 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.670118    2574 scope.go:117] "RemoveContainer" containerID="67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81"
May 27 00:08:43.676351 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.676338    2574 scope.go:117] "RemoveContainer" containerID="1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6"
May 27 00:08:43.676586 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.676569    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6\": container with ID starting with 1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6 not found: ID does not exist" containerID="1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6"
May 27 00:08:43.676628 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.676592    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6"} err="failed to get container status \"1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6\": rpc error: code = NotFound desc = could not find container \"1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6\": container with ID starting with 1261c4fd0c6744009b55990d43f7add9f718a5855083eaa1d093c3e93dedc0f6 not found: ID does not exist"
May 27 00:08:43.676628 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.676610    2574 scope.go:117] "RemoveContainer" containerID="a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662"
May 27 00:08:43.676865 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.676837    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662\": container with ID starting with a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662 not found: ID does not exist" containerID="a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662"
May 27 00:08:43.676962 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.676869    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662"} err="failed to get container status \"a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662\": rpc error: code = NotFound desc = could not find container \"a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662\": container with ID starting with a4e06a1f2e8893670f49b9f44f1cec0b82a0eecd2c7242baca557bebb7424662 not found: ID does not exist"
May 27 00:08:43.676962 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.676886    2574 scope.go:117] "RemoveContainer" containerID="4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6"
May 27 00:08:43.677161 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.677124    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6\": container with ID starting with 4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6 not found: ID does not exist" containerID="4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6"
May 27 00:08:43.677394 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.677161    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6"} err="failed to get container status \"4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6\": rpc error: code = NotFound desc = could not find container \"4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6\": container with ID starting with 4c905f21376f18b2f9832e6221afff8b2ae353f099c42cfd184a2076b4dc5bc6 not found: ID does not exist"
May 27 00:08:43.677394 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.677190    2574 scope.go:117] "RemoveContainer" containerID="18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c"
May 27 00:08:43.677599 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.677573    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c\": container with ID starting with 18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c not found: ID does not exist" containerID="18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c"
May 27 00:08:43.677652 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.677594    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c"} err="failed to get container status \"18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c\": rpc error: code = NotFound desc = could not find container \"18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c\": container with ID starting with 18f72ee7790e3884664aaa32f89cf0fd0fcc7bc471a6c3d7496ceac97c308f6c not found: ID does not exist"
May 27 00:08:43.677652 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.677622    2574 scope.go:117] "RemoveContainer" containerID="67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81"
May 27 00:08:43.677880 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.677863    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81\": container with ID starting with 67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81 not found: ID does not exist" containerID="67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81"
May 27 00:08:43.677927 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.677883    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81"} err="failed to get container status \"67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81\": rpc error: code = NotFound desc = could not find container \"67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81\": container with ID starting with 67f688df667eafdf01fa36b571600ec68c1a9a08f55af7a0db46d20aadc3ed81 not found: ID does not exist"
May 27 00:08:43.677927 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.677896    2574 scope.go:117] "RemoveContainer" containerID="1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952"
May 27 00:08:43.678671 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.678653    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"]
May 27 00:08:43.681999 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.681969    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-7h8lh"]
May 27 00:08:43.684895 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.684878    2574 scope.go:117] "RemoveContainer" containerID="6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283"
May 27 00:08:43.691035 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.691015    2574 scope.go:117] "RemoveContainer" containerID="afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b"
May 27 00:08:43.701480 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.701463    2574 scope.go:117] "RemoveContainer" containerID="e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6"
May 27 00:08:43.709687 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.709657    2574 scope.go:117] "RemoveContainer" containerID="6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a"
May 27 00:08:43.715851 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.715836    2574 scope.go:117] "RemoveContainer" containerID="1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3"
May 27 00:08:43.722030 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.722012    2574 scope.go:117] "RemoveContainer" containerID="1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952"
May 27 00:08:43.722304 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.722287    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952\": container with ID starting with 1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952 not found: ID does not exist" containerID="1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952"
May 27 00:08:43.722357 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.722312    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952"} err="failed to get container status \"1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952\": rpc error: code = NotFound desc = could not find container \"1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952\": container with ID starting with 1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952 not found: ID does not exist"
May 27 00:08:43.722357 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.722329    2574 scope.go:117] "RemoveContainer" containerID="6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283"
May 27 00:08:43.722540 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.722526    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283\": container with ID starting with 6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283 not found: ID does not exist" containerID="6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283"
May 27 00:08:43.722585 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.722542    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283"} err="failed to get container status \"6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283\": rpc error: code = NotFound desc = could not find container \"6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283\": container with ID starting with 6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283 not found: ID does not exist"
May 27 00:08:43.722585 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.722553    2574 scope.go:117] "RemoveContainer" containerID="afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b"
May 27 00:08:43.722743 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.722729    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b\": container with ID starting with afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b not found: ID does not exist" containerID="afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b"
May 27 00:08:43.722779 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.722745    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b"} err="failed to get container status \"afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b\": rpc error: code = NotFound desc = could not find container \"afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b\": container with ID starting with afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b not found: ID does not exist"
May 27 00:08:43.722779 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.722757    2574 scope.go:117] "RemoveContainer" containerID="e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6"
May 27 00:08:43.722971 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.722953    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6\": container with ID starting with e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6 not found: ID does not exist" containerID="e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6"
May 27 00:08:43.723010 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.722977    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6"} err="failed to get container status \"e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6\": rpc error: code = NotFound desc = could not find container \"e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6\": container with ID starting with e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6 not found: ID does not exist"
May 27 00:08:43.723069 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.722992    2574 scope.go:117] "RemoveContainer" containerID="6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a"
May 27 00:08:43.723268 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.723243    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a\": container with ID starting with 6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a not found: ID does not exist" containerID="6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a"
May 27 00:08:43.723403 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.723268    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a"} err="failed to get container status \"6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a\": rpc error: code = NotFound desc = could not find container \"6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a\": container with ID starting with 6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a not found: ID does not exist"
May 27 00:08:43.723403 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.723288    2574 scope.go:117] "RemoveContainer" containerID="1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3"
May 27 00:08:43.723544 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:08:43.723527    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3\": container with ID starting with 1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3 not found: ID does not exist" containerID="1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3"
May 27 00:08:43.723584 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.723550    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3"} err="failed to get container status \"1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3\": rpc error: code = NotFound desc = could not find container \"1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3\": container with ID starting with 1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3 not found: ID does not exist"
May 27 00:08:43.723584 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.723566    2574 scope.go:117] "RemoveContainer" containerID="1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952"
May 27 00:08:43.723788 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.723771    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952"} err="failed to get container status \"1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952\": rpc error: code = NotFound desc = could not find container \"1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952\": container with ID starting with 1e40044cead8e75ed6c91b310dc361fffe7db081634d060f1401bee890562952 not found: ID does not exist"
May 27 00:08:43.723854 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.723791    2574 scope.go:117] "RemoveContainer" containerID="6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283"
May 27 00:08:43.724062 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.724026    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283"} err="failed to get container status \"6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283\": rpc error: code = NotFound desc = could not find container \"6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283\": container with ID starting with 6d2c651a7efbb1e8f77e3bc53ec4561b462e5cc4d8a602cc7c9561582b815283 not found: ID does not exist"
May 27 00:08:43.724117 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.724066    2574 scope.go:117] "RemoveContainer" containerID="afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b"
May 27 00:08:43.724307 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.724291    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b"} err="failed to get container status \"afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b\": rpc error: code = NotFound desc = could not find container \"afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b\": container with ID starting with afb42da1f1fe3badd4e9f9aabde5bdd671f78e8d32e98c6496643ee2d2e1ab5b not found: ID does not exist"
May 27 00:08:43.724307 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.724306    2574 scope.go:117] "RemoveContainer" containerID="e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6"
May 27 00:08:43.724575 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.724518    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6"} err="failed to get container status \"e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6\": rpc error: code = NotFound desc = could not find container \"e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6\": container with ID starting with e81aedb42008677a7b967810d2670aec4a84fbe55f6b9929871c11c17eb4f2e6 not found: ID does not exist"
May 27 00:08:43.724575 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.724538    2574 scope.go:117] "RemoveContainer" containerID="6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a"
May 27 00:08:43.724758 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.724735    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a"} err="failed to get container status \"6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a\": rpc error: code = NotFound desc = could not find container \"6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a\": container with ID starting with 6d66c4638b42fbabf9bfa90d7657f401d8c1a4303669f88b77a6169bf7c7dc8a not found: ID does not exist"
May 27 00:08:43.724758 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.724757    2574 scope.go:117] "RemoveContainer" containerID="1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3"
May 27 00:08:43.724980 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:43.724962    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3"} err="failed to get container status \"1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3\": rpc error: code = NotFound desc = could not find container \"1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3\": container with ID starting with 1acf0cf49c32106138209f5c8e0ba8f72dc0788ee75cccc4bffed7e5155ab8f3 not found: ID does not exist"
May 27 00:08:44.696421 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:44.696380    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" path="/var/lib/kubelet/pods/455addf0-feb5-4e2a-be05-f3e4d2977574/volumes"
May 27 00:08:44.697232 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:08:44.697210    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" path="/var/lib/kubelet/pods/fe3d38ae-6ad8-44c7-9050-ad0828b3d186/volumes"
May 27 00:09:01.274042 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.273999    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"]
May 27 00:09:01.274528 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.274304    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m" podUID="52274c76-b0d5-4653-acaa-4a3f9a88b97e" containerName="manager" containerID="cri-o://7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2" gracePeriod=10
May 27 00:09:01.511893 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.511866    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"
May 27 00:09:01.524584 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.524541    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z8s6\" (UniqueName: \"kubernetes.io/projected/52274c76-b0d5-4653-acaa-4a3f9a88b97e-kube-api-access-7z8s6\") pod \"52274c76-b0d5-4653-acaa-4a3f9a88b97e\" (UID: \"52274c76-b0d5-4653-acaa-4a3f9a88b97e\") "
May 27 00:09:01.526643 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.526602    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52274c76-b0d5-4653-acaa-4a3f9a88b97e-kube-api-access-7z8s6" (OuterVolumeSpecName: "kube-api-access-7z8s6") pod "52274c76-b0d5-4653-acaa-4a3f9a88b97e" (UID: "52274c76-b0d5-4653-acaa-4a3f9a88b97e"). InnerVolumeSpecName "kube-api-access-7z8s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 00:09:01.625774 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.625746    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z8s6\" (UniqueName: \"kubernetes.io/projected/52274c76-b0d5-4653-acaa-4a3f9a88b97e-kube-api-access-7z8s6\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:09:01.692399 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.692364    2574 generic.go:358] "Generic (PLEG): container finished" podID="52274c76-b0d5-4653-acaa-4a3f9a88b97e" containerID="7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2" exitCode=0
May 27 00:09:01.692505 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.692416    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m" event={"ID":"52274c76-b0d5-4653-acaa-4a3f9a88b97e","Type":"ContainerDied","Data":"7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2"}
May 27 00:09:01.692505 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.692442    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m" event={"ID":"52274c76-b0d5-4653-acaa-4a3f9a88b97e","Type":"ContainerDied","Data":"e841e64a0aba8572d5dc5a7599d74d290916d4939cad0810800be95dffe7c494"}
May 27 00:09:01.692505 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.692440    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"
May 27 00:09:01.692619 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.692453    2574 scope.go:117] "RemoveContainer" containerID="7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2"
May 27 00:09:01.701109 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.700957    2574 scope.go:117] "RemoveContainer" containerID="7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2"
May 27 00:09:01.701417 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:09:01.701388    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2\": container with ID starting with 7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2 not found: ID does not exist" containerID="7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2"
May 27 00:09:01.701500 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.701426    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2"} err="failed to get container status \"7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2\": rpc error: code = NotFound desc = could not find container \"7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2\": container with ID starting with 7f2741ee0137bef88f82021232758536a62debcb1d25391d3e0e413f495e0af2 not found: ID does not exist"
May 27 00:09:01.713005 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.712985    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"]
May 27 00:09:01.715923 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:01.715896    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lnf7m"]
May 27 00:09:02.695680 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:02.695649    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52274c76-b0d5-4653-acaa-4a3f9a88b97e" path="/var/lib/kubelet/pods/52274c76-b0d5-4653-acaa-4a3f9a88b97e/volumes"
May 27 00:09:05.514785 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.514749    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"]
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.514965    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="feast-apply"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.514975    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="feast-apply"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.514985    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="online"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.514991    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="online"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.514999    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="offline"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515005    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="offline"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515011    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="feast-apply"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515016    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="feast-apply"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515022    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="offline"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515027    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="offline"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515032    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="feast-init"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515037    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="feast-init"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515044    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="online"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515063    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="online"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515071    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="ui"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515076    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="ui"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515086    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52274c76-b0d5-4653-acaa-4a3f9a88b97e" containerName="manager"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515091    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="52274c76-b0d5-4653-acaa-4a3f9a88b97e" containerName="manager"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515098    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="ui"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515102    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="ui"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515110    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="registry"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515115    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="registry"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515122    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="feast-init"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515126    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="feast-init"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515164    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="offline"
May 27 00:09:05.515159 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515172    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="ui"
May 27 00:09:05.515901 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515177    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="online"
May 27 00:09:05.515901 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515183    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="offline"
May 27 00:09:05.515901 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515190    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="ui"
May 27 00:09:05.515901 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515195    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="52274c76-b0d5-4653-acaa-4a3f9a88b97e" containerName="manager"
May 27 00:09:05.515901 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515203    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="455addf0-feb5-4e2a-be05-f3e4d2977574" containerName="registry"
May 27 00:09:05.515901 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.515210    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe3d38ae-6ad8-44c7-9050-ad0828b3d186" containerName="online"
May 27 00:09:05.519424 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.519406    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"
May 27 00:09:05.521425 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.521407    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 27 00:09:05.522276 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.522260    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 27 00:09:05.522276 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.522268    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-j5lmh\""
May 27 00:09:05.523924 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.523897    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"]
May 27 00:09:05.551976 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.551948    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnl6f\" (UniqueName: \"kubernetes.io/projected/b5495db5-4812-424d-b9bd-0252aad37378-kube-api-access-jnl6f\") pod \"feast-operator-controller-manager-cf99db75-mvtkb\" (UID: \"b5495db5-4812-424d-b9bd-0252aad37378\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"
May 27 00:09:05.653026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.652986    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnl6f\" (UniqueName: \"kubernetes.io/projected/b5495db5-4812-424d-b9bd-0252aad37378-kube-api-access-jnl6f\") pod \"feast-operator-controller-manager-cf99db75-mvtkb\" (UID: \"b5495db5-4812-424d-b9bd-0252aad37378\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"
May 27 00:09:05.663390 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.663359    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnl6f\" (UniqueName: \"kubernetes.io/projected/b5495db5-4812-424d-b9bd-0252aad37378-kube-api-access-jnl6f\") pod \"feast-operator-controller-manager-cf99db75-mvtkb\" (UID: \"b5495db5-4812-424d-b9bd-0252aad37378\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"
May 27 00:09:05.829980 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.829899    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"
May 27 00:09:05.947909 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.947881    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"]
May 27 00:09:05.950138 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:09:05.950111    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5495db5_4812_424d_b9bd_0252aad37378.slice/crio-505b7bb0998b941c351892380b3ae9a657ac381fbd75766df4870c596eabc7f0 WatchSource:0}: Error finding container 505b7bb0998b941c351892380b3ae9a657ac381fbd75766df4870c596eabc7f0: Status 404 returned error can't find the container with id 505b7bb0998b941c351892380b3ae9a657ac381fbd75766df4870c596eabc7f0
May 27 00:09:05.951870 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:05.951853    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 00:09:06.708309 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:06.708276    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb" event={"ID":"b5495db5-4812-424d-b9bd-0252aad37378","Type":"ContainerStarted","Data":"caaa5e8ef47b3adfb779547cecf1e09066229d77ea568d4df65ea9e0c8bd035f"}
May 27 00:09:06.708309 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:06.708312    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb" event={"ID":"b5495db5-4812-424d-b9bd-0252aad37378","Type":"ContainerStarted","Data":"505b7bb0998b941c351892380b3ae9a657ac381fbd75766df4870c596eabc7f0"}
May 27 00:09:06.708705 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:06.708392    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"
May 27 00:09:06.723183 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:06.723142    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb" podStartSLOduration=1.7231304189999999 podStartE2EDuration="1.723130419s" podCreationTimestamp="2026-05-27 00:09:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 00:09:06.722569611 +0000 UTC m=+1542.618390370" watchObservedRunningTime="2026-05-27 00:09:06.723130419 +0000 UTC m=+1542.618951179"
May 27 00:09:17.713140 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:17.713111    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mvtkb"
May 27 00:09:25.377708 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.377670    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"]
May 27 00:09:25.382465 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.382446    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.384633 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.384605    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 27 00:09:25.384767 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.384695    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 27 00:09:25.384767 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.384734    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-64mtj\""
May 27 00:09:25.384877 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.384808    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 27 00:09:25.384877 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.384858    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 27 00:09:25.385085 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.385067    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 27 00:09:25.385140 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.385073    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 27 00:09:25.390611 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.390592    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"]
May 27 00:09:25.490290 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.490260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.490447 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.490306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.490447 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.490331    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7369bfda-107f-4854-a532-5e42d27182c2-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.490447 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.490407    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.490447 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.490441    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.490623 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.490486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2fjs\" (UniqueName: \"kubernetes.io/projected/7369bfda-107f-4854-a532-5e42d27182c2-kube-api-access-c2fjs\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.591561 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.591531    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.591561 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.591562    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7369bfda-107f-4854-a532-5e42d27182c2-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.591737 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.591582    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.591737 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.591697    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.591841 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.591759    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2fjs\" (UniqueName: \"kubernetes.io/projected/7369bfda-107f-4854-a532-5e42d27182c2-kube-api-access-c2fjs\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.591841 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.591797    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.591841 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:09:25.591828    2574 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 27 00:09:25.591988 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:09:25.591908    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-online-tls podName:7369bfda-107f-4854-a532-5e42d27182c2 nodeName:}" failed. No retries permitted until 2026-05-27 00:09:26.091886063 +0000 UTC m=+1561.987706802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-online-tls") pod "feast-simple-feast-setup-664fcfcc58-h66g5" (UID: "7369bfda-107f-4854-a532-5e42d27182c2") : secret "feast-simple-feast-setup-online-tls" not found
May 27 00:09:25.591988 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.591934    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7369bfda-107f-4854-a532-5e42d27182c2-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.594113 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.594090    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.594205 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.594149    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.594287 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.594269    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:25.599473 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:25.599454    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2fjs\" (UniqueName: \"kubernetes.io/projected/7369bfda-107f-4854-a532-5e42d27182c2-kube-api-access-c2fjs\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:26.096317 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:26.096285    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:26.098592 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:26.098573    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-h66g5\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:26.292755 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:26.292724    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:26.416430 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:26.416402    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"]
May 27 00:09:26.420318 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:09:26.420293    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7369bfda_107f_4854_a532_5e42d27182c2.slice/crio-03fe76b1068b65abea5b2e21e778076dfc126394f9b801f4113d517f235c56b0 WatchSource:0}: Error finding container 03fe76b1068b65abea5b2e21e778076dfc126394f9b801f4113d517f235c56b0: Status 404 returned error can't find the container with id 03fe76b1068b65abea5b2e21e778076dfc126394f9b801f4113d517f235c56b0
May 27 00:09:26.756707 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:26.756674    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerStarted","Data":"9ea28e624d5eb714ca1ae4ce36e4b2cd89134e3b0bfbf07ab7a0992a12904c57"}
May 27 00:09:26.756847 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:26.756717    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerStarted","Data":"03fe76b1068b65abea5b2e21e778076dfc126394f9b801f4113d517f235c56b0"}
May 27 00:09:31.771844 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:31.771809    2574 generic.go:358] "Generic (PLEG): container finished" podID="7369bfda-107f-4854-a532-5e42d27182c2" containerID="9ea28e624d5eb714ca1ae4ce36e4b2cd89134e3b0bfbf07ab7a0992a12904c57" exitCode=0
May 27 00:09:31.771844 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:31.771847    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerDied","Data":"9ea28e624d5eb714ca1ae4ce36e4b2cd89134e3b0bfbf07ab7a0992a12904c57"}
May 27 00:09:32.776133 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:32.776097    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerStarted","Data":"8254fcdca2be1b74000ff2d7e1e8028996fd8a06c6665db64bfb609727858d2f"}
May 27 00:09:37.792010 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:37.791975    2574 generic.go:358] "Generic (PLEG): container finished" podID="7369bfda-107f-4854-a532-5e42d27182c2" containerID="8254fcdca2be1b74000ff2d7e1e8028996fd8a06c6665db64bfb609727858d2f" exitCode=0
May 27 00:09:37.792375 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:37.792041    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerDied","Data":"8254fcdca2be1b74000ff2d7e1e8028996fd8a06c6665db64bfb609727858d2f"}
May 27 00:09:38.798274 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:38.798235    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerStarted","Data":"21d2e8abf0b0342e9e1c2a8857777e29299780049408d2ab988ce3e896035d2e"}
May 27 00:09:38.798761 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:38.798287    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerStarted","Data":"eba210648177bec375bd1ab529eff8f5aeb1298f7ba031cf405f18f3e6b93098"}
May 27 00:09:38.798761 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:38.798302    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerStarted","Data":"c14cf719f23441c2afa224652e4ac577151f9fcc0f64f23cafa87fc43588a4c6"}
May 27 00:09:38.798761 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:38.798315    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerStarted","Data":"0e3189ca87d351a49a7550870661b4f71474e084d53e99062227d8eac8eb629d"}
May 27 00:09:38.821384 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:38.821322    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podStartSLOduration=13.821301111 podStartE2EDuration="13.821301111s" podCreationTimestamp="2026-05-27 00:09:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 00:09:38.820792723 +0000 UTC m=+1574.716613486" watchObservedRunningTime="2026-05-27 00:09:38.821301111 +0000 UTC m=+1574.717121872"
May 27 00:09:41.293277 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:41.293221    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:41.293805 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:41.293778    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:41.293955 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:41.293825    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:41.293955 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:41.293839    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:41.295212 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:41.295174    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused"
May 27 00:09:41.295312 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:41.295195    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused"
May 27 00:09:41.295371 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:41.295316    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 27 00:09:41.295371 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:41.295339    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 27 00:09:44.294400 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.294367    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.294766 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.294488    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.294766 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.294675    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.295114 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.295041    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.295237 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.295124    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.295237 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.295139    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.295340 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.295248    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.295340 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.295304    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.295616 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.295600    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.298767 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.298751    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.817660 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.817628    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:09:44.820600 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:09:44.820579    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:10:47.582311 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:47.582275    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"]
May 27 00:10:47.582759 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:47.582613    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="registry" containerID="cri-o://0e3189ca87d351a49a7550870661b4f71474e084d53e99062227d8eac8eb629d" gracePeriod=30
May 27 00:10:47.582759 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:47.582640    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="ui" containerID="cri-o://21d2e8abf0b0342e9e1c2a8857777e29299780049408d2ab988ce3e896035d2e" gracePeriod=30
May 27 00:10:47.582759 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:47.582670    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="offline" containerID="cri-o://eba210648177bec375bd1ab529eff8f5aeb1298f7ba031cf405f18f3e6b93098" gracePeriod=30
May 27 00:10:47.582921 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:47.582666    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="online" containerID="cri-o://c14cf719f23441c2afa224652e4ac577151f9fcc0f64f23cafa87fc43588a4c6" gracePeriod=30
May 27 00:10:47.990776 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:47.990748    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"]
May 27 00:10:47.994638 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:47.994614    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:47.997217 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:47.997197    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gvcvb\""
May 27 00:10:48.005590 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.005568    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"]
May 27 00:10:48.170284 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.170244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.170284 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.170285    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.170488 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.170310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5hp8\" (UniqueName: \"kubernetes.io/projected/047ba489-652d-45f3-9329-632f052adb42-kube-api-access-k5hp8\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.170488 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.170387    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.170488 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.170413    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/047ba489-652d-45f3-9329-632f052adb42-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.170488 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.170463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.271685 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.271655    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.271811 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.271693    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.271811 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.271722    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.271811 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.271762    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5hp8\" (UniqueName: \"kubernetes.io/projected/047ba489-652d-45f3-9329-632f052adb42-kube-api-access-k5hp8\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.271940 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.271815    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.271940 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.271840    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/047ba489-652d-45f3-9329-632f052adb42-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.272276 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.272257    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/047ba489-652d-45f3-9329-632f052adb42-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.274387 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.274363    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.274481 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.274458    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.274582 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.274558    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.274622 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.274582    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.279389 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.279368    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5hp8\" (UniqueName: \"kubernetes.io/projected/047ba489-652d-45f3-9329-632f052adb42-kube-api-access-k5hp8\") pod \"feast-simple-feast-setup-664fcfcc58-sbz6p\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.311230 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.311211    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:10:48.437504 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.437474    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"]
May 27 00:10:48.439683 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:10:48.439657    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod047ba489_652d_45f3_9329_632f052adb42.slice/crio-083ed56f83092c2137c04876b967b4c5cb99fb46ade762c8a14a2f04689e5a75 WatchSource:0}: Error finding container 083ed56f83092c2137c04876b967b4c5cb99fb46ade762c8a14a2f04689e5a75: Status 404 returned error can't find the container with id 083ed56f83092c2137c04876b967b4c5cb99fb46ade762c8a14a2f04689e5a75
May 27 00:10:48.992827 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.992795    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerStarted","Data":"3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd"}
May 27 00:10:48.993321 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.993294    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerStarted","Data":"083ed56f83092c2137c04876b967b4c5cb99fb46ade762c8a14a2f04689e5a75"}
May 27 00:10:48.995757 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.995725    2574 generic.go:358] "Generic (PLEG): container finished" podID="7369bfda-107f-4854-a532-5e42d27182c2" containerID="21d2e8abf0b0342e9e1c2a8857777e29299780049408d2ab988ce3e896035d2e" exitCode=0
May 27 00:10:48.995757 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.995746    2574 generic.go:358] "Generic (PLEG): container finished" podID="7369bfda-107f-4854-a532-5e42d27182c2" containerID="c14cf719f23441c2afa224652e4ac577151f9fcc0f64f23cafa87fc43588a4c6" exitCode=0
May 27 00:10:48.995910 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.995802    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerDied","Data":"21d2e8abf0b0342e9e1c2a8857777e29299780049408d2ab988ce3e896035d2e"}
May 27 00:10:48.995910 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:48.995843    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerDied","Data":"c14cf719f23441c2afa224652e4ac577151f9fcc0f64f23cafa87fc43588a4c6"}
May 27 00:10:53.007958 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:53.007930    2574 generic.go:358] "Generic (PLEG): container finished" podID="047ba489-652d-45f3-9329-632f052adb42" containerID="3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd" exitCode=0
May 27 00:10:53.008277 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:53.007985    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerDied","Data":"3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd"}
May 27 00:10:54.012171 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:54.012140    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerStarted","Data":"3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687"}
May 27 00:10:54.296131 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:54.296017    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 27 00:10:54.818668 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:54.818628    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 27 00:10:59.025190 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:59.025148    2574 generic.go:358] "Generic (PLEG): container finished" podID="047ba489-652d-45f3-9329-632f052adb42" containerID="3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687" exitCode=0
May 27 00:10:59.025546 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:10:59.025222    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerDied","Data":"3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687"}
May 27 00:11:00.031846 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.031802    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerStarted","Data":"e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca"}
May 27 00:11:00.032432 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.031857    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerStarted","Data":"e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4"}
May 27 00:11:00.032432 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.031875    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerStarted","Data":"e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032"}
May 27 00:11:00.032432 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.031889    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerStarted","Data":"cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a"}
May 27 00:11:00.054341 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.054281    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podStartSLOduration=13.054260376 podStartE2EDuration="13.054260376s" podCreationTimestamp="2026-05-27 00:10:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 00:11:00.052414279 +0000 UTC m=+1655.948235040" watchObservedRunningTime="2026-05-27 00:11:00.054260376 +0000 UTC m=+1655.950081135"
May 27 00:11:00.311915 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.311806    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:00.311915 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.311856    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:00.311915 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.311871    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:00.311915 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.311885    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:00.313989 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.313945    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
May 27 00:11:00.313989 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.313968    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 27 00:11:00.314229 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.314039    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
May 27 00:11:00.314229 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:00.314092    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 27 00:11:03.311689 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:03.311642    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
May 27 00:11:03.312314 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:03.311641    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 27 00:11:03.312456 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:03.311656    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 27 00:11:03.312456 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:03.311672    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
May 27 00:11:04.296010 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:04.295954    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 27 00:11:04.818475 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:04.818435    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 27 00:11:06.312404 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.312368    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:06.312826 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.312517    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:06.312826 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.312751    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:06.313181 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.313149    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:06.313318 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.313190    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:06.313318 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.313202    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:06.313563 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.313542    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:06.313657 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.313600    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:06.314170 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.314156    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:06.316915 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:06.316897    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:07.056980 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:07.056942    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:07.059973 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:07.059948    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:11:14.295272 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:14.295223    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 27 00:11:14.295746 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:14.295346    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:11:14.817823 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:14.817787    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 27 00:11:14.817997 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:14.817895    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:11:18.089912 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.089878    2574 generic.go:358] "Generic (PLEG): container finished" podID="7369bfda-107f-4854-a532-5e42d27182c2" containerID="eba210648177bec375bd1ab529eff8f5aeb1298f7ba031cf405f18f3e6b93098" exitCode=137
May 27 00:11:18.089912 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.089906    2574 generic.go:358] "Generic (PLEG): container finished" podID="7369bfda-107f-4854-a532-5e42d27182c2" containerID="0e3189ca87d351a49a7550870661b4f71474e084d53e99062227d8eac8eb629d" exitCode=137
May 27 00:11:18.090363 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.089956    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerDied","Data":"eba210648177bec375bd1ab529eff8f5aeb1298f7ba031cf405f18f3e6b93098"}
May 27 00:11:18.090363 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.089988    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerDied","Data":"0e3189ca87d351a49a7550870661b4f71474e084d53e99062227d8eac8eb629d"}
May 27 00:11:18.236939 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.236917    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:11:18.324442 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.324412    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-ui-tls\") pod \"7369bfda-107f-4854-a532-5e42d27182c2\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") "
May 27 00:11:18.324570 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.324449    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-offline-tls\") pod \"7369bfda-107f-4854-a532-5e42d27182c2\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") "
May 27 00:11:18.324570 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.324464    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-online-tls\") pod \"7369bfda-107f-4854-a532-5e42d27182c2\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") "
May 27 00:11:18.324570 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.324482    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-registry-tls\") pod \"7369bfda-107f-4854-a532-5e42d27182c2\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") "
May 27 00:11:18.324570 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.324507    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2fjs\" (UniqueName: \"kubernetes.io/projected/7369bfda-107f-4854-a532-5e42d27182c2-kube-api-access-c2fjs\") pod \"7369bfda-107f-4854-a532-5e42d27182c2\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") "
May 27 00:11:18.324570 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.324534    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7369bfda-107f-4854-a532-5e42d27182c2-feast-data\") pod \"7369bfda-107f-4854-a532-5e42d27182c2\" (UID: \"7369bfda-107f-4854-a532-5e42d27182c2\") "
May 27 00:11:18.325135 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.325097    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7369bfda-107f-4854-a532-5e42d27182c2-feast-data" (OuterVolumeSpecName: "feast-data") pod "7369bfda-107f-4854-a532-5e42d27182c2" (UID: "7369bfda-107f-4854-a532-5e42d27182c2"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 00:11:18.326712 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.326689    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7369bfda-107f-4854-a532-5e42d27182c2" (UID: "7369bfda-107f-4854-a532-5e42d27182c2"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:11:18.326992 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.326965    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7369bfda-107f-4854-a532-5e42d27182c2" (UID: "7369bfda-107f-4854-a532-5e42d27182c2"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:11:18.327133 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.327003    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7369bfda-107f-4854-a532-5e42d27182c2-kube-api-access-c2fjs" (OuterVolumeSpecName: "kube-api-access-c2fjs") pod "7369bfda-107f-4854-a532-5e42d27182c2" (UID: "7369bfda-107f-4854-a532-5e42d27182c2"). InnerVolumeSpecName "kube-api-access-c2fjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 00:11:18.327133 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.327081    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-online-tls" (OuterVolumeSpecName: "online-tls") pod "7369bfda-107f-4854-a532-5e42d27182c2" (UID: "7369bfda-107f-4854-a532-5e42d27182c2"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:11:18.327220 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.327143    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7369bfda-107f-4854-a532-5e42d27182c2" (UID: "7369bfda-107f-4854-a532-5e42d27182c2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:11:18.425878 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.425814    2574 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-ui-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:11:18.425878 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.425838    2574 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-offline-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:11:18.425878 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.425852    2574 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-online-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:11:18.425878 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.425863    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7369bfda-107f-4854-a532-5e42d27182c2-registry-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:11:18.425878 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.425876    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2fjs\" (UniqueName: \"kubernetes.io/projected/7369bfda-107f-4854-a532-5e42d27182c2-kube-api-access-c2fjs\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:11:18.426122 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:18.425889    2574 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7369bfda-107f-4854-a532-5e42d27182c2-feast-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:11:19.095562 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.095530    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5" event={"ID":"7369bfda-107f-4854-a532-5e42d27182c2","Type":"ContainerDied","Data":"03fe76b1068b65abea5b2e21e778076dfc126394f9b801f4113d517f235c56b0"}
May 27 00:11:19.095944 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.095574    2574 scope.go:117] "RemoveContainer" containerID="21d2e8abf0b0342e9e1c2a8857777e29299780049408d2ab988ce3e896035d2e"
May 27 00:11:19.095944 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.095607    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"
May 27 00:11:19.103579 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.103562    2574 scope.go:117] "RemoveContainer" containerID="eba210648177bec375bd1ab529eff8f5aeb1298f7ba031cf405f18f3e6b93098"
May 27 00:11:19.110173 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.110159    2574 scope.go:117] "RemoveContainer" containerID="c14cf719f23441c2afa224652e4ac577151f9fcc0f64f23cafa87fc43588a4c6"
May 27 00:11:19.112916 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.112891    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"]
May 27 00:11:19.116834 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.116816    2574 scope.go:117] "RemoveContainer" containerID="0e3189ca87d351a49a7550870661b4f71474e084d53e99062227d8eac8eb629d"
May 27 00:11:19.118307 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.118285    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-h66g5"]
May 27 00:11:19.123566 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.123551    2574 scope.go:117] "RemoveContainer" containerID="8254fcdca2be1b74000ff2d7e1e8028996fd8a06c6665db64bfb609727858d2f"
May 27 00:11:19.131861 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:19.131157    2574 scope.go:117] "RemoveContainer" containerID="9ea28e624d5eb714ca1ae4ce36e4b2cd89134e3b0bfbf07ab7a0992a12904c57"
May 27 00:11:20.696770 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:11:20.696737    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7369bfda-107f-4854-a532-5e42d27182c2" path="/var/lib/kubelet/pods/7369bfda-107f-4854-a532-5e42d27182c2/volumes"
May 27 00:12:09.380238 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380202    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"]
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380449    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="registry"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380463    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="registry"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380478    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="online"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380483    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="online"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380495    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="feast-apply"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380501    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="feast-apply"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380507    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="ui"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380512    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="ui"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380522    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="offline"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380528    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="offline"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380541    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="feast-init"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380546    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="feast-init"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380586    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="ui"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380595    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="registry"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380601    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="online"
May 27 00:12:09.380666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.380614    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="7369bfda-107f-4854-a532-5e42d27182c2" containerName="offline"
May 27 00:12:09.383731 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.383715    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.385852 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.385820    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-7gng4\""
May 27 00:12:09.386212 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.386175    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 27 00:12:09.386331 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.386223    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 27 00:12:09.386837 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.386806    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 27 00:12:09.387976 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.387209    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 27 00:12:09.387976 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.387506    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 27 00:12:09.387976 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.387906    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 27 00:12:09.395244 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.395221    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"]
May 27 00:12:09.583642 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.583608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.583642 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.583648    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.583863 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.583668    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7z54\" (UniqueName: \"kubernetes.io/projected/0351de9a-df0d-4303-abd6-e75cecbe37b6-kube-api-access-w7z54\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.583863 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.583685    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.583863 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.583701    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0351de9a-df0d-4303-abd6-e75cecbe37b6-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.583863 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.583781    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0351de9a-df0d-4303-abd6-e75cecbe37b6-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.684578 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.684517    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.684578 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.684552    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.684578 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.684573    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7z54\" (UniqueName: \"kubernetes.io/projected/0351de9a-df0d-4303-abd6-e75cecbe37b6-kube-api-access-w7z54\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.684763 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:12:09.684667    2574 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 27 00:12:09.684763 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.684688    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.684763 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.684721    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0351de9a-df0d-4303-abd6-e75cecbe37b6-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.684763 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:12:09.684743    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-online-tls podName:0351de9a-df0d-4303-abd6-e75cecbe37b6 nodeName:}" failed. No retries permitted until 2026-05-27 00:12:10.184722576 +0000 UTC m=+1726.080543333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-8ckq5" (UID: "0351de9a-df0d-4303-abd6-e75cecbe37b6") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 27 00:12:09.684971 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.684792    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0351de9a-df0d-4303-abd6-e75cecbe37b6-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.685169 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.685141    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0351de9a-df0d-4303-abd6-e75cecbe37b6-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.685374 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.685358    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0351de9a-df0d-4303-abd6-e75cecbe37b6-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.687062 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.687026    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.687062 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.687039    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:09.695513 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:09.695488    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7z54\" (UniqueName: \"kubernetes.io/projected/0351de9a-df0d-4303-abd6-e75cecbe37b6-kube-api-access-w7z54\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:10.188122 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:10.188084    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:10.190376 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:10.190355    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-8ckq5\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:10.293812 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:10.293786    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:10.418734 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:10.418708    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"]
May 27 00:12:10.420426 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:12:10.420399    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0351de9a_df0d_4303_abd6_e75cecbe37b6.slice/crio-cc2b5a553f5fac840bdb1ffdb6551c341a58936a3bac0e3f554454e767e49a7d WatchSource:0}: Error finding container cc2b5a553f5fac840bdb1ffdb6551c341a58936a3bac0e3f554454e767e49a7d: Status 404 returned error can't find the container with id cc2b5a553f5fac840bdb1ffdb6551c341a58936a3bac0e3f554454e767e49a7d
May 27 00:12:11.230752 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:11.230719    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerStarted","Data":"069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925"}
May 27 00:12:11.230752 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:11.230754    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerStarted","Data":"cc2b5a553f5fac840bdb1ffdb6551c341a58936a3bac0e3f554454e767e49a7d"}
May 27 00:12:15.245376 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:15.245290    2574 generic.go:358] "Generic (PLEG): container finished" podID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerID="069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925" exitCode=0
May 27 00:12:15.245376 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:15.245341    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerDied","Data":"069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925"}
May 27 00:12:16.249439 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:16.249399    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerStarted","Data":"85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41"}
May 27 00:12:21.265244 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:21.265209    2574 generic.go:358] "Generic (PLEG): container finished" podID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerID="85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41" exitCode=0
May 27 00:12:21.265574 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:21.265281    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerDied","Data":"85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41"}
May 27 00:12:22.271229 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.271191    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerStarted","Data":"f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4"}
May 27 00:12:22.271592 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.271239    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerStarted","Data":"19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5"}
May 27 00:12:22.271592 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.271255    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerStarted","Data":"ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a"}
May 27 00:12:22.294066 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.293992    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podStartSLOduration=13.29397546 podStartE2EDuration="13.29397546s" podCreationTimestamp="2026-05-27 00:12:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 00:12:22.291599264 +0000 UTC m=+1738.187420026" watchObservedRunningTime="2026-05-27 00:12:22.29397546 +0000 UTC m=+1738.189796221"
May 27 00:12:22.294215 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.294032    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:22.294215 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.294164    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:22.294215 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.294179    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:22.295997 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.295972    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
May 27 00:12:22.296130 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.296012    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 27 00:12:22.296130 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:22.296009    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 27 00:12:25.294643 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:25.294597    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
May 27 00:12:25.294643 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:25.294618    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 27 00:12:25.295173 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:25.294678    2574 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 27 00:12:28.295307 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:28.295277    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:28.295812 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:28.295363    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:28.295812 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:28.295684    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:28.295812 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:28.295714    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:28.295985 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:28.295928    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:28.296083 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:28.296066    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:28.299406 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:28.299392    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:29.291666 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:29.291633    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:12:29.294488 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:12:29.294461    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:13:24.708953 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:24.708925    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 27 00:13:24.712117 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:24.712094    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 27 00:13:30.660166 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:30.660131    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"]
May 27 00:13:30.660613 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:30.660541    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="online" containerID="cri-o://ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a" gracePeriod=30
May 27 00:13:30.661321 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:30.660959    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="ui" containerID="cri-o://f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4" gracePeriod=30
May 27 00:13:30.661321 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:30.661073    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="offline" containerID="cri-o://19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5" gracePeriod=30
May 27 00:13:30.807946 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:30.807912    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"]
May 27 00:13:30.808551 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:30.808374    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="registry" containerID="cri-o://cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a" gracePeriod=30
May 27 00:13:30.808551 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:30.808410    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="offline" containerID="cri-o://e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4" gracePeriod=30
May 27 00:13:30.808551 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:30.808455    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="online" containerID="cri-o://e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032" gracePeriod=30
May 27 00:13:30.808551 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:30.808526    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="ui" containerID="cri-o://e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca" gracePeriod=30
May 27 00:13:31.458604 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:31.458576    2574 generic.go:358] "Generic (PLEG): container finished" podID="047ba489-652d-45f3-9329-632f052adb42" containerID="e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca" exitCode=0
May 27 00:13:31.458710 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:31.458654    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerDied","Data":"e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca"}
May 27 00:13:31.460857 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:31.460837    2574 generic.go:358] "Generic (PLEG): container finished" podID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerID="f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4" exitCode=0
May 27 00:13:31.460857 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:31.460856    2574 generic.go:358] "Generic (PLEG): container finished" podID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerID="ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a" exitCode=0
May 27 00:13:31.460990 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:31.460888    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerDied","Data":"f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4"}
May 27 00:13:31.460990 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:31.460914    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerDied","Data":"ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a"}
May 27 00:13:32.465527 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:32.465497    2574 generic.go:358] "Generic (PLEG): container finished" podID="047ba489-652d-45f3-9329-632f052adb42" containerID="e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032" exitCode=0
May 27 00:13:32.465882 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:32.465542    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerDied","Data":"e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032"}
May 27 00:13:36.314203 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:36.314151    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 27 00:13:37.057423 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:37.057380    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 27 00:13:38.296366 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:38.296323    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 27 00:13:39.292444 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:39.292404    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 27 00:13:46.313874 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:46.313826    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 27 00:13:47.057876 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:47.057833    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 27 00:13:48.296438 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:48.296388    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 27 00:13:49.291855 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:49.291810    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 27 00:13:56.313335 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:56.313286    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 27 00:13:56.313817 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:56.313431    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:13:57.057763 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:57.057718    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 27 00:13:57.057942 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:57.057849    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:13:58.296371 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:58.296306    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 27 00:13:58.296762 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:58.296487    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:13:59.292325 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:59.292278    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 27 00:13:59.292505 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:13:59.292405    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:14:00.833350 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.833327    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:14:00.871254 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.871226    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0351de9a-df0d-4303-abd6-e75cecbe37b6-registry-tls\") pod \"0351de9a-df0d-4303-abd6-e75cecbe37b6\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") "
May 27 00:14:00.871406 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.871271    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7z54\" (UniqueName: \"kubernetes.io/projected/0351de9a-df0d-4303-abd6-e75cecbe37b6-kube-api-access-w7z54\") pod \"0351de9a-df0d-4303-abd6-e75cecbe37b6\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") "
May 27 00:14:00.871406 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.871318    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-offline-tls\") pod \"0351de9a-df0d-4303-abd6-e75cecbe37b6\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") "
May 27 00:14:00.871406 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.871348    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0351de9a-df0d-4303-abd6-e75cecbe37b6-feast-data\") pod \"0351de9a-df0d-4303-abd6-e75cecbe37b6\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") "
May 27 00:14:00.871406 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.871378    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-ui-tls\") pod \"0351de9a-df0d-4303-abd6-e75cecbe37b6\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") "
May 27 00:14:00.871406 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.871402    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-online-tls\") pod \"0351de9a-df0d-4303-abd6-e75cecbe37b6\" (UID: \"0351de9a-df0d-4303-abd6-e75cecbe37b6\") "
May 27 00:14:00.871653 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.871633    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0351de9a-df0d-4303-abd6-e75cecbe37b6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0351de9a-df0d-4303-abd6-e75cecbe37b6" (UID: "0351de9a-df0d-4303-abd6-e75cecbe37b6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 00:14:00.872155 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.872093    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0351de9a-df0d-4303-abd6-e75cecbe37b6-feast-data" (OuterVolumeSpecName: "feast-data") pod "0351de9a-df0d-4303-abd6-e75cecbe37b6" (UID: "0351de9a-df0d-4303-abd6-e75cecbe37b6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 00:14:00.873592 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.873556    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0351de9a-df0d-4303-abd6-e75cecbe37b6-kube-api-access-w7z54" (OuterVolumeSpecName: "kube-api-access-w7z54") pod "0351de9a-df0d-4303-abd6-e75cecbe37b6" (UID: "0351de9a-df0d-4303-abd6-e75cecbe37b6"). InnerVolumeSpecName "kube-api-access-w7z54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 00:14:00.873973 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.873946    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0351de9a-df0d-4303-abd6-e75cecbe37b6" (UID: "0351de9a-df0d-4303-abd6-e75cecbe37b6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:14:00.874102 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.874024    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0351de9a-df0d-4303-abd6-e75cecbe37b6" (UID: "0351de9a-df0d-4303-abd6-e75cecbe37b6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:14:00.874102 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.874061    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-online-tls" (OuterVolumeSpecName: "online-tls") pod "0351de9a-df0d-4303-abd6-e75cecbe37b6" (UID: "0351de9a-df0d-4303-abd6-e75cecbe37b6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:14:00.972961 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.972874    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7z54\" (UniqueName: \"kubernetes.io/projected/0351de9a-df0d-4303-abd6-e75cecbe37b6-kube-api-access-w7z54\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:00.972961 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.972902    2574 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-offline-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:00.972961 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.972913    2574 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0351de9a-df0d-4303-abd6-e75cecbe37b6-feast-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:00.972961 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.972922    2574 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-ui-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:00.972961 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.972932    2574 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0351de9a-df0d-4303-abd6-e75cecbe37b6-online-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:00.972961 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:00.972941    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0351de9a-df0d-4303-abd6-e75cecbe37b6-registry-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:01.454450 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.454430    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:14:01.475851 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.475831    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-online-tls\") pod \"047ba489-652d-45f3-9329-632f052adb42\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") "
May 27 00:14:01.475948 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.475863    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-registry-tls\") pod \"047ba489-652d-45f3-9329-632f052adb42\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") "
May 27 00:14:01.475948 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.475889    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/047ba489-652d-45f3-9329-632f052adb42-feast-data\") pod \"047ba489-652d-45f3-9329-632f052adb42\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") "
May 27 00:14:01.475948 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.475908    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-ui-tls\") pod \"047ba489-652d-45f3-9329-632f052adb42\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") "
May 27 00:14:01.475948 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.475924    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-offline-tls\") pod \"047ba489-652d-45f3-9329-632f052adb42\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") "
May 27 00:14:01.475948 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.475947    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5hp8\" (UniqueName: \"kubernetes.io/projected/047ba489-652d-45f3-9329-632f052adb42-kube-api-access-k5hp8\") pod \"047ba489-652d-45f3-9329-632f052adb42\" (UID: \"047ba489-652d-45f3-9329-632f052adb42\") "
May 27 00:14:01.476627 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.476602    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047ba489-652d-45f3-9329-632f052adb42-feast-data" (OuterVolumeSpecName: "feast-data") pod "047ba489-652d-45f3-9329-632f052adb42" (UID: "047ba489-652d-45f3-9329-632f052adb42"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 00:14:01.478834 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.478798    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "047ba489-652d-45f3-9329-632f052adb42" (UID: "047ba489-652d-45f3-9329-632f052adb42"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:14:01.479194 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.478853    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/047ba489-652d-45f3-9329-632f052adb42-kube-api-access-k5hp8" (OuterVolumeSpecName: "kube-api-access-k5hp8") pod "047ba489-652d-45f3-9329-632f052adb42" (UID: "047ba489-652d-45f3-9329-632f052adb42"). InnerVolumeSpecName "kube-api-access-k5hp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 00:14:01.479194 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.479041    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-online-tls" (OuterVolumeSpecName: "online-tls") pod "047ba489-652d-45f3-9329-632f052adb42" (UID: "047ba489-652d-45f3-9329-632f052adb42"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:14:01.479194 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.479112    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "047ba489-652d-45f3-9329-632f052adb42" (UID: "047ba489-652d-45f3-9329-632f052adb42"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:14:01.479948 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.479919    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "047ba489-652d-45f3-9329-632f052adb42" (UID: "047ba489-652d-45f3-9329-632f052adb42"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 00:14:01.540905 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.540875    2574 generic.go:358] "Generic (PLEG): container finished" podID="047ba489-652d-45f3-9329-632f052adb42" containerID="e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4" exitCode=137
May 27 00:14:01.540905 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.540900    2574 generic.go:358] "Generic (PLEG): container finished" podID="047ba489-652d-45f3-9329-632f052adb42" containerID="cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a" exitCode=137
May 27 00:14:01.541160 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.540950    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"
May 27 00:14:01.541160 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.540947    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerDied","Data":"e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4"}
May 27 00:14:01.541160 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.541079    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerDied","Data":"cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a"}
May 27 00:14:01.541160 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.541097    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p" event={"ID":"047ba489-652d-45f3-9329-632f052adb42","Type":"ContainerDied","Data":"083ed56f83092c2137c04876b967b4c5cb99fb46ade762c8a14a2f04689e5a75"}
May 27 00:14:01.541160 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.541118    2574 scope.go:117] "RemoveContainer" containerID="e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca"
May 27 00:14:01.543459 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.543436    2574 generic.go:358] "Generic (PLEG): container finished" podID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerID="19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5" exitCode=137
May 27 00:14:01.543587 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.543481    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerDied","Data":"19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5"}
May 27 00:14:01.543587 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.543507    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5" event={"ID":"0351de9a-df0d-4303-abd6-e75cecbe37b6","Type":"ContainerDied","Data":"cc2b5a553f5fac840bdb1ffdb6551c341a58936a3bac0e3f554454e767e49a7d"}
May 27 00:14:01.543587 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.543519    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"
May 27 00:14:01.555253 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.555229    2574 scope.go:117] "RemoveContainer" containerID="e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4"
May 27 00:14:01.564229 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.564215    2574 scope.go:117] "RemoveContainer" containerID="e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032"
May 27 00:14:01.568898 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.568875    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"]
May 27 00:14:01.572547 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.572529    2574 scope.go:117] "RemoveContainer" containerID="cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a"
May 27 00:14:01.572913 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.572892    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-sbz6p"]
May 27 00:14:01.576990 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.576933    2574 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-online-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:01.576990 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.576955    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-registry-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:01.576990 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.576964    2574 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/047ba489-652d-45f3-9329-632f052adb42-feast-data\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:01.576990 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.576973    2574 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-ui-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:01.576990 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.576980    2574 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/047ba489-652d-45f3-9329-632f052adb42-offline-tls\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:01.576990 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.576989    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5hp8\" (UniqueName: \"kubernetes.io/projected/047ba489-652d-45f3-9329-632f052adb42-kube-api-access-k5hp8\") on node \"ip-10-0-136-0.ec2.internal\" DevicePath \"\""
May 27 00:14:01.579421 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.579405    2574 scope.go:117] "RemoveContainer" containerID="3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687"
May 27 00:14:01.583127 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.583106    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"]
May 27 00:14:01.586365 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.586343    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-8ckq5"]
May 27 00:14:01.586925 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.586908    2574 scope.go:117] "RemoveContainer" containerID="3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd"
May 27 00:14:01.593668 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.593652    2574 scope.go:117] "RemoveContainer" containerID="e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca"
May 27 00:14:01.593900 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.593882    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca\": container with ID starting with e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca not found: ID does not exist" containerID="e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca"
May 27 00:14:01.593955 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.593906    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca"} err="failed to get container status \"e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca\": rpc error: code = NotFound desc = could not find container \"e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca\": container with ID starting with e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca not found: ID does not exist"
May 27 00:14:01.593955 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.593924    2574 scope.go:117] "RemoveContainer" containerID="e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4"
May 27 00:14:01.594147 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.594130    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4\": container with ID starting with e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4 not found: ID does not exist" containerID="e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4"
May 27 00:14:01.594192 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594151    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4"} err="failed to get container status \"e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4\": rpc error: code = NotFound desc = could not find container \"e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4\": container with ID starting with e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4 not found: ID does not exist"
May 27 00:14:01.594192 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594165    2574 scope.go:117] "RemoveContainer" containerID="e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032"
May 27 00:14:01.594345 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.594330    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032\": container with ID starting with e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032 not found: ID does not exist" containerID="e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032"
May 27 00:14:01.594383 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594348    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032"} err="failed to get container status \"e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032\": rpc error: code = NotFound desc = could not find container \"e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032\": container with ID starting with e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032 not found: ID does not exist"
May 27 00:14:01.594383 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594359    2574 scope.go:117] "RemoveContainer" containerID="cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a"
May 27 00:14:01.594568 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.594551    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a\": container with ID starting with cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a not found: ID does not exist" containerID="cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a"
May 27 00:14:01.594603 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594574    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a"} err="failed to get container status \"cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a\": rpc error: code = NotFound desc = could not find container \"cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a\": container with ID starting with cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a not found: ID does not exist"
May 27 00:14:01.594603 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594591    2574 scope.go:117] "RemoveContainer" containerID="3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687"
May 27 00:14:01.594765 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.594751    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687\": container with ID starting with 3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687 not found: ID does not exist" containerID="3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687"
May 27 00:14:01.594801 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594769    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687"} err="failed to get container status \"3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687\": rpc error: code = NotFound desc = could not find container \"3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687\": container with ID starting with 3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687 not found: ID does not exist"
May 27 00:14:01.594801 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594781    2574 scope.go:117] "RemoveContainer" containerID="3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd"
May 27 00:14:01.594969 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.594954    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd\": container with ID starting with 3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd not found: ID does not exist" containerID="3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd"
May 27 00:14:01.595004 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594973    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd"} err="failed to get container status \"3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd\": rpc error: code = NotFound desc = could not find container \"3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd\": container with ID starting with 3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd not found: ID does not exist"
May 27 00:14:01.595004 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.594986    2574 scope.go:117] "RemoveContainer" containerID="e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca"
May 27 00:14:01.595174 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.595158    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca"} err="failed to get container status \"e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca\": rpc error: code = NotFound desc = could not find container \"e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca\": container with ID starting with e315bedfcb0360db7d9e05824379c3bb8a56d3358c30555edaecf1454d1a9cca not found: ID does not exist"
May 27 00:14:01.595220 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.595174    2574 scope.go:117] "RemoveContainer" containerID="e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4"
May 27 00:14:01.595412 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.595395    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4"} err="failed to get container status \"e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4\": rpc error: code = NotFound desc = could not find container \"e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4\": container with ID starting with e54dc0a4484bc258b584b5a1d76410bd9a635c8f5dc083578274f78ff9185fa4 not found: ID does not exist"
May 27 00:14:01.595451 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.595413    2574 scope.go:117] "RemoveContainer" containerID="e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032"
May 27 00:14:01.595607 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.595591    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032"} err="failed to get container status \"e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032\": rpc error: code = NotFound desc = could not find container \"e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032\": container with ID starting with e3778781929c07cb3f8fc5afbe5e807919aa772a16517b8083219b088ba84032 not found: ID does not exist"
May 27 00:14:01.595645 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.595608    2574 scope.go:117] "RemoveContainer" containerID="cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a"
May 27 00:14:01.595823 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.595804    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a"} err="failed to get container status \"cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a\": rpc error: code = NotFound desc = could not find container \"cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a\": container with ID starting with cc9c6da7a3d3bc05f6a7e2344ab64991152b0c165afd3fc629eaa6162c55d97a not found: ID does not exist"
May 27 00:14:01.595879 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.595825    2574 scope.go:117] "RemoveContainer" containerID="3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687"
May 27 00:14:01.596023 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.596007    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687"} err="failed to get container status \"3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687\": rpc error: code = NotFound desc = could not find container \"3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687\": container with ID starting with 3837a29a7e4367fac56b4a400cbfe1865e2ebd71014828e1f38d92e301db3687 not found: ID does not exist"
May 27 00:14:01.596101 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.596023    2574 scope.go:117] "RemoveContainer" containerID="3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd"
May 27 00:14:01.596230 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.596215    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd"} err="failed to get container status \"3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd\": rpc error: code = NotFound desc = could not find container \"3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd\": container with ID starting with 3df966ae0236aa6ebeacd38fa41164f01258eedfbae58ee853b9ab5cb98de2fd not found: ID does not exist"
May 27 00:14:01.596267 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.596230    2574 scope.go:117] "RemoveContainer" containerID="f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4"
May 27 00:14:01.602921 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.602904    2574 scope.go:117] "RemoveContainer" containerID="19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5"
May 27 00:14:01.609334 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.609319    2574 scope.go:117] "RemoveContainer" containerID="ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a"
May 27 00:14:01.615583 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.615567    2574 scope.go:117] "RemoveContainer" containerID="85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41"
May 27 00:14:01.622093 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.622072    2574 scope.go:117] "RemoveContainer" containerID="069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925"
May 27 00:14:01.628286 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.628268    2574 scope.go:117] "RemoveContainer" containerID="f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4"
May 27 00:14:01.628501 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.628483    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4\": container with ID starting with f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4 not found: ID does not exist" containerID="f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4"
May 27 00:14:01.628552 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.628509    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4"} err="failed to get container status \"f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4\": rpc error: code = NotFound desc = could not find container \"f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4\": container with ID starting with f955dee8501ac1086f413714f9fa99a3201645af6c70e8d9f7abb919dfb958a4 not found: ID does not exist"
May 27 00:14:01.628552 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.628535    2574 scope.go:117] "RemoveContainer" containerID="19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5"
May 27 00:14:01.628783 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.628768    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5\": container with ID starting with 19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5 not found: ID does not exist" containerID="19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5"
May 27 00:14:01.628824 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.628787    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5"} err="failed to get container status \"19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5\": rpc error: code = NotFound desc = could not find container \"19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5\": container with ID starting with 19e5ca8b0baa44977a42336ef4000753551cb252b351cb9026228555eadcc0e5 not found: ID does not exist"
May 27 00:14:01.628824 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.628800    2574 scope.go:117] "RemoveContainer" containerID="ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a"
May 27 00:14:01.629017 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.629002    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a\": container with ID starting with ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a not found: ID does not exist" containerID="ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a"
May 27 00:14:01.629077 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.629021    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a"} err="failed to get container status \"ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a\": rpc error: code = NotFound desc = could not find container \"ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a\": container with ID starting with ff7e42afc67cf736b170a9ada2a5417233132ec536ad5dd6fe656441a637242a not found: ID does not exist"
May 27 00:14:01.629077 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.629033    2574 scope.go:117] "RemoveContainer" containerID="85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41"
May 27 00:14:01.629244 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.629226    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41\": container with ID starting with 85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41 not found: ID does not exist" containerID="85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41"
May 27 00:14:01.629281 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.629249    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41"} err="failed to get container status \"85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41\": rpc error: code = NotFound desc = could not find container \"85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41\": container with ID starting with 85a4d13bf5fea3d47657611acdc37e5d585f319c496f3d5f4b39f64f20163f41 not found: ID does not exist"
May 27 00:14:01.629281 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.629264    2574 scope.go:117] "RemoveContainer" containerID="069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925"
May 27 00:14:01.629473 ip-10-0-136-0 kubenswrapper[2574]: E0527 00:14:01.629459    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925\": container with ID starting with 069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925 not found: ID does not exist" containerID="069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925"
May 27 00:14:01.629530 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:01.629476    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925"} err="failed to get container status \"069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925\": rpc error: code = NotFound desc = could not find container \"069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925\": container with ID starting with 069e7b8af7a4511dae9953a4fc819564a246e886eb30f2893bf67708384a8925 not found: ID does not exist"
May 27 00:14:02.695811 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:02.695780    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" path="/var/lib/kubelet/pods/0351de9a-df0d-4303-abd6-e75cecbe37b6/volumes"
May 27 00:14:02.696325 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:02.696311    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="047ba489-652d-45f3-9329-632f052adb42" path="/var/lib/kubelet/pods/047ba489-652d-45f3-9329-632f052adb42/volumes"
May 27 00:14:37.272516 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272431    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-twt48/must-gather-g5w74"]
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272748    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="feast-apply"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272766    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="feast-apply"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272779    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="ui"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272788    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="ui"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272798    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="ui"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272807    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="ui"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272818    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="offline"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272826    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="offline"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272834    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="online"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272841    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="online"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272860    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="feast-apply"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272868    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="feast-apply"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272884    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="feast-init"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272893    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="feast-init"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272904    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="registry"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272913    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="registry"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272922    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="online"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272930    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="online"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272940    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="feast-init"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272949    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="feast-init"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272965    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="offline"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.272973    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="offline"
May 27 00:14:37.273026 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.273030    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="registry"
May 27 00:14:37.274091 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.273042    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="ui"
May 27 00:14:37.274091 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.273069    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="ui"
May 27 00:14:37.274091 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.273081    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="online"
May 27 00:14:37.274091 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.273092    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="047ba489-652d-45f3-9329-632f052adb42" containerName="offline"
May 27 00:14:37.274091 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.273101    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="online"
May 27 00:14:37.274091 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.273111    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="0351de9a-df0d-4303-abd6-e75cecbe37b6" containerName="offline"
May 27 00:14:37.277537 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.277518    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twt48/must-gather-g5w74"
May 27 00:14:37.279963 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.279943    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-twt48\"/\"default-dockercfg-lcfnn\""
May 27 00:14:37.280036 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.279985    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-twt48\"/\"kube-root-ca.crt\""
May 27 00:14:37.280109 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.280063    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-twt48\"/\"openshift-service-ca.crt\""
May 27 00:14:37.284437 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.284414    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-twt48/must-gather-g5w74"]
May 27 00:14:37.402164 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.402123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1343ab5f-9ec8-46d0-88a4-9b1d7f505317-must-gather-output\") pod \"must-gather-g5w74\" (UID: \"1343ab5f-9ec8-46d0-88a4-9b1d7f505317\") " pod="openshift-must-gather-twt48/must-gather-g5w74"
May 27 00:14:37.402270 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.402180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt8v4\" (UniqueName: \"kubernetes.io/projected/1343ab5f-9ec8-46d0-88a4-9b1d7f505317-kube-api-access-bt8v4\") pod \"must-gather-g5w74\" (UID: \"1343ab5f-9ec8-46d0-88a4-9b1d7f505317\") " pod="openshift-must-gather-twt48/must-gather-g5w74"
May 27 00:14:37.503068 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.503028    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bt8v4\" (UniqueName: \"kubernetes.io/projected/1343ab5f-9ec8-46d0-88a4-9b1d7f505317-kube-api-access-bt8v4\") pod \"must-gather-g5w74\" (UID: \"1343ab5f-9ec8-46d0-88a4-9b1d7f505317\") " pod="openshift-must-gather-twt48/must-gather-g5w74"
May 27 00:14:37.503194 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.503136    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1343ab5f-9ec8-46d0-88a4-9b1d7f505317-must-gather-output\") pod \"must-gather-g5w74\" (UID: \"1343ab5f-9ec8-46d0-88a4-9b1d7f505317\") " pod="openshift-must-gather-twt48/must-gather-g5w74"
May 27 00:14:37.503465 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.503448    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1343ab5f-9ec8-46d0-88a4-9b1d7f505317-must-gather-output\") pod \"must-gather-g5w74\" (UID: \"1343ab5f-9ec8-46d0-88a4-9b1d7f505317\") " pod="openshift-must-gather-twt48/must-gather-g5w74"
May 27 00:14:37.512196 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.512174    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt8v4\" (UniqueName: \"kubernetes.io/projected/1343ab5f-9ec8-46d0-88a4-9b1d7f505317-kube-api-access-bt8v4\") pod \"must-gather-g5w74\" (UID: \"1343ab5f-9ec8-46d0-88a4-9b1d7f505317\") " pod="openshift-must-gather-twt48/must-gather-g5w74"
May 27 00:14:37.586486 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.586432    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twt48/must-gather-g5w74"
May 27 00:14:37.706754 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.706714    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-twt48/must-gather-g5w74"]
May 27 00:14:37.709517 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:14:37.709493    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1343ab5f_9ec8_46d0_88a4_9b1d7f505317.slice/crio-917aa8f33c0942fd0952da7ba724b820eeafa1917d9de446c01e8569f24be187 WatchSource:0}: Error finding container 917aa8f33c0942fd0952da7ba724b820eeafa1917d9de446c01e8569f24be187: Status 404 returned error can't find the container with id 917aa8f33c0942fd0952da7ba724b820eeafa1917d9de446c01e8569f24be187
May 27 00:14:37.711227 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:37.711212    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 00:14:38.642759 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:38.642727    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twt48/must-gather-g5w74" event={"ID":"1343ab5f-9ec8-46d0-88a4-9b1d7f505317","Type":"ContainerStarted","Data":"e52e271148973f1a3f82d4ca0de2a4f379bf804fe653bcee817c397318c81065"}
May 27 00:14:38.643035 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:38.642767    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twt48/must-gather-g5w74" event={"ID":"1343ab5f-9ec8-46d0-88a4-9b1d7f505317","Type":"ContainerStarted","Data":"917aa8f33c0942fd0952da7ba724b820eeafa1917d9de446c01e8569f24be187"}
May 27 00:14:39.648640 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:39.648599    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twt48/must-gather-g5w74" event={"ID":"1343ab5f-9ec8-46d0-88a4-9b1d7f505317","Type":"ContainerStarted","Data":"deff8417ee49b9797751f9060532bbf90caac8801bf5e81dadd9ab03809444cc"}
May 27 00:14:39.666707 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:39.666649    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-twt48/must-gather-g5w74" podStartSLOduration=1.8517049719999998 podStartE2EDuration="2.666631285s" podCreationTimestamp="2026-05-27 00:14:37 +0000 UTC" firstStartedPulling="2026-05-27 00:14:37.711408745 +0000 UTC m=+1873.607229483" lastFinishedPulling="2026-05-27 00:14:38.526335044 +0000 UTC m=+1874.422155796" observedRunningTime="2026-05-27 00:14:39.664489085 +0000 UTC m=+1875.560309839" watchObservedRunningTime="2026-05-27 00:14:39.666631285 +0000 UTC m=+1875.562452045"
May 27 00:14:39.825191 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:39.825159    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jnpf6_375b33ce-fc77-46c7-b25d-b3b7a5e69a0c/global-pull-secret-syncer/0.log"
May 27 00:14:39.946310 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:39.946224    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kqsj4_2e92b997-ff62-4a5a-a446-915d36e9e03a/konnectivity-agent/0.log"
May 27 00:14:40.012506 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:40.012460    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-0.ec2.internal_f4c644e74d9922165a4478c112ee14b0/haproxy/0.log"
May 27 00:14:43.118624 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:43.118592    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqc9j_abc9ecde-b366-4c07-ac90-5eedb80be916/node-exporter/0.log"
May 27 00:14:43.140768 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:43.140745    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqc9j_abc9ecde-b366-4c07-ac90-5eedb80be916/kube-rbac-proxy/0.log"
May 27 00:14:43.160979 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:43.160954    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqc9j_abc9ecde-b366-4c07-ac90-5eedb80be916/init-textfile/0.log"
May 27 00:14:44.790670 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:44.790642    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-84lxj_208668b1-eb68-483d-ab6b-cb1bca830afe/networking-console-plugin/0.log"
May 27 00:14:46.508908 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.508878    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9svlm_43c7e54b-86c1-404f-938c-8c0a45ab4e0e/dns/0.log"
May 27 00:14:46.534884 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.534852    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9svlm_43c7e54b-86c1-404f-938c-8c0a45ab4e0e/kube-rbac-proxy/0.log"
May 27 00:14:46.547380 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.547348    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"]
May 27 00:14:46.550888 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.550867    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.562484 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.562400    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"]
May 27 00:14:46.679345 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.679318    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-psbmk_fd9846b6-4187-4335-869d-21c8dc444a11/dns-node-resolver/0.log"
May 27 00:14:46.685808 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.685777    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-podres\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.685971 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.685811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-sys\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.685971 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.685836    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-proc\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.685971 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.685887    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6gxw\" (UniqueName: \"kubernetes.io/projected/ced2b0eb-0eaf-4563-b871-62e00f2fe789-kube-api-access-l6gxw\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.685971 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.685914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-lib-modules\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.786462 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.786379    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6gxw\" (UniqueName: \"kubernetes.io/projected/ced2b0eb-0eaf-4563-b871-62e00f2fe789-kube-api-access-l6gxw\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.786462 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.786421    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-lib-modules\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.786462 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.786448    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-podres\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.786700 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.786471    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-sys\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.786700 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.786492    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-proc\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.786700 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.786567    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-sys\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.786700 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.786572    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-proc\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.786700 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.786609    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-podres\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.786700 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.786614    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ced2b0eb-0eaf-4563-b871-62e00f2fe789-lib-modules\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.793883 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.793863    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6gxw\" (UniqueName: \"kubernetes.io/projected/ced2b0eb-0eaf-4563-b871-62e00f2fe789-kube-api-access-l6gxw\") pod \"perf-node-gather-daemonset-l4c4f\" (UID: \"ced2b0eb-0eaf-4563-b871-62e00f2fe789\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:46.866943 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:46.866915    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:47.004611 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:47.004577    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"]
May 27 00:14:47.009007 ip-10-0-136-0 kubenswrapper[2574]: W0527 00:14:47.008974    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podced2b0eb_0eaf_4563_b871_62e00f2fe789.slice/crio-ad9cae92671e4b58a7346f96feee23bc13719899d7de95eb5e307d1c1c2799c2 WatchSource:0}: Error finding container ad9cae92671e4b58a7346f96feee23bc13719899d7de95eb5e307d1c1c2799c2: Status 404 returned error can't find the container with id ad9cae92671e4b58a7346f96feee23bc13719899d7de95eb5e307d1c1c2799c2
May 27 00:14:47.156116 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:47.156081    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sv6wc_d9915d1c-3fad-4080-a23f-01f593cef437/node-ca/0.log"
May 27 00:14:47.691647 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:47.691609    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f" event={"ID":"ced2b0eb-0eaf-4563-b871-62e00f2fe789","Type":"ContainerStarted","Data":"fde626f6355058444624cf3843d9fedde18e2efde20be6ac668b63f90a51063a"}
May 27 00:14:47.691647 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:47.691653    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f" event={"ID":"ced2b0eb-0eaf-4563-b871-62e00f2fe789","Type":"ContainerStarted","Data":"ad9cae92671e4b58a7346f96feee23bc13719899d7de95eb5e307d1c1c2799c2"}
May 27 00:14:47.692037 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:47.691737    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:47.706509 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:47.706459    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f" podStartSLOduration=1.706445183 podStartE2EDuration="1.706445183s" podCreationTimestamp="2026-05-27 00:14:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 00:14:47.705574322 +0000 UTC m=+1883.601395093" watchObservedRunningTime="2026-05-27 00:14:47.706445183 +0000 UTC m=+1883.602265942"
May 27 00:14:48.101021 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:48.100977    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7mddt_86fa870e-3474-4da6-b96b-ac91909598a2/serve-healthcheck-canary/0.log"
May 27 00:14:48.587284 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:48.587256    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xbbzd_5ff6d659-32ac-4472-9e70-7b57fc79aa23/kube-rbac-proxy/0.log"
May 27 00:14:48.605391 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:48.605367    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xbbzd_5ff6d659-32ac-4472-9e70-7b57fc79aa23/exporter/0.log"
May 27 00:14:48.624460 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:48.624441    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xbbzd_5ff6d659-32ac-4472-9e70-7b57fc79aa23/extractor/0.log"
May 27 00:14:53.367427 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.367399    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ls22_b99f2d83-2309-4be0-86fe-5d837c071be9/kube-multus-additional-cni-plugins/0.log"
May 27 00:14:53.386063 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.386029    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ls22_b99f2d83-2309-4be0-86fe-5d837c071be9/egress-router-binary-copy/0.log"
May 27 00:14:53.406190 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.406163    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ls22_b99f2d83-2309-4be0-86fe-5d837c071be9/cni-plugins/0.log"
May 27 00:14:53.424288 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.424265    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ls22_b99f2d83-2309-4be0-86fe-5d837c071be9/bond-cni-plugin/0.log"
May 27 00:14:53.444085 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.444023    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ls22_b99f2d83-2309-4be0-86fe-5d837c071be9/routeoverride-cni/0.log"
May 27 00:14:53.462696 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.462674    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ls22_b99f2d83-2309-4be0-86fe-5d837c071be9/whereabouts-cni-bincopy/0.log"
May 27 00:14:53.480268 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.480221    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ls22_b99f2d83-2309-4be0-86fe-5d837c071be9/whereabouts-cni/0.log"
May 27 00:14:53.705600 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.705536    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-l4c4f"
May 27 00:14:53.819961 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.819936    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cl9nk_d85d57c4-458e-4aa8-94be-930460d8bc09/kube-multus/0.log"
May 27 00:14:53.882949 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.882924    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4gd6s_e4942eb9-3d0f-431a-97a5-ee6cba6a5a66/network-metrics-daemon/0.log"
May 27 00:14:53.900790 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:53.900759    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4gd6s_e4942eb9-3d0f-431a-97a5-ee6cba6a5a66/kube-rbac-proxy/0.log"
May 27 00:14:55.116437 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:55.116402    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-controller/0.log"
May 27 00:14:55.133526 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:55.133504    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/0.log"
May 27 00:14:55.144601 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:55.144574    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovn-acl-logging/1.log"
May 27 00:14:55.164173 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:55.164145    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/kube-rbac-proxy-node/0.log"
May 27 00:14:55.185700 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:55.185673    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/kube-rbac-proxy-ovn-metrics/0.log"
May 27 00:14:55.200844 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:55.200817    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/northd/0.log"
May 27 00:14:55.220818 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:55.220793    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/nbdb/0.log"
May 27 00:14:55.240714 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:55.240684    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/sbdb/0.log"
May 27 00:14:55.356523 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:55.356429    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2j7n_ad5b8223-60ed-496c-9e83-ad0bf01ada03/ovnkube-controller/0.log"
May 27 00:14:56.439300 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:56.439233    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q9mxd_33d8c80a-1504-411a-b3e9-1834b471b952/network-check-target-container/0.log"
May 27 00:14:57.320398 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:57.320359    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-q55q5_e4223034-5463-473f-811a-e0e3220a52a2/iptables-alerter/0.log"
May 27 00:14:58.011180 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:14:58.011153    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-nrcpk_93e5b8b7-b63a-4a83-a292-4da4d6761a75/tuned/0.log"
May 27 00:15:00.990577 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:15:00.990549    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-j5b22_4a50c40a-ed69-44af-bbd3-ec1ee4063160/csi-driver/0.log"
May 27 00:15:01.009391 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:15:01.009367    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-j5b22_4a50c40a-ed69-44af-bbd3-ec1ee4063160/csi-node-driver-registrar/0.log"
May 27 00:15:01.029196 ip-10-0-136-0 kubenswrapper[2574]: I0527 00:15:01.029173    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-j5b22_4a50c40a-ed69-44af-bbd3-ec1ee4063160/csi-liveness-probe/0.log"