May 26 06:54:14.614215 ip-10-0-134-143 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 06:54:14.614229 ip-10-0-134-143 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 06:54:14.614239 ip-10-0-134-143 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 06:54:14.614577 ip-10-0-134-143 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 06:54:24.640938 ip-10-0-134-143 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 06:54:24.640960 ip-10-0-134-143 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c4dbfd4a280247929a16c519cef10cc5 --
May 26 06:56:44.299430 ip-10-0-134-143 systemd[1]: Starting Kubernetes Kubelet...
May 26 06:56:44.818305 ip-10-0-134-143 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 06:56:44.818305 ip-10-0-134-143 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 06:56:44.818305 ip-10-0-134-143 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 06:56:44.818305 ip-10-0-134-143 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 06:56:44.818305 ip-10-0-134-143 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 06:56:44.819282 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.819189    2564 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 06:56:44.822349 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822334    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:44.822349 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822349    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822352    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822356    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822359    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822363    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822366    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822368    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822372    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822374    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822377    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822380    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822382    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822385    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822388    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822390    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822393    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822396    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822398    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822401    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822404    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:44.822414 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822407    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822409    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822416    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822420    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822422    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822425    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822428    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822431    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822434    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822436    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822439    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822442    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822444    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822447    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822450    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822452    2564 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822455    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822457    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822460    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822462    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:44.822893 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822465    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822467    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822470    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822472    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822475    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822477    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822480    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822482    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822485    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822489    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822492    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822495    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822498    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822501    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822506    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822509    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822512    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822514    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822517    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:44.823404 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822520    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822522    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822524    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822527    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822529    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822532    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822534    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822539    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822542    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822546    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822549    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822552    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822555    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822558    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822561    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822565    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822567    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822570    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822573    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822576    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:44.823841 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822579    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822582    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822585    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822588    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822591    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.822594    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823033    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823041    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823044    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823046    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823049    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823052    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823055    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823058    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823060    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823063    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823066    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823069    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823071    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823074    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:44.824323 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823076    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823079    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823082    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823084    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823087    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823090    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823093    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823096    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823098    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823101    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823103    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823106    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823108    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823111    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823113    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823116    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823119    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823122    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823125    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:44.824790 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823127    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823130    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823134    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823138    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823141    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823143    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823146    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823148    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823151    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823153    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823156    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823158    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823160    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823163    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823166    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823169    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823171    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823174    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823176    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823180    2564 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:44.825272 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823183    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823185    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823190    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823193    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823196    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823199    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823202    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823205    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823220    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823223    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823226    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823228    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823230    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823233    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823235    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823238    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823241    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823243    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823245    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823248    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:44.825749 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823250    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823253    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823255    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823258    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823260    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823263    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823268    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823271    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823275    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823277    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823280    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823283    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823286    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823353    2564 flags.go:64] FLAG: --address="0.0.0.0"
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823361    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823369    2564 flags.go:64] FLAG: --anonymous-auth="true"
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823375    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823382    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823387    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823393    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823399    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 06:56:44.826311 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823404    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823409    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823413    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823417    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823420    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823423    2564 flags.go:64] FLAG: --cgroup-root=""
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823426    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823429    2564 flags.go:64] FLAG: --client-ca-file=""
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823431    2564 flags.go:64] FLAG: --cloud-config=""
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823434    2564 flags.go:64] FLAG: --cloud-provider="external"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823437    2564 flags.go:64] FLAG: --cluster-dns="[]"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823442    2564 flags.go:64] FLAG: --cluster-domain=""
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823445    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823448    2564 flags.go:64] FLAG: --config-dir=""
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823450    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823453    2564 flags.go:64] FLAG: --container-log-max-files="5"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823458    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823461    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823464    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823467    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823470    2564 flags.go:64] FLAG: --contention-profiling="false"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823473    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823476    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823479    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823482    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 06:56:44.826819 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823487    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823490    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823493    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823496    2564 flags.go:64] FLAG: --enable-load-reader="false"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823499    2564 flags.go:64] FLAG: --enable-server="true"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823502    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823506    2564 flags.go:64] FLAG: --event-burst="100"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823509    2564 flags.go:64] FLAG: --event-qps="50"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823512    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823515    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823518    2564 flags.go:64] FLAG: --eviction-hard=""
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823522    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823525    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823527    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823531    2564 flags.go:64] FLAG: --eviction-soft=""
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823534    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823536    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823539    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823542    2564 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823545    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823548    2564 flags.go:64] FLAG: --fail-swap-on="true"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823550    2564 flags.go:64] FLAG: --feature-gates=""
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823554    2564 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823557    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823560    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 06:56:44.827444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823563    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823566    2564 flags.go:64] FLAG: --healthz-port="10248"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823570    2564 flags.go:64] FLAG: --help="false"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823573    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-134-143.ec2.internal"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823576    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823579    2564 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823582    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823585    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823589    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823592    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823595    2564 flags.go:64] FLAG: --image-service-endpoint=""
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823597    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823600    2564 flags.go:64] FLAG: --kube-api-burst="100"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823603    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823606    2564 flags.go:64] FLAG: --kube-api-qps="50"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823609    2564 flags.go:64] FLAG: --kube-reserved=""
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823612    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823615    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823618    2564 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823620    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823623    2564 flags.go:64] FLAG: --lock-file=""
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823626    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823629    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823632    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 06:56:44.828083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823637    2564 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823639    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823642    2564 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823645    2564 flags.go:64] FLAG: --logging-format="text"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823648    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823651    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823654    2564 flags.go:64] FLAG: --manifest-url=""
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823657    2564 flags.go:64] FLAG: --manifest-url-header=""
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823661    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823664    2564 flags.go:64] FLAG: --max-open-files="1000000"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823668    2564 flags.go:64] FLAG: --max-pods="110"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823671    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823674    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823677    2564 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823680    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823683    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823686    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823689    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823696    2564 flags.go:64] FLAG: --node-status-max-images="50"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823699    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823702    2564 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823705    2564 flags.go:64] FLAG: --pod-cidr=""
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823708    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 06:56:44.828638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823713    2564 flags.go:64] FLAG: --pod-manifest-path=""
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823716    2564 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823719    2564 flags.go:64] FLAG: --pods-per-core="0"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823722    2564 flags.go:64] FLAG: --port="10250"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823725    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823728    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00900b11ffc6fd2a2"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823731    2564 flags.go:64] FLAG: --qos-reserved=""
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823734    2564 flags.go:64] FLAG: --read-only-port="10255"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823737    2564 flags.go:64] FLAG: --register-node="true"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823740    2564 flags.go:64] FLAG: --register-schedulable="true"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823743    2564 flags.go:64] FLAG: --register-with-taints=""
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823746    2564 flags.go:64] FLAG: --registry-burst="10"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823749    2564 flags.go:64] FLAG: --registry-qps="5"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823752    2564 flags.go:64] FLAG: --reserved-cpus=""
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823755    2564 flags.go:64] FLAG: --reserved-memory=""
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823758    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823761    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823765    2564 flags.go:64] FLAG: --rotate-certificates="false"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823767    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823770    2564 flags.go:64] FLAG: --runonce="false"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823773    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823776    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823779    2564 flags.go:64] FLAG: --seccomp-default="false"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823782    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823785    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823788    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 06:56:44.829222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823791    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823794    2564 flags.go:64] FLAG: --storage-driver-password="root"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823797    2564 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823800    2564 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823803    2564 flags.go:64] FLAG: --storage-driver-user="root"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823805    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823808    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823811    2564 flags.go:64] FLAG: --system-cgroups=""
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823814    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823818    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823821    2564 flags.go:64] FLAG: --tls-cert-file=""
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823824    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823828    2564 flags.go:64] FLAG: --tls-min-version=""
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823831    2564 flags.go:64] FLAG: --tls-private-key-file=""
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823834    2564 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823837    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823839    2564 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823842    2564 flags.go:64] FLAG: --v="2"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823846    2564 flags.go:64] FLAG: --version="false"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823851    2564 flags.go:64] FLAG: --vmodule=""
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823855    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.823859    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823974    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823978    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:44.829833 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823981    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823984    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823990    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823993    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823996    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.823999    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824014    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824017    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824020    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824023    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824027    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824031    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824034    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824036    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824039    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824042    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824044    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824047    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824051    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:44.830454 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824054    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824057    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824060    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824063    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824066    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824069    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824072    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824074    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824077    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824080    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824082    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824089    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824092    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824094    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824097    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824101    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824104    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824106    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824109    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824112    2564 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:44.831259 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824114    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824117    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824120    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824122    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824125    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824128    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824131    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824133    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824136    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824138    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824141    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824144    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824146    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824149    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824151    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824154    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824156    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824159    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824162    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824164    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:44.832182 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824167    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824169    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824172    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824176    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824179    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824182    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824184    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824188    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824190    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824193    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824196    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824198    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824201    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824203    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824206    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824208    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824211    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824213    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824216    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824219    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:44.832963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824221    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824224    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824227    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824229    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.824232    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.825142    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.832704    2564 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.832722    2564 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832772    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832777    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832781    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832784    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832787    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832790    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832793    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832796    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:44.833863 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832798    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832801    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832804    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832807    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832809    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832812    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832814    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832817    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832819    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832822    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832825    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832827    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832830    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832833    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832836    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832838    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832841    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832845    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832849    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832852    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:44.834332 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832854    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832857    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832859    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832863    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832866    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832869    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832872    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832874    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832877    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832880    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832882    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832885    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832888    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832890    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832893    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832895    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832898    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832900    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832903    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832905    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:44.834823 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832908    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832910    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832913    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832915    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832918    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832920    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832923    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832926    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832928    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832931    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832933    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832936    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832938    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832941    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832943    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832946    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832950    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832952    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832955    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832958    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:44.835342 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832960    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832962    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832965    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832967    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832971    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832974    2564 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832976    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832980    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832984    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832988    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832991    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832993    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832996    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.832998    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833001    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833020    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833024    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:44.835811 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833026    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.833031    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833121    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833126    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833130    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833133    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833136    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833140    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833143    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833147    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833149    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833154    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833157    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833161    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833163    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:44.836237 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833166    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833169    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833171    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833174    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833177    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833179    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833182    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833184    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833187    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833189    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833192    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833194    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833197    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833199    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833202    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833204    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833207    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833209    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833212    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833214    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:44.836612 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833217    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833220    2564 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833222    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833225    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833228    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833230    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833233    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833236    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833239    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833242    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833244    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833247    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833249    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833252    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833254    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833257    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833259    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833262    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833265    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833267    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:44.837124 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833270    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833272    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833275    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833277    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833280    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833282    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833284    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833287    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833289    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833292    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833294    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833297    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833299    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833302    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833304    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833307    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833310    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833314    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833317    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:44.837629 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833320    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833322    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833325    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833327    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833330    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833332    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833335    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833337    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833340    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833342    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833345    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833347    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833350    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:44.833352    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.833357    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 06:56:44.838116 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.833454    2564 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 06:56:44.838485 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.838324    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 06:56:44.839419 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.839406    2564 server.go:1019] "Starting client certificate rotation"
May 26 06:56:44.839530 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.839513    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 06:56:44.839565 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.839552    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 06:56:44.868620 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.868604    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 06:56:44.874813 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.874791    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 06:56:44.890001 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.889963    2564 log.go:25] "Validated CRI v1 runtime API"
May 26 06:56:44.898475 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.898459    2564 log.go:25] "Validated CRI v1 image API"
May 26 06:56:44.900716 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.900702    2564 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 06:56:44.902147 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.902130    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 06:56:44.905960 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.905929    2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e7110963-f540-4648-bbae-fbf7aa45eac4:/dev/nvme0n1p4 efd59408-48fd-4000-9dbe-2eff1a540489:/dev/nvme0n1p3]
May 26 06:56:44.906071 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.905960    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 06:56:44.910211 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.910094    2564 manager.go:217] Machine: {Timestamp:2026-05-26 06:56:44.909574945 +0000 UTC m=+0.471930629 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3162089 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f8d7d0740be5d8b745d8b74da16c SystemUUID:ec24f8d7-d074-0be5-d8b7-45d8b74da16c BootID:c4dbfd4a-2802-4792-9a16-c519cef10cc5 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:85:e2:69:8a:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:85:e2:69:8a:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:70:11:f9:fd:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 06:56:44.910803 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.910789    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 06:56:44.910907 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.910891    2564 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 06:56:44.915822 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.915795    2564 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 06:56:44.915979 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.915824    2564 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 06:56:44.916083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.915989    2564 topology_manager.go:138] "Creating topology manager with none policy"
May 26 06:56:44.916083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.916016    2564 container_manager_linux.go:306] "Creating device plugin manager"
May 26 06:56:44.916083 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.916026    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 06:56:44.917101 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.917089    2564 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 06:56:44.919636 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.919622    2564 state_mem.go:36] "Initialized new in-memory state store"
May 26 06:56:44.919763 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.919752    2564 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 06:56:44.922567 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.922555    2564 kubelet.go:491] "Attempting to sync node with API server"
May 26 06:56:44.922634 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.922578    2564 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 06:56:44.922634 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.922595    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 06:56:44.922634 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.922608    2564 kubelet.go:397] "Adding apiserver pod source"
May 26 06:56:44.922634 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.922622    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 06:56:44.923854 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.923841    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 06:56:44.923913 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.923865    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 06:56:44.927568 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.927553    2564 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 06:56:44.930093 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.930078    2564 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 06:56:44.931163 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931149    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 06:56:44.931241 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931168    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 06:56:44.931241 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931189    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 06:56:44.931241 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931196    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 06:56:44.931241 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931208    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 06:56:44.931241 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931216    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 06:56:44.931241 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931226    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 06:56:44.931241 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931234    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 06:56:44.931434 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931244    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 06:56:44.931434 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931253    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 06:56:44.931434 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931265    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 06:56:44.931555 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.931544    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 06:56:44.932521 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.932511    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 06:56:44.932570 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.932524    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 06:56:44.937680 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.937601    2564 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 06:56:44.937680 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:44.937626    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 06:56:44.938065 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:44.937776    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 06:56:44.938860 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.938842    2564 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 06:56:44.938932 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.938896    2564 server.go:1295] "Started kubelet"
May 26 06:56:44.938986 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.938951    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 06:56:44.939057 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.938981    2564 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 06:56:44.939108 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.939073    2564 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 06:56:44.939940 ip-10-0-134-143 systemd[1]: Started Kubernetes Kubelet.
May 26 06:56:44.940218 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.940202    2564 server.go:317] "Adding debug handlers to kubelet server"
May 26 06:56:44.940551 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.940527    2564 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 06:56:44.945736 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:44.944634    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-143.ec2.internal.18b30b3626388ce6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-143.ec2.internal,UID:ip-10-0-134-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-143.ec2.internal,},FirstTimestamp:2026-05-26 06:56:44.938857702 +0000 UTC m=+0.501213391,LastTimestamp:2026-05-26 06:56:44.938857702 +0000 UTC m=+0.501213391,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-143.ec2.internal,}"
May 26 06:56:44.948521 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.948503    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 06:56:44.948521 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.948515    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 06:56:44.948665 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.948635    2564 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 06:56:44.948665 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.948647    2564 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 06:56:44.948760 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.948751    2564 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 06:56:44.948830 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.948819    2564 reconstruct.go:97] "Volume reconstruction finished"
May 26 06:56:44.948904 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.948896    2564 reconciler.go:26] "Reconciler: start to sync state"
May 26 06:56:44.949138 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.949114    2564 factory.go:55] Registering systemd factory
May 26 06:56:44.949138 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:44.949125    2564 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 06:56:44.949246 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.949135    2564 factory.go:223] Registration of the systemd container factory successfully
May 26 06:56:44.949398 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.949380    2564 factory.go:153] Registering CRI-O factory
May 26 06:56:44.949398 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.949400    2564 factory.go:223] Registration of the crio container factory successfully
May 26 06:56:44.949536 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.949452    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 06:56:44.949536 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.949472    2564 factory.go:103] Registering Raw factory
May 26 06:56:44.949536 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.949499    2564 manager.go:1196] Started watching for new ooms in manager
May 26 06:56:44.949773 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:44.949719    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:44.950635 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.950620    2564 manager.go:319] Starting recovery of all containers
May 26 06:56:44.952712 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.952691    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7nnrd"
May 26 06:56:44.959285 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.959164    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7nnrd"
May 26 06:56:44.959938 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:44.959811    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 06:56:44.960036 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:44.959985    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 06:56:44.961807 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.961788    2564 manager.go:324] Recovery completed
May 26 06:56:44.967456 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.967436    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:44.969134 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.969120    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:44.969203 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.969146    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:44.969203 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.969159    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:44.969632 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.969619    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 06:56:44.969632 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.969630    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 06:56:44.969707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.969645    2564 state_mem.go:36] "Initialized new in-memory state store"
May 26 06:56:44.973432 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.973420    2564 policy_none.go:49] "None policy: Start"
May 26 06:56:44.973493 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.973436    2564 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 06:56:44.973493 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:44.973445    2564 state_mem.go:35] "Initializing new in-memory state store"
May 26 06:56:45.003623 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.003610    2564 manager.go:341] "Starting Device Plugin manager"
May 26 06:56:45.029350 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.003638    2564 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 06:56:45.029350 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.003648    2564 server.go:85] "Starting device plugin registration server"
May 26 06:56:45.029350 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.003828    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 06:56:45.029350 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.003840    2564 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 06:56:45.029350 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.003919    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 06:56:45.029350 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.003973    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 06:56:45.029350 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.003980    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 06:56:45.029350 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.004455    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 06:56:45.029350 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.004482    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.053363 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.053336    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 06:56:45.054513 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.054501    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 06:56:45.054590 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.054518    2564 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 06:56:45.054590 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.054535    2564 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 06:56:45.054590 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.054546    2564 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 06:56:45.054590 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.054588    2564 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 06:56:45.058667 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.058647    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:56:45.104687 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.104640    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:45.105428 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.105413    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:45.105493 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.105444    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:45.105493 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.105457    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:45.105493 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.105485    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-143.ec2.internal"
May 26 06:56:45.114876 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.114860    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-143.ec2.internal"
May 26 06:56:45.114919 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.114880    2564 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-143.ec2.internal\": node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.136389 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.136367    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.155630 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.155604    2564 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"]
May 26 06:56:45.155713 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.155674    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:45.156551 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.156535    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:45.156647 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.156567    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:45.156647 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.156581    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:45.157790 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.157775    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:45.157940 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.157925    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.157990 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.157963    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:45.158479 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.158465    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:45.158555 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.158487    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:45.158555 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.158496    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:45.158555 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.158514    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:45.158555 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.158515    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:45.158555 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.158533    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:45.159595 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.159578    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.159670 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.159603    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:45.160211 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.160197    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:45.160301 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.160219    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:45.160301 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.160230    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:45.178581 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.178562    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-143.ec2.internal\" not found" node="ip-10-0-134-143.ec2.internal"
May 26 06:56:45.182329 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.182314    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-143.ec2.internal\" not found" node="ip-10-0-134-143.ec2.internal"
May 26 06:56:45.236848 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.236822    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.250556 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.250539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b2a8d2144f7ac516d9ab44dc2153c74-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"0b2a8d2144f7ac516d9ab44dc2153c74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.250641 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.250568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ad3d1c4ba6c2ff0bb291a936631deb2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-143.ec2.internal\" (UID: \"1ad3d1c4ba6c2ff0bb291a936631deb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.250641 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.250597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b2a8d2144f7ac516d9ab44dc2153c74-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"0b2a8d2144f7ac516d9ab44dc2153c74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.337908 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.337887    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.351258 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.351235    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b2a8d2144f7ac516d9ab44dc2153c74-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"0b2a8d2144f7ac516d9ab44dc2153c74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.351329 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.351264    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ad3d1c4ba6c2ff0bb291a936631deb2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-143.ec2.internal\" (UID: \"1ad3d1c4ba6c2ff0bb291a936631deb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.351329 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.351283    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b2a8d2144f7ac516d9ab44dc2153c74-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"0b2a8d2144f7ac516d9ab44dc2153c74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.351396 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.351339    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ad3d1c4ba6c2ff0bb291a936631deb2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-143.ec2.internal\" (UID: \"1ad3d1c4ba6c2ff0bb291a936631deb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.351396 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.351386    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b2a8d2144f7ac516d9ab44dc2153c74-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"0b2a8d2144f7ac516d9ab44dc2153c74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.351453 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.351411    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b2a8d2144f7ac516d9ab44dc2153c74-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal\" (UID: \"0b2a8d2144f7ac516d9ab44dc2153c74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.438574 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.438520    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.481925 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.481905    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.484719 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.484701    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
May 26 06:56:45.539458 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.539429    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.639907 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.639884    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.740374 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.740330    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.838750 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.838730    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 06:56:45.839236 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.838880    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 06:56:45.840879 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.840861    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.941349 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:45.941328    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:45.949084 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.949067    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 06:56:45.959618 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.959599    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 06:56:45.961740 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.961710    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 06:51:44 +0000 UTC" deadline="2027-12-29 20:35:25.238611647 +0000 UTC"
May 26 06:56:45.961782 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.961740    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13981h38m39.276874111s"
May 26 06:56:45.987972 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.987952    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dtcfn"
May 26 06:56:45.996861 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:45.996824    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dtcfn"
May 26 06:56:46.002360 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.002346    2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:56:46.041560 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:46.041535    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-143.ec2.internal\" not found"
May 26 06:56:46.079336 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.079317    2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:56:46.142831 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:46.142804    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad3d1c4ba6c2ff0bb291a936631deb2.slice/crio-50a7a2bb8ecc6bda29eab1774bd21ca83739a58d3236828b5d2f8e0747398360 WatchSource:0}: Error finding container 50a7a2bb8ecc6bda29eab1774bd21ca83739a58d3236828b5d2f8e0747398360: Status 404 returned error can't find the container with id 50a7a2bb8ecc6bda29eab1774bd21ca83739a58d3236828b5d2f8e0747398360
May 26 06:56:46.143142 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:46.143116    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2a8d2144f7ac516d9ab44dc2153c74.slice/crio-8cff8fde3ba32cbd00d8bff0ab7ae62c72af8e962bfa98a0396a10dfe7853184 WatchSource:0}: Error finding container 8cff8fde3ba32cbd00d8bff0ab7ae62c72af8e962bfa98a0396a10dfe7853184: Status 404 returned error can't find the container with id 8cff8fde3ba32cbd00d8bff0ab7ae62c72af8e962bfa98a0396a10dfe7853184
May 26 06:56:46.145865 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.145851    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 06:56:46.149549 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.149533    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal"
May 26 06:56:46.164727 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.164698    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 06:56:46.166095 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.166082    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal"
May 26 06:56:46.175291 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.175277    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 06:56:46.423372 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.423350    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:56:46.923857 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.923829    2564 apiserver.go:52] "Watching apiserver"
May 26 06:56:46.931563 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.931360    2564 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 06:56:46.931751 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.931723    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6","openshift-image-registry/node-ca-nn9b9","openshift-multus/multus-additional-cni-plugins-j5bdr","openshift-multus/multus-z9rzq","openshift-multus/network-metrics-daemon-q4gb7","openshift-network-operator/iptables-alerter-8v2lq","openshift-ovn-kubernetes/ovnkube-node-8zhkh","kube-system/konnectivity-agent-q4qj4","kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5k5gf","openshift-dns/node-resolver-qkvvz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal","openshift-network-diagnostics/network-check-target-58c86"]
May 26 06:56:46.934795 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.934560    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.936664 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.936645    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:46.937444 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.937424    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 06:56:46.938668 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.938261    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ln2d6\""
May 26 06:56:46.938668 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.938481    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 06:56:46.938823 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.938709    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 06:56:46.939185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.938886    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 06:56:46.939185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.938971    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 06:56:46.939185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.939090    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 06:56:46.939567 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.939547    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 06:56:46.939643 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.939581    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 06:56:46.939643 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.939595    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hngph\""
May 26 06:56:46.939740 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.939691    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 06:56:46.941068 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.941050    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:46.943951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.943177    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.943951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.943342    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:46.943951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.943416    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 06:56:46.943951 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:46.943419    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:56:46.943951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.943690    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 06:56:46.943951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.943827    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 06:56:46.943951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.943836    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 06:56:46.943951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.943845    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-phqdf\""
May 26 06:56:46.943951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.943903    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 06:56:46.945249 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.945227    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 06:56:46.945800 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.945786    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rpcdr\""
May 26 06:56:46.948406 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.948388    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:46.948532 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.948517    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:46.950795 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.950773    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 06:56:46.951425 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.951407    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xgv2c\""
May 26 06:56:46.951425 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.951418    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sxrr6\""
May 26 06:56:46.951758 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.951739    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 06:56:46.951862 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.951847    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 06:56:46.952335 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.952099    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 06:56:46.952335 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.952212    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 06:56:46.952898 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.952879    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 06:56:46.955282 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.955252    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:56:46.955371 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.955348    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:46.957575 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.957556    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gfjm8\""
May 26 06:56:46.957710 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.957691    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:46.958027 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.957987    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 06:56:46.958116 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.958064    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 06:56:46.958206 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.957921    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tqs6h\""
May 26 06:56:46.958552 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.957891    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 06:56:46.958686 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.958669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-run-ovn\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.958816 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.958801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-log-socket\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.958917 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.958760    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 06:56:46.959026 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.958995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-os-release\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.959448 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0baaf30b-4991-4ac5-b330-c379dac4ae4a-cni-binary-copy\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.959534 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-registration-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:46.959534 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjs5r\" (UniqueName: \"kubernetes.io/projected/4f05b089-b857-4e44-81f5-86cd388b45fa-kube-api-access-vjs5r\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:46.959643 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh29c\" (UniqueName: \"kubernetes.io/projected/0801ad22-d4d0-4de1-9866-986fc02f72f3-kube-api-access-jh29c\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:46.959643 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:46.959743 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-socket-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:46.959743 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-var-lib-openvswitch\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.959845 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec043f56-b630-4ad1-b67d-de851a55d74b-env-overrides\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.959845 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-daemon-config\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.959939 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-cnibin\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:46.959939 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:46.960061 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-kubelet\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.960061 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959950    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:46.960061 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-run-netns\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.960061 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.959992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-hostroot\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.960061 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:46.960025    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:56:46.960061 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4lt\" (UniqueName: \"kubernetes.io/projected/4640d633-bd23-41d6-87a5-3be959925a6b-kube-api-access-kj4lt\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:46.960336 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-var-lib-kubelet\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.960336 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-node-log\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.960336 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-etc-kubernetes\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.960336 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960148    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:46.960336 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04835322-4daf-4aae-a36a-17bc76d04cfd-host-slash\") pod \"iptables-alerter-8v2lq\" (UID: \"04835322-4daf-4aae-a36a-17bc76d04cfd\") " pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:46.960336 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2xk4\" (UniqueName: \"kubernetes.io/projected/04835322-4daf-4aae-a36a-17bc76d04cfd-kube-api-access-k2xk4\") pod \"iptables-alerter-8v2lq\" (UID: \"04835322-4daf-4aae-a36a-17bc76d04cfd\") " pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:46.960605 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-device-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:46.960605 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-run-openvswitch\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.960605 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-cni-netd\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.960605 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-systemd-units\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.960605 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-cni-bin\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.960605 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-cni-dir\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.960887 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f05b089-b857-4e44-81f5-86cd388b45fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:46.960887 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-sys-fs\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:46.960887 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-slash\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.960887 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960802    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-run-multus-certs\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.960887 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-run-systemd\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.960887 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04835322-4daf-4aae-a36a-17bc76d04cfd-iptables-alerter-script\") pod \"iptables-alerter-8v2lq\" (UID: \"04835322-4daf-4aae-a36a-17bc76d04cfd\") " pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e93292f-83e2-4ab1-9d48-ffd8d5aee46f-agent-certs\") pod \"konnectivity-agent-q4qj4\" (UID: \"5e93292f-83e2-4ab1-9d48-ffd8d5aee46f\") " pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxxlw\" (UniqueName: \"kubernetes.io/projected/ec043f56-b630-4ad1-b67d-de851a55d74b-kube-api-access-fxxlw\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-socket-dir-parent\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64b5633d-2ef9-4a32-acb5-3679ee903ae9-host\") pod \"node-ca-nn9b9\" (UID: \"64b5633d-2ef9-4a32-acb5-3679ee903ae9\") " pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.960999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-system-cni-dir\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-run-netns\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961073    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-var-lib-cni-multus\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zttmp\" (UniqueName: \"kubernetes.io/projected/64b5633d-2ef9-4a32-acb5-3679ee903ae9-kube-api-access-zttmp\") pod \"node-ca-nn9b9\" (UID: \"64b5633d-2ef9-4a32-acb5-3679ee903ae9\") " pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961121    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f05b089-b857-4e44-81f5-86cd388b45fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-etc-openvswitch\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.961185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec043f56-b630-4ad1-b67d-de851a55d74b-ovn-node-metrics-cert\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec043f56-b630-4ad1-b67d-de851a55d74b-ovnkube-script-lib\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961237    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-run-k8s-cni-cncf-io\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-var-lib-cni-bin\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-conf-dir\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e93292f-83e2-4ab1-9d48-ffd8d5aee46f-konnectivity-ca\") pod \"konnectivity-agent-q4qj4\" (UID: \"5e93292f-83e2-4ab1-9d48-ffd8d5aee46f\") " pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f05b089-b857-4e44-81f5-86cd388b45fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec043f56-b630-4ad1-b67d-de851a55d74b-ovnkube-config\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-system-cni-dir\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz9cv\" (UniqueName: \"kubernetes.io/projected/0baaf30b-4991-4ac5-b330-c379dac4ae4a-kube-api-access-rz9cv\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64b5633d-2ef9-4a32-acb5-3679ee903ae9-serviceca\") pod \"node-ca-nn9b9\" (UID: \"64b5633d-2ef9-4a32-acb5-3679ee903ae9\") " pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-cnibin\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-os-release\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:46.961707 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-run-ovn-kubernetes\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:46.962558 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961905    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 06:56:46.962558 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961921    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 06:56:46.962558 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.961987    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dlts9\""
May 26 06:56:46.997487 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.997449    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 06:51:45 +0000 UTC" deadline="2027-10-28 08:18:37.911736977 +0000 UTC"
May 26 06:56:46.997487 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:46.997488    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12481h21m50.914252367s"
May 26 06:56:47.050281 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.050265    2564 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 06:56:47.061680 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.061626    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal" event={"ID":"0b2a8d2144f7ac516d9ab44dc2153c74","Type":"ContainerStarted","Data":"8cff8fde3ba32cbd00d8bff0ab7ae62c72af8e962bfa98a0396a10dfe7853184"}
May 26 06:56:47.062439 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062415    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.062534 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062465    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-run-ovn-kubernetes\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.062534 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-kubernetes\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.062624 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/865291d6-3c5b-4739-a036-7ea8903b6c8e-tmp-dir\") pod \"node-resolver-qkvvz\" (UID: \"865291d6-3c5b-4739-a036-7ea8903b6c8e\") " pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.062624 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062585    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-run-ovn\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.062624 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062609    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-log-socket\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.062760 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062638    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-os-release\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.062760 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062670    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0baaf30b-4991-4ac5-b330-c379dac4ae4a-cni-binary-copy\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.062760 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062718    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-registration-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.062760 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062723    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-run-ovn-kubernetes\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.062917 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062768    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjs5r\" (UniqueName: \"kubernetes.io/projected/4f05b089-b857-4e44-81f5-86cd388b45fa-kube-api-access-vjs5r\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.062917 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062781    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-registration-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.062917 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062803    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jh29c\" (UniqueName: \"kubernetes.io/projected/0801ad22-d4d0-4de1-9866-986fc02f72f3-kube-api-access-jh29c\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:47.062917 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062669    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.062917 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062840    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.062917 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.062893    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-run-ovn\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.063248 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.063221    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-log-socket\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.063448 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.063428    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0baaf30b-4991-4ac5-b330-c379dac4ae4a-cni-binary-copy\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.063551 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.063537    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-os-release\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.063608 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.063593    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-socket-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.063649 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.063632    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-var-lib-openvswitch\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.063691 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.063663    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.063691 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.063667    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec043f56-b630-4ad1-b67d-de851a55d74b-env-overrides\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.063774 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.063742    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-var-lib-openvswitch\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.064171 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064152    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec043f56-b630-4ad1-b67d-de851a55d74b-env-overrides\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.064282 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064266    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-socket-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.064329 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064309    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-daemon-config\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.064371 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064336    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-cnibin\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.064371 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064364    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.064456 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064391    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-kubelet\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.064456 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064419    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-run-netns\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.064456 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064446    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-hostroot\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.064575 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-systemd\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.064575 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064522    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-run-netns\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.064662 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkvzx\" (UniqueName: \"kubernetes.io/projected/865291d6-3c5b-4739-a036-7ea8903b6c8e-kube-api-access-hkvzx\") pod \"node-resolver-qkvvz\" (UID: \"865291d6-3c5b-4739-a036-7ea8903b6c8e\") " pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.064662 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064592    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-hostroot\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.064662 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064597    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-cnibin\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.064662 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064615    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4lt\" (UniqueName: \"kubernetes.io/projected/4640d633-bd23-41d6-87a5-3be959925a6b-kube-api-access-kj4lt\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.064845 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064664    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-var-lib-kubelet\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.064845 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064685    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.064845 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064757    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-var-lib-kubelet\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.064978 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064923    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-kubelet\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.064978 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.064957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-sys\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.065091 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-lib-modules\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.065144 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/865291d6-3c5b-4739-a036-7ea8903b6c8e-hosts-file\") pod \"node-resolver-qkvvz\" (UID: \"865291d6-3c5b-4739-a036-7ea8903b6c8e\") " pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.065191 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065144    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-daemon-config\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.065191 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065137    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-node-log\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.065285 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065247    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-etc-kubernetes\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.065285 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065251    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-node-log\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.065285 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-host\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.065397 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065325    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:47.065397 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065331    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-etc-kubernetes\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.065397 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.065375    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04835322-4daf-4aae-a36a-17bc76d04cfd-host-slash\") pod \"iptables-alerter-8v2lq\" (UID: \"04835322-4daf-4aae-a36a-17bc76d04cfd\") " pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:47.066602 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.066583    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:47.066602 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066581    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2xk4\" (UniqueName: \"kubernetes.io/projected/04835322-4daf-4aae-a36a-17bc76d04cfd-kube-api-access-k2xk4\") pod \"iptables-alerter-8v2lq\" (UID: \"04835322-4daf-4aae-a36a-17bc76d04cfd\") " pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:47.066745 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066630    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-device-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.066745 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.066676    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs podName:0801ad22-d4d0-4de1-9866-986fc02f72f3 nodeName:}" failed. No retries permitted until 2026-05-26 06:56:47.56664171 +0000 UTC m=+3.128997403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs") pod "network-metrics-daemon-q4gb7" (UID: "0801ad22-d4d0-4de1-9866-986fc02f72f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:47.066745 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066712    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-run-openvswitch\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.066745 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066721    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-device-dir\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.066745 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066741    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-cni-netd\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.066971 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066755    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04835322-4daf-4aae-a36a-17bc76d04cfd-host-slash\") pod \"iptables-alerter-8v2lq\" (UID: \"04835322-4daf-4aae-a36a-17bc76d04cfd\") " pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:47.066971 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93869d12-39bb-40f3-9529-edd714d8c0cc-tmp\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.066971 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066794    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-systemd-units\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.066971 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066817    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-cni-bin\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.066971 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066838    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-cni-dir\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.066971 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-run\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.066971 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066886    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f05b089-b857-4e44-81f5-86cd388b45fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066954    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-sys-fs\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067031    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-slash\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067083    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-slash\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067105    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-cni-dir\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.066736    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal" event={"ID":"1ad3d1c4ba6c2ff0bb291a936631deb2","Type":"ContainerStarted","Data":"50a7a2bb8ecc6bda29eab1774bd21ca83739a58d3236828b5d2f8e0747398360"}
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067159    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-run-multus-certs\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067233    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4640d633-bd23-41d6-87a5-3be959925a6b-sys-fs\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067266    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-run-multus-certs\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067272    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-run-openvswitch\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.067293 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067279    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-cni-bin\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-modprobe-d\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067307    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-cni-netd\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067321    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-systemd-units\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-sysctl-conf\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067408    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-run-systemd\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067444    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-run-systemd\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067445    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04835322-4daf-4aae-a36a-17bc76d04cfd-iptables-alerter-script\") pod \"iptables-alerter-8v2lq\" (UID: \"04835322-4daf-4aae-a36a-17bc76d04cfd\") " pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067490    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e93292f-83e2-4ab1-9d48-ffd8d5aee46f-agent-certs\") pod \"konnectivity-agent-q4qj4\" (UID: \"5e93292f-83e2-4ab1-9d48-ffd8d5aee46f\") " pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067588    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxxlw\" (UniqueName: \"kubernetes.io/projected/ec043f56-b630-4ad1-b67d-de851a55d74b-kube-api-access-fxxlw\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067606    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-socket-dir-parent\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067612    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f05b089-b857-4e44-81f5-86cd388b45fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-sysctl-d\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067675    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-socket-dir-parent\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.067730 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067745    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64b5633d-2ef9-4a32-acb5-3679ee903ae9-host\") pod \"node-ca-nn9b9\" (UID: \"64b5633d-2ef9-4a32-acb5-3679ee903ae9\") " pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067770    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-system-cni-dir\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067785    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-run-netns\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067802    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-var-lib-cni-multus\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067825    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zttmp\" (UniqueName: \"kubernetes.io/projected/64b5633d-2ef9-4a32-acb5-3679ee903ae9-kube-api-access-zttmp\") pod \"node-ca-nn9b9\" (UID: \"64b5633d-2ef9-4a32-acb5-3679ee903ae9\") " pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067850    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f05b089-b857-4e44-81f5-86cd388b45fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067862    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-run-netns\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067873    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-etc-openvswitch\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067881    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-system-cni-dir\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067896    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec043f56-b630-4ad1-b67d-de851a55d74b-ovn-node-metrics-cert\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067936    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04835322-4daf-4aae-a36a-17bc76d04cfd-iptables-alerter-script\") pod \"iptables-alerter-8v2lq\" (UID: \"04835322-4daf-4aae-a36a-17bc76d04cfd\") " pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067946    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-etc-openvswitch\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067956    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-var-lib-cni-multus\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067974    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.067979    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64b5633d-2ef9-4a32-acb5-3679ee903ae9-host\") pod \"node-ca-nn9b9\" (UID: \"64b5633d-2ef9-4a32-acb5-3679ee903ae9\") " pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068035    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec043f56-b630-4ad1-b67d-de851a55d74b-ovnkube-script-lib\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068062    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-run-k8s-cni-cncf-io\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.068328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068087    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-var-lib-cni-bin\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068112    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-conf-dir\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068135    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e93292f-83e2-4ab1-9d48-ffd8d5aee46f-konnectivity-ca\") pod \"konnectivity-agent-q4qj4\" (UID: \"5e93292f-83e2-4ab1-9d48-ffd8d5aee46f\") " pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068139    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-run-k8s-cni-cncf-io\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068159    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f05b089-b857-4e44-81f5-86cd388b45fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068186    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-multus-conf-dir\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068183    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec043f56-b630-4ad1-b67d-de851a55d74b-ovnkube-config\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068225    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-system-cni-dir\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068249    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rz9cv\" (UniqueName: \"kubernetes.io/projected/0baaf30b-4991-4ac5-b330-c379dac4ae4a-kube-api-access-rz9cv\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068277    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-sysconfig\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-var-lib-kubelet\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-tuned\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068347    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64b5633d-2ef9-4a32-acb5-3679ee903ae9-serviceca\") pod \"node-ca-nn9b9\" (UID: \"64b5633d-2ef9-4a32-acb5-3679ee903ae9\") " pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068373    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068397    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-cnibin\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xb9t\" (UniqueName: \"kubernetes.io/projected/93869d12-39bb-40f3-9529-edd714d8c0cc-kube-api-access-5xb9t\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068451    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-os-release\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.069129 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068532    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f05b089-b857-4e44-81f5-86cd388b45fa-os-release\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068575    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-host-var-lib-cni-bin\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068598    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec043f56-b630-4ad1-b67d-de851a55d74b-ovnkube-script-lib\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068616    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-system-cni-dir\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068741    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec043f56-b630-4ad1-b67d-de851a55d74b-ovnkube-config\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068811    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0baaf30b-4991-4ac5-b330-c379dac4ae4a-cnibin\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068824    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e93292f-83e2-4ab1-9d48-ffd8d5aee46f-konnectivity-ca\") pod \"konnectivity-agent-q4qj4\" (UID: \"5e93292f-83e2-4ab1-9d48-ffd8d5aee46f\") " pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068810    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec043f56-b630-4ad1-b67d-de851a55d74b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068869    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f05b089-b857-4e44-81f5-86cd388b45fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.068959    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f05b089-b857-4e44-81f5-86cd388b45fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.069886 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.069054    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64b5633d-2ef9-4a32-acb5-3679ee903ae9-serviceca\") pod \"node-ca-nn9b9\" (UID: \"64b5633d-2ef9-4a32-acb5-3679ee903ae9\") " pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:47.071902 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.071879    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e93292f-83e2-4ab1-9d48-ffd8d5aee46f-agent-certs\") pod \"konnectivity-agent-q4qj4\" (UID: \"5e93292f-83e2-4ab1-9d48-ffd8d5aee46f\") " pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:56:47.072721 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.072697    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec043f56-b630-4ad1-b67d-de851a55d74b-ovn-node-metrics-cert\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.074074 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.073983    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh29c\" (UniqueName: \"kubernetes.io/projected/0801ad22-d4d0-4de1-9866-986fc02f72f3-kube-api-access-jh29c\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:47.075262 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.075110    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjs5r\" (UniqueName: \"kubernetes.io/projected/4f05b089-b857-4e44-81f5-86cd388b45fa-kube-api-access-vjs5r\") pod \"multus-additional-cni-plugins-j5bdr\" (UID: \"4f05b089-b857-4e44-81f5-86cd388b45fa\") " pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.075262 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.075182    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4lt\" (UniqueName: \"kubernetes.io/projected/4640d633-bd23-41d6-87a5-3be959925a6b-kube-api-access-kj4lt\") pod \"aws-ebs-csi-driver-node-q7jh6\" (UID: \"4640d633-bd23-41d6-87a5-3be959925a6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.077277 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.077257    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2xk4\" (UniqueName: \"kubernetes.io/projected/04835322-4daf-4aae-a36a-17bc76d04cfd-kube-api-access-k2xk4\") pod \"iptables-alerter-8v2lq\" (UID: \"04835322-4daf-4aae-a36a-17bc76d04cfd\") " pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:47.082200 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.082177    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zttmp\" (UniqueName: \"kubernetes.io/projected/64b5633d-2ef9-4a32-acb5-3679ee903ae9-kube-api-access-zttmp\") pod \"node-ca-nn9b9\" (UID: \"64b5633d-2ef9-4a32-acb5-3679ee903ae9\") " pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:47.083303 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.083282    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz9cv\" (UniqueName: \"kubernetes.io/projected/0baaf30b-4991-4ac5-b330-c379dac4ae4a-kube-api-access-rz9cv\") pod \"multus-z9rzq\" (UID: \"0baaf30b-4991-4ac5-b330-c379dac4ae4a\") " pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.083495 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.083474    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxxlw\" (UniqueName: \"kubernetes.io/projected/ec043f56-b630-4ad1-b67d-de851a55d74b-kube-api-access-fxxlw\") pod \"ovnkube-node-8zhkh\" (UID: \"ec043f56-b630-4ad1-b67d-de851a55d74b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.116813 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.115502    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:56:47.168849 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.168821    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-modprobe-d\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.168989 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.168860    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-sysctl-conf\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.168989 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.168888    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-sysctl-d\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.168989 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.168914    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:47.168989 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.168948    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-sysconfig\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.168989 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.168975    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-var-lib-kubelet\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169000    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-tuned\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169023    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-modprobe-d\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169035    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-sysctl-d\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169043    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xb9t\" (UniqueName: \"kubernetes.io/projected/93869d12-39bb-40f3-9529-edd714d8c0cc-kube-api-access-5xb9t\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169048    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-sysctl-conf\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169088    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-kubernetes\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169095    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-sysconfig\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169100    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-var-lib-kubelet\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169115    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/865291d6-3c5b-4739-a036-7ea8903b6c8e-tmp-dir\") pod \"node-resolver-qkvvz\" (UID: \"865291d6-3c5b-4739-a036-7ea8903b6c8e\") " pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169246    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-systemd\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169252    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-kubernetes\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169261 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169268    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkvzx\" (UniqueName: \"kubernetes.io/projected/865291d6-3c5b-4739-a036-7ea8903b6c8e-kube-api-access-hkvzx\") pod \"node-resolver-qkvvz\" (UID: \"865291d6-3c5b-4739-a036-7ea8903b6c8e\") " pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169316    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-systemd\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169344    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-sys\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169368    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-lib-modules\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169388    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/865291d6-3c5b-4739-a036-7ea8903b6c8e-hosts-file\") pod \"node-resolver-qkvvz\" (UID: \"865291d6-3c5b-4739-a036-7ea8903b6c8e\") " pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169410    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-host\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169441    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/865291d6-3c5b-4739-a036-7ea8903b6c8e-tmp-dir\") pod \"node-resolver-qkvvz\" (UID: \"865291d6-3c5b-4739-a036-7ea8903b6c8e\") " pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169451    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93869d12-39bb-40f3-9529-edd714d8c0cc-tmp\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169409    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-sys\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169491    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-run\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169494    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-host\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169536    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/865291d6-3c5b-4739-a036-7ea8903b6c8e-hosts-file\") pod \"node-resolver-qkvvz\" (UID: \"865291d6-3c5b-4739-a036-7ea8903b6c8e\") " pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169555    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-run\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.169791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.169570    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93869d12-39bb-40f3-9529-edd714d8c0cc-lib-modules\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.171465 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.171444    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93869d12-39bb-40f3-9529-edd714d8c0cc-etc-tuned\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.171571 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.171554    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93869d12-39bb-40f3-9529-edd714d8c0cc-tmp\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.178239 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.178185    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:56:47.178239 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.178207    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:56:47.178239 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.178219    2564 projected.go:194] Error preparing data for projected volume kube-api-access-c2bcw for pod openshift-network-diagnostics/network-check-target-58c86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:47.178450 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.178284    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw podName:c3147f4f-fad0-4325-9137-e80f70229ae6 nodeName:}" failed. No retries permitted until 2026-05-26 06:56:47.678269514 +0000 UTC m=+3.240625199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c2bcw" (UniqueName: "kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw") pod "network-check-target-58c86" (UID: "c3147f4f-fad0-4325-9137-e80f70229ae6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:47.178704 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.178673    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkvzx\" (UniqueName: \"kubernetes.io/projected/865291d6-3c5b-4739-a036-7ea8903b6c8e-kube-api-access-hkvzx\") pod \"node-resolver-qkvvz\" (UID: \"865291d6-3c5b-4739-a036-7ea8903b6c8e\") " pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.179796 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.179776    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xb9t\" (UniqueName: \"kubernetes.io/projected/93869d12-39bb-40f3-9529-edd714d8c0cc-kube-api-access-5xb9t\") pod \"tuned-5k5gf\" (UID: \"93869d12-39bb-40f3-9529-edd714d8c0cc\") " pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.247277 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.247244    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:56:47.257322 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.257299    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nn9b9"
May 26 06:56:47.275258 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.275234    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5bdr"
May 26 06:56:47.279934 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.279913    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z9rzq"
May 26 06:56:47.288515 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.288495    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8v2lq"
May 26 06:56:47.296111 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.296089    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6"
May 26 06:56:47.303700 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.303678    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:56:47.311254 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.311237    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5k5gf"
May 26 06:56:47.316753 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.316738    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qkvvz"
May 26 06:56:47.571646 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.571618    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:47.571837 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.571743    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:47.571837 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.571808    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs podName:0801ad22-d4d0-4de1-9866-986fc02f72f3 nodeName:}" failed. No retries permitted until 2026-05-26 06:56:48.571787158 +0000 UTC m=+4.134142830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs") pod "network-metrics-daemon-q4gb7" (UID: "0801ad22-d4d0-4de1-9866-986fc02f72f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:47.773245 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.773216    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:47.773415 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.773335    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:56:47.773415 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.773349    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:56:47.773415 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.773359    2564 projected.go:194] Error preparing data for projected volume kube-api-access-c2bcw for pod openshift-network-diagnostics/network-check-target-58c86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:47.773415 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:47.773410    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw podName:c3147f4f-fad0-4325-9137-e80f70229ae6 nodeName:}" failed. No retries permitted until 2026-05-26 06:56:48.773396473 +0000 UTC m=+4.335752144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2bcw" (UniqueName: "kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw") pod "network-check-target-58c86" (UID: "c3147f4f-fad0-4325-9137-e80f70229ae6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:47.903288 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:47.903258    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e93292f_83e2_4ab1_9d48_ffd8d5aee46f.slice/crio-7b70aa5e050ab9e6aeca57bedd770c09965301c74f6947e987592c42546868df WatchSource:0}: Error finding container 7b70aa5e050ab9e6aeca57bedd770c09965301c74f6947e987592c42546868df: Status 404 returned error can't find the container with id 7b70aa5e050ab9e6aeca57bedd770c09965301c74f6947e987592c42546868df
May 26 06:56:47.906331 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:47.906305    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04835322_4daf_4aae_a36a_17bc76d04cfd.slice/crio-a76137e4729e1af1b36064f6cd2a939040500e9066edc252254f552af4d59071 WatchSource:0}: Error finding container a76137e4729e1af1b36064f6cd2a939040500e9066edc252254f552af4d59071: Status 404 returned error can't find the container with id a76137e4729e1af1b36064f6cd2a939040500e9066edc252254f552af4d59071
May 26 06:56:47.909952 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:47.909917    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4640d633_bd23_41d6_87a5_3be959925a6b.slice/crio-c14d50e6e7c8f0d92c0a2effe60f5cb7cf97f480560f992fb163fdc5bc81e93e WatchSource:0}: Error finding container c14d50e6e7c8f0d92c0a2effe60f5cb7cf97f480560f992fb163fdc5bc81e93e: Status 404 returned error can't find the container with id c14d50e6e7c8f0d92c0a2effe60f5cb7cf97f480560f992fb163fdc5bc81e93e
May 26 06:56:47.910846 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:47.910821    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0baaf30b_4991_4ac5_b330_c379dac4ae4a.slice/crio-0195b87ab1218e8579bc42dff3847ab702d2a3c6fba0da247a6cc853bdf9a97c WatchSource:0}: Error finding container 0195b87ab1218e8579bc42dff3847ab702d2a3c6fba0da247a6cc853bdf9a97c: Status 404 returned error can't find the container with id 0195b87ab1218e8579bc42dff3847ab702d2a3c6fba0da247a6cc853bdf9a97c
May 26 06:56:47.911844 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:47.911828    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f05b089_b857_4e44_81f5_86cd388b45fa.slice/crio-8d7b8884aade1effe63ba889f32e586f800b1ce17f7f0241d49b421cfe126929 WatchSource:0}: Error finding container 8d7b8884aade1effe63ba889f32e586f800b1ce17f7f0241d49b421cfe126929: Status 404 returned error can't find the container with id 8d7b8884aade1effe63ba889f32e586f800b1ce17f7f0241d49b421cfe126929
May 26 06:56:47.916529 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:47.916476    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec043f56_b630_4ad1_b67d_de851a55d74b.slice/crio-c60e1aa1d18c2fb035336ce8d3a7f5be087afcad414e4bde950b027748908743 WatchSource:0}: Error finding container c60e1aa1d18c2fb035336ce8d3a7f5be087afcad414e4bde950b027748908743: Status 404 returned error can't find the container with id c60e1aa1d18c2fb035336ce8d3a7f5be087afcad414e4bde950b027748908743
May 26 06:56:47.918516 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:56:47.918493    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865291d6_3c5b_4739_a036_7ea8903b6c8e.slice/crio-512ca3d7f7eb8ade59e46c7b65de39e2b6c53687d82c8d1fec9cbf4055a5908b WatchSource:0}: Error finding container 512ca3d7f7eb8ade59e46c7b65de39e2b6c53687d82c8d1fec9cbf4055a5908b: Status 404 returned error can't find the container with id 512ca3d7f7eb8ade59e46c7b65de39e2b6c53687d82c8d1fec9cbf4055a5908b
May 26 06:56:47.998208 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.998086    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 06:51:45 +0000 UTC" deadline="2028-02-02 08:51:42.1350607 +0000 UTC"
May 26 06:56:47.998208 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:47.998204    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14809h54m54.136859222s"
May 26 06:56:48.070180 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.070143    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal" event={"ID":"1ad3d1c4ba6c2ff0bb291a936631deb2","Type":"ContainerStarted","Data":"726a493429049338b49f072506b63b5094e309ba91efd7309f0f56c83421645c"}
May 26 06:56:48.073723 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.073680    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qkvvz" event={"ID":"865291d6-3c5b-4739-a036-7ea8903b6c8e","Type":"ContainerStarted","Data":"512ca3d7f7eb8ade59e46c7b65de39e2b6c53687d82c8d1fec9cbf4055a5908b"}
May 26 06:56:48.074678 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.074658    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5k5gf" event={"ID":"93869d12-39bb-40f3-9529-edd714d8c0cc","Type":"ContainerStarted","Data":"7dece15ddccfd202dc1c6ce87fba4a271c3bd5ee18d0d61dbcb6d7127297645f"}
May 26 06:56:48.075699 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.075674    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nn9b9" event={"ID":"64b5633d-2ef9-4a32-acb5-3679ee903ae9","Type":"ContainerStarted","Data":"a57f9f5afb4861e54bea1a796275dd41cf948df066f96d1ceece80f685d06548"}
May 26 06:56:48.076726 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.076694    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" event={"ID":"4f05b089-b857-4e44-81f5-86cd388b45fa","Type":"ContainerStarted","Data":"8d7b8884aade1effe63ba889f32e586f800b1ce17f7f0241d49b421cfe126929"}
May 26 06:56:48.077897 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.077870    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8v2lq" event={"ID":"04835322-4daf-4aae-a36a-17bc76d04cfd","Type":"ContainerStarted","Data":"a76137e4729e1af1b36064f6cd2a939040500e9066edc252254f552af4d59071"}
May 26 06:56:48.078802 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.078779    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q4qj4" event={"ID":"5e93292f-83e2-4ab1-9d48-ffd8d5aee46f","Type":"ContainerStarted","Data":"7b70aa5e050ab9e6aeca57bedd770c09965301c74f6947e987592c42546868df"}
May 26 06:56:48.079915 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.079888    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerStarted","Data":"c60e1aa1d18c2fb035336ce8d3a7f5be087afcad414e4bde950b027748908743"}
May 26 06:56:48.080898 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.080867    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z9rzq" event={"ID":"0baaf30b-4991-4ac5-b330-c379dac4ae4a","Type":"ContainerStarted","Data":"0195b87ab1218e8579bc42dff3847ab702d2a3c6fba0da247a6cc853bdf9a97c"}
May 26 06:56:48.081956 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.081937    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6" event={"ID":"4640d633-bd23-41d6-87a5-3be959925a6b","Type":"ContainerStarted","Data":"c14d50e6e7c8f0d92c0a2effe60f5cb7cf97f480560f992fb163fdc5bc81e93e"}
May 26 06:56:48.083039 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.082974    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-143.ec2.internal" podStartSLOduration=2.08296409 podStartE2EDuration="2.08296409s" podCreationTimestamp="2026-05-26 06:56:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:56:48.082710373 +0000 UTC m=+3.645066069" watchObservedRunningTime="2026-05-26 06:56:48.08296409 +0000 UTC m=+3.645319781"
May 26 06:56:48.582938 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.582378    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:48.582938 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:48.582525    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:48.582938 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:48.582594    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs podName:0801ad22-d4d0-4de1-9866-986fc02f72f3 nodeName:}" failed. No retries permitted until 2026-05-26 06:56:50.582573686 +0000 UTC m=+6.144929381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs") pod "network-metrics-daemon-q4gb7" (UID: "0801ad22-d4d0-4de1-9866-986fc02f72f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:48.785328 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:48.784664    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:48.785328 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:48.784862    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:56:48.785328 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:48.784889    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:56:48.785328 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:48.784903    2564 projected.go:194] Error preparing data for projected volume kube-api-access-c2bcw for pod openshift-network-diagnostics/network-check-target-58c86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:48.785328 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:48.784964    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw podName:c3147f4f-fad0-4325-9137-e80f70229ae6 nodeName:}" failed. No retries permitted until 2026-05-26 06:56:50.784945485 +0000 UTC m=+6.347301177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2bcw" (UniqueName: "kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw") pod "network-check-target-58c86" (UID: "c3147f4f-fad0-4325-9137-e80f70229ae6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:49.056254 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:49.056164    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:49.056685 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:49.056312    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:56:49.058378 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:49.058355    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:49.058488 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:49.058454    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:56:49.092751 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:49.092722    2564 generic.go:358] "Generic (PLEG): container finished" podID="0b2a8d2144f7ac516d9ab44dc2153c74" containerID="82a13f6ca46a6f72b98127a6e91c86d021c3354f767ee36cf9157b1d25db277d" exitCode=0
May 26 06:56:49.092889 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:49.092801    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal" event={"ID":"0b2a8d2144f7ac516d9ab44dc2153c74","Type":"ContainerDied","Data":"82a13f6ca46a6f72b98127a6e91c86d021c3354f767ee36cf9157b1d25db277d"}
May 26 06:56:50.109218 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:50.109179    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal" event={"ID":"0b2a8d2144f7ac516d9ab44dc2153c74","Type":"ContainerStarted","Data":"571c1fc39a3c4d5c16ad75a9df46d260dd5dc2be9ec0d2dc7db7276737a5b4a0"}
May 26 06:56:50.600558 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:50.600514    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:50.600749 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:50.600697    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:50.600811 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:50.600761    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs podName:0801ad22-d4d0-4de1-9866-986fc02f72f3 nodeName:}" failed. No retries permitted until 2026-05-26 06:56:54.600741775 +0000 UTC m=+10.163097462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs") pod "network-metrics-daemon-q4gb7" (UID: "0801ad22-d4d0-4de1-9866-986fc02f72f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:50.802106 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:50.802067    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:50.802288 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:50.802246    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:56:50.802288 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:50.802265    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:56:50.802288 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:50.802278    2564 projected.go:194] Error preparing data for projected volume kube-api-access-c2bcw for pod openshift-network-diagnostics/network-check-target-58c86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:50.802591 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:50.802340    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw podName:c3147f4f-fad0-4325-9137-e80f70229ae6 nodeName:}" failed. No retries permitted until 2026-05-26 06:56:54.802322531 +0000 UTC m=+10.364678216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2bcw" (UniqueName: "kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw") pod "network-check-target-58c86" (UID: "c3147f4f-fad0-4325-9137-e80f70229ae6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:51.055442 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:51.055365    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:51.055592 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:51.055499    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:56:51.057858 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:51.057830    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:51.057991 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:51.057967    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:56:53.054804 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:53.054756    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:53.055322 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:53.054882    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:56:53.055322 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:53.055140    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:53.055322 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:53.055253    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:56:54.632849 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:54.632765    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:54.633298 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:54.632914    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:54.633298 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:54.633047    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs podName:0801ad22-d4d0-4de1-9866-986fc02f72f3 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:02.633024419 +0000 UTC m=+18.195380105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs") pod "network-metrics-daemon-q4gb7" (UID: "0801ad22-d4d0-4de1-9866-986fc02f72f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:56:54.834085 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:54.834051    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:54.834276 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:54.834237    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:56:54.834276 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:54.834257    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:56:54.834276 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:54.834270    2564 projected.go:194] Error preparing data for projected volume kube-api-access-c2bcw for pod openshift-network-diagnostics/network-check-target-58c86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:54.834428 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:54.834327    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw podName:c3147f4f-fad0-4325-9137-e80f70229ae6 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:02.834309196 +0000 UTC m=+18.396664870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2bcw" (UniqueName: "kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw") pod "network-check-target-58c86" (UID: "c3147f4f-fad0-4325-9137-e80f70229ae6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:56:55.057595 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:55.057503    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:55.057754 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:55.057659    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:56:55.057754 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:55.057725    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:55.057853 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:55.057795    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:56:57.055709 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:57.055675    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:57.055709 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:57.055716    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:57.056250 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:57.055804    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:56:57.056250 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:57.055920    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:56:58.637581 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.637510    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-143.ec2.internal" podStartSLOduration=12.637490507 podStartE2EDuration="12.637490507s" podCreationTimestamp="2026-05-26 06:56:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:56:50.125938034 +0000 UTC m=+5.688293730" watchObservedRunningTime="2026-05-26 06:56:58.637490507 +0000 UTC m=+14.199846200"
May 26 06:56:58.638287 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.638236    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gsdx9"]
May 26 06:56:58.642442 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.642415    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:58.642539 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:58.642491    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:56:58.765286 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.765252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89a930c8-bcd2-44f5-9039-a2e0789bb89a-kubelet-config\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:58.765443 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.765386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89a930c8-bcd2-44f5-9039-a2e0789bb89a-dbus\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:58.765504 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.765445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:58.866666 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.866633    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89a930c8-bcd2-44f5-9039-a2e0789bb89a-kubelet-config\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:58.866827 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.866794    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89a930c8-bcd2-44f5-9039-a2e0789bb89a-kubelet-config\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:58.866827 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.866808    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89a930c8-bcd2-44f5-9039-a2e0789bb89a-dbus\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:58.866919 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.866864    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:58.866963 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:58.866942    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89a930c8-bcd2-44f5-9039-a2e0789bb89a-dbus\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:58.867032 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:58.866989    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:56:58.867072 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:58.867063    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret podName:89a930c8-bcd2-44f5-9039-a2e0789bb89a nodeName:}" failed. No retries permitted until 2026-05-26 06:56:59.367044669 +0000 UTC m=+14.929400346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret") pod "global-pull-secret-syncer-gsdx9" (UID: "89a930c8-bcd2-44f5-9039-a2e0789bb89a") : object "kube-system"/"original-pull-secret" not registered
May 26 06:56:59.057400 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:59.057323    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:56:59.057400 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:59.057361    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:56:59.057631 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:59.057439    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:56:59.057631 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:59.057598    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:56:59.370563 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:56:59.370525    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:56:59.370746 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:59.370652    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:56:59.370746 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:56:59.370715    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret podName:89a930c8-bcd2-44f5-9039-a2e0789bb89a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:00.370688638 +0000 UTC m=+15.933044311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret") pod "global-pull-secret-syncer-gsdx9" (UID: "89a930c8-bcd2-44f5-9039-a2e0789bb89a") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:00.054872 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:00.054838    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:00.055282 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:00.054950    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:00.376436 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:00.376399    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:00.376676 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:00.376567    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:00.376676 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:00.376649    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret podName:89a930c8-bcd2-44f5-9039-a2e0789bb89a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:02.376625322 +0000 UTC m=+17.938981017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret") pod "global-pull-secret-syncer-gsdx9" (UID: "89a930c8-bcd2-44f5-9039-a2e0789bb89a") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:01.059098 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:01.059070    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:01.059098 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:01.059087    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:01.059519 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:01.059166    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:01.059519 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:01.059330    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:02.055427 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:02.055397    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:02.055571 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:02.055488    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:02.391855 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:02.391810    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:02.392323 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:02.391916    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:02.392323 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:02.391993    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret podName:89a930c8-bcd2-44f5-9039-a2e0789bb89a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:06.391977992 +0000 UTC m=+21.954333665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret") pod "global-pull-secret-syncer-gsdx9" (UID: "89a930c8-bcd2-44f5-9039-a2e0789bb89a") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:02.694272 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:02.694176    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:02.694419 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:02.694355    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:02.694481 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:02.694433    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs podName:0801ad22-d4d0-4de1-9866-986fc02f72f3 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:18.694411416 +0000 UTC m=+34.256767088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs") pod "network-metrics-daemon-q4gb7" (UID: "0801ad22-d4d0-4de1-9866-986fc02f72f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:02.895541 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:02.895509    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:02.895727 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:02.895661    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:57:02.895727 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:02.895680    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:57:02.895727 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:02.895690    2564 projected.go:194] Error preparing data for projected volume kube-api-access-c2bcw for pod openshift-network-diagnostics/network-check-target-58c86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:02.895880 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:02.895766    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw podName:c3147f4f-fad0-4325-9137-e80f70229ae6 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:18.8957484 +0000 UTC m=+34.458104091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2bcw" (UniqueName: "kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw") pod "network-check-target-58c86" (UID: "c3147f4f-fad0-4325-9137-e80f70229ae6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:03.054853 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:03.054787    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:03.054853 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:03.054825    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:03.055063 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:03.054933    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:03.055063 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:03.055039    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:04.055638 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:04.055606    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:04.056099 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:04.055744    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:05.057970 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:05.057936    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:05.058415 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:05.058101    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:05.058415 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:05.058097    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:05.058415 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:05.058200    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:06.054920 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:06.054816    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:06.054920 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:06.054914    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:06.140862 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:06.140667    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nn9b9" event={"ID":"64b5633d-2ef9-4a32-acb5-3679ee903ae9","Type":"ContainerStarted","Data":"e17112380169696a6b8478ef9816e5738db75ac08c2a99db2617c29b462c3369"}
May 26 06:57:06.143303 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:06.143058    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" event={"ID":"4f05b089-b857-4e44-81f5-86cd388b45fa","Type":"ContainerStarted","Data":"aaf8ecf617aee4cf9d02d5dff89bd4ea23b888ded853d02153512814e81de1df"}
May 26 06:57:06.147779 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:06.147646    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qkvvz" event={"ID":"865291d6-3c5b-4739-a036-7ea8903b6c8e","Type":"ContainerStarted","Data":"ce08ef6bd7e0c2b1a8a504d6e5a2d47cc97c9b9540ea49e4e00548fb2621cae4"}
May 26 06:57:06.168615 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:06.168564    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nn9b9" podStartSLOduration=3.286899014 podStartE2EDuration="21.168549327s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:56:47.916746476 +0000 UTC m=+3.479102156" lastFinishedPulling="2026-05-26 06:57:05.798396789 +0000 UTC m=+21.360752469" observedRunningTime="2026-05-26 06:57:06.156140828 +0000 UTC m=+21.718496524" watchObservedRunningTime="2026-05-26 06:57:06.168549327 +0000 UTC m=+21.730905022"
May 26 06:57:06.189922 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:06.189408    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qkvvz" podStartSLOduration=3.330159654 podStartE2EDuration="21.189387693s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:56:47.939222261 +0000 UTC m=+3.501577936" lastFinishedPulling="2026-05-26 06:57:05.798450296 +0000 UTC m=+21.360805975" observedRunningTime="2026-05-26 06:57:06.16944038 +0000 UTC m=+21.731796101" watchObservedRunningTime="2026-05-26 06:57:06.189387693 +0000 UTC m=+21.751743388"
May 26 06:57:06.423781 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:06.423751    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:06.423894 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:06.423879    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:06.423966 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:06.423953    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret podName:89a930c8-bcd2-44f5-9039-a2e0789bb89a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:14.423934496 +0000 UTC m=+29.986290171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret") pod "global-pull-secret-syncer-gsdx9" (UID: "89a930c8-bcd2-44f5-9039-a2e0789bb89a") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:07.054920 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.054739    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:07.055122 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.054744    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:07.055122 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:07.054990    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:07.055122 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:07.055092    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:07.151065 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.151032    2564 generic.go:358] "Generic (PLEG): container finished" podID="4f05b089-b857-4e44-81f5-86cd388b45fa" containerID="aaf8ecf617aee4cf9d02d5dff89bd4ea23b888ded853d02153512814e81de1df" exitCode=0
May 26 06:57:07.151848 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.151101    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" event={"ID":"4f05b089-b857-4e44-81f5-86cd388b45fa","Type":"ContainerDied","Data":"aaf8ecf617aee4cf9d02d5dff89bd4ea23b888ded853d02153512814e81de1df"}
May 26 06:57:07.152632 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.152597    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q4qj4" event={"ID":"5e93292f-83e2-4ab1-9d48-ffd8d5aee46f","Type":"ContainerStarted","Data":"08ca5a94b0c9f34ea5c9b234a54bd3c6ac9ee159de27f02c857879c950bb271e"}
May 26 06:57:07.157158 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.157136    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 06:57:07.157688 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.157651    2564 generic.go:358] "Generic (PLEG): container finished" podID="ec043f56-b630-4ad1-b67d-de851a55d74b" containerID="6128431b5f63fe9aeb109cff850c6968c333b502689fd6b455ce6f5eedbd66b4" exitCode=1
May 26 06:57:07.157800 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.157712    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerStarted","Data":"9642a609795f91e2481a2cf3b3a0b5513026e80b95f33e1281e032af99a2cfcd"}
May 26 06:57:07.157800 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.157743    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerStarted","Data":"5ec4ff7775dd0250bf309b3cc768687841609765400324ff5c8040f77871ed89"}
May 26 06:57:07.157800 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.157756    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerStarted","Data":"ab368bcb368b791eb31e8ce8c875aac757cf91be7d7ce98c9219fb395441f93f"}
May 26 06:57:07.157800 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.157767    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerStarted","Data":"0255c6d421ce4cfaae22f80a611ff32e5d7bafc91c49a29482485677cbe22702"}
May 26 06:57:07.157800 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.157779    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerDied","Data":"6128431b5f63fe9aeb109cff850c6968c333b502689fd6b455ce6f5eedbd66b4"}
May 26 06:57:07.157800 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.157793    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerStarted","Data":"ef16e8255469c354092b439b041de36a87d3c3be55a0ef8419f060f536c4e1bf"}
May 26 06:57:07.159317 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.159294    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z9rzq" event={"ID":"0baaf30b-4991-4ac5-b330-c379dac4ae4a","Type":"ContainerStarted","Data":"389ed8ad9170d36b5be6c695e132168cd6d8d81a90c7c1f7c8a824a27d11e114"}
May 26 06:57:07.160683 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.160662    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6" event={"ID":"4640d633-bd23-41d6-87a5-3be959925a6b","Type":"ContainerStarted","Data":"77dff3ea416f201e69317b14cdb99a702ed263395dd1a31b6eb6cdbd61ba6348"}
May 26 06:57:07.162031 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.161995    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5k5gf" event={"ID":"93869d12-39bb-40f3-9529-edd714d8c0cc","Type":"ContainerStarted","Data":"7fd73e53494cbd4da3005147cb36c03457b2fbc8d63efeecf694d8197ac99198"}
May 26 06:57:07.209783 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.209700    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5k5gf" podStartSLOduration=4.257627947 podStartE2EDuration="22.209686295s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:56:47.939263024 +0000 UTC m=+3.501618697" lastFinishedPulling="2026-05-26 06:57:05.891321366 +0000 UTC m=+21.453677045" observedRunningTime="2026-05-26 06:57:07.209573001 +0000 UTC m=+22.771928692" watchObservedRunningTime="2026-05-26 06:57:07.209686295 +0000 UTC m=+22.772041989"
May 26 06:57:07.227929 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.227883    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-z9rzq" podStartSLOduration=3.960252632 podStartE2EDuration="22.227867453s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:56:47.913409993 +0000 UTC m=+3.475765673" lastFinishedPulling="2026-05-26 06:57:06.181024806 +0000 UTC m=+21.743380494" observedRunningTime="2026-05-26 06:57:07.227324425 +0000 UTC m=+22.789680118" watchObservedRunningTime="2026-05-26 06:57:07.227867453 +0000 UTC m=+22.790223149"
May 26 06:57:07.771158 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:07.771129    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 06:57:08.014207 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:08.014028    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T06:57:07.771154735Z","UUID":"b6b2b3f1-5fa7-4887-8042-94fdd03eba83","Handler":null,"Name":"","Endpoint":""}
May 26 06:57:08.016619 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:08.016595    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 06:57:08.016755 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:08.016628    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 06:57:08.055193 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:08.055168    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:08.055333 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:08.055281    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:08.165436 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:08.165400    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8v2lq" event={"ID":"04835322-4daf-4aae-a36a-17bc76d04cfd","Type":"ContainerStarted","Data":"60aa88f38655699d2e92db0c2341c8d24f59f328fad7f43832b5f693d47a525a"}
May 26 06:57:08.167317 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:08.167286    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6" event={"ID":"4640d633-bd23-41d6-87a5-3be959925a6b","Type":"ContainerStarted","Data":"8368a605a90e0b024ea1115ce2d18de6aa7ab737b540b8754101095a39c66071"}
May 26 06:57:08.179808 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:08.179771    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8v2lq" podStartSLOduration=5.192281894 podStartE2EDuration="23.17975771s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:56:47.908163899 +0000 UTC m=+3.470519570" lastFinishedPulling="2026-05-26 06:57:05.895639701 +0000 UTC m=+21.457995386" observedRunningTime="2026-05-26 06:57:08.179591602 +0000 UTC m=+23.741947296" watchObservedRunningTime="2026-05-26 06:57:08.17975771 +0000 UTC m=+23.742113406"
May 26 06:57:08.179978 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:08.179957    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q4qj4" podStartSLOduration=5.195527291 podStartE2EDuration="23.179952985s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:56:47.905053519 +0000 UTC m=+3.467409194" lastFinishedPulling="2026-05-26 06:57:05.889479203 +0000 UTC m=+21.451834888" observedRunningTime="2026-05-26 06:57:07.252213617 +0000 UTC m=+22.814569311" watchObservedRunningTime="2026-05-26 06:57:08.179952985 +0000 UTC m=+23.742308679"
May 26 06:57:09.058368 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:09.058295    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:09.058521 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:09.058295    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:09.058521 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:09.058405    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:09.058521 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:09.058460    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:09.172813 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:09.172791    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 06:57:09.174025 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:09.173974    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerStarted","Data":"0feb266dae410bcddb7edc0e887ab0012e1aaec845d672015d4665b4b2dc1402"}
May 26 06:57:10.055464 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:10.055231    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:10.055620 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:10.055572    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:10.087324 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:10.087296    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:57:10.087927 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:10.087908    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:57:10.177778 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:10.177739    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6" event={"ID":"4640d633-bd23-41d6-87a5-3be959925a6b","Type":"ContainerStarted","Data":"0376f58ec64b54c415178fcbb0cb5edd6864bb8a76dcdab142bffacd070c9cbc"}
May 26 06:57:10.178284 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:10.178034    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:57:10.178566 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:10.178547    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q4qj4"
May 26 06:57:10.208079 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:10.208027    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q7jh6" podStartSLOduration=3.995871667 podStartE2EDuration="25.2079935s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:56:47.911480608 +0000 UTC m=+3.473836293" lastFinishedPulling="2026-05-26 06:57:09.12360245 +0000 UTC m=+24.685958126" observedRunningTime="2026-05-26 06:57:10.194128374 +0000 UTC m=+25.756484067" watchObservedRunningTime="2026-05-26 06:57:10.2079935 +0000 UTC m=+25.770349195"
May 26 06:57:11.057846 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:11.057818    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:11.058030 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:11.057818    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:11.058030 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:11.057917    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:11.058119 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:11.058062    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:12.055303 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.055206    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:12.055303 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:12.055295    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:12.182735 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.182698    2564 generic.go:358] "Generic (PLEG): container finished" podID="4f05b089-b857-4e44-81f5-86cd388b45fa" containerID="b7652c0e3ff016cf8d1001c2bf4476846cba2435ebff0c182e80a62e9cb4fe22" exitCode=0
May 26 06:57:12.182892 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.182789    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" event={"ID":"4f05b089-b857-4e44-81f5-86cd388b45fa","Type":"ContainerDied","Data":"b7652c0e3ff016cf8d1001c2bf4476846cba2435ebff0c182e80a62e9cb4fe22"}
May 26 06:57:12.186038 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.186016    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 06:57:12.186507 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.186482    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerStarted","Data":"df75f60446d3c28c9ec059c0fe03857a364ddd1253bd0e2d47a90a558fc27e38"}
May 26 06:57:12.186729 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.186715    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:57:12.186865 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.186848    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:57:12.186920 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.186867    2564 scope.go:117] "RemoveContainer" containerID="6128431b5f63fe9aeb109cff850c6968c333b502689fd6b455ce6f5eedbd66b4"
May 26 06:57:12.186920 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.186875    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:57:12.202982 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.202961    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:57:12.203072 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:12.203040    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:57:13.055442 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.055410    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:13.055442 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.055410    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:13.056033 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:13.055531    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:13.056033 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:13.055620    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:13.192821 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.192799    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 06:57:13.193216 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.193179    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" event={"ID":"ec043f56-b630-4ad1-b67d-de851a55d74b","Type":"ContainerStarted","Data":"0e864c8a899cfbd6cd16dff302e1bbb64307f2b8bf62219007f1bb4cb26862b2"}
May 26 06:57:13.221863 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.221824    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh" podStartSLOduration=10.237238123 podStartE2EDuration="28.221810356s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:56:47.917807847 +0000 UTC m=+3.480163521" lastFinishedPulling="2026-05-26 06:57:05.902380081 +0000 UTC m=+21.464735754" observedRunningTime="2026-05-26 06:57:13.2201475 +0000 UTC m=+28.782503194" watchObservedRunningTime="2026-05-26 06:57:13.221810356 +0000 UTC m=+28.784166050"
May 26 06:57:13.343381 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.343354    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gsdx9"]
May 26 06:57:13.343523 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.343465    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:13.343562 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:13.343542    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:13.351183 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.351158    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4gb7"]
May 26 06:57:13.351295 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.351247    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:13.351342 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:13.351326    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:13.358468 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.358447    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-58c86"]
May 26 06:57:13.358573 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:13.358516    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:13.358687 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:13.358615    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:14.196505 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:14.196468    2564 generic.go:358] "Generic (PLEG): container finished" podID="4f05b089-b857-4e44-81f5-86cd388b45fa" containerID="77d8a68ad4094c66ee8ed7baa4f69277e8b313ab0704e14c0c980725e29066cd" exitCode=0
May 26 06:57:14.196858 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:14.196553    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" event={"ID":"4f05b089-b857-4e44-81f5-86cd388b45fa","Type":"ContainerDied","Data":"77d8a68ad4094c66ee8ed7baa4f69277e8b313ab0704e14c0c980725e29066cd"}
May 26 06:57:14.492061 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:14.491984    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:14.492216 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:14.492132    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:14.492216 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:14.492188    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret podName:89a930c8-bcd2-44f5-9039-a2e0789bb89a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:30.492173212 +0000 UTC m=+46.054528884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret") pod "global-pull-secret-syncer-gsdx9" (UID: "89a930c8-bcd2-44f5-9039-a2e0789bb89a") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:15.058026 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:15.057984    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:15.058171 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:15.057984    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:15.058171 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:15.058123    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:15.058171 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:15.057984    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:15.058323 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:15.058170    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:15.058323 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:15.058239    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:16.201961 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:16.201929    2564 generic.go:358] "Generic (PLEG): container finished" podID="4f05b089-b857-4e44-81f5-86cd388b45fa" containerID="1fdc2615ec02da5c396d858673da781f9d73fb92c6d5af7a5116e7e1249b2563" exitCode=0
May 26 06:57:16.201961 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:16.201971    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" event={"ID":"4f05b089-b857-4e44-81f5-86cd388b45fa","Type":"ContainerDied","Data":"1fdc2615ec02da5c396d858673da781f9d73fb92c6d5af7a5116e7e1249b2563"}
May 26 06:57:17.055319 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:17.055284    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:17.055319 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:17.055301    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:17.055319 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:17.055309    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:17.055561 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:17.055394    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-58c86" podUID="c3147f4f-fad0-4325-9137-e80f70229ae6"
May 26 06:57:17.055561 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:17.055485    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsdx9" podUID="89a930c8-bcd2-44f5-9039-a2e0789bb89a"
May 26 06:57:17.055735 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:17.055616    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:57:18.723553 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.723505    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:18.724165 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:18.723674    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:18.724165 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:18.723758    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs podName:0801ad22-d4d0-4de1-9866-986fc02f72f3 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:50.723737079 +0000 UTC m=+66.286092756 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs") pod "network-metrics-daemon-q4gb7" (UID: "0801ad22-d4d0-4de1-9866-986fc02f72f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:18.736907 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.736881    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-143.ec2.internal" event="NodeReady"
May 26 06:57:18.737117 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.737104    2564 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 06:57:18.774305 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.774268    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67c9c85bbc-snlz5"]
May 26 06:57:18.791326 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.791262    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c9c85bbc-snlz5"]
May 26 06:57:18.791326 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.791325    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7ccz7"]
May 26 06:57:18.791554 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.791399    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:18.794447 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.794282    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m4kvk\""
May 26 06:57:18.794447 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.794410    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 06:57:18.794657 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.794522    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 06:57:18.794657 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.794583    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 06:57:18.810120 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.809905    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 06:57:18.812729 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.812441    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"]
May 26 06:57:18.813480 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.812997    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:18.819992 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.819968    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 06:57:18.820419 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.820212    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2jnx6\""
May 26 06:57:18.820999 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.820972    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 06:57:18.826795 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.826768    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fp6ht"]
May 26 06:57:18.827229 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.827187    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:18.830736 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.830715    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 26 06:57:18.830811 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.830752    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c7clz\""
May 26 06:57:18.830811 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.830768    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 26 06:57:18.847255 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.847234    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"]
May 26 06:57:18.847404 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.847387    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:18.850056 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.849862    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 06:57:18.850056 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.849885    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 06:57:18.850056 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.849906    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zm2vh\""
May 26 06:57:18.850056 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.849919    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 06:57:18.861860 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.861771    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"]
May 26 06:57:18.861959 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.861872    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:18.864193 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.864173    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 06:57:18.864299 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.864197    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 26 06:57:18.864576 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.864556    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 06:57:18.864792 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.864776    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 06:57:18.871825 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.871807    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"]
May 26 06:57:18.871939 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.871924    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"
May 26 06:57:18.874507 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.874490    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-g7g4r\""
May 26 06:57:18.874858 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.874565    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 26 06:57:18.888900 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.888881    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"]
May 26 06:57:18.888993 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.888915    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7ccz7"]
May 26 06:57:18.888993 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.888913    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:18.889114 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.888929    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"]
May 26 06:57:18.889114 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.889055    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"]
May 26 06:57:18.889114 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.889069    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"]
May 26 06:57:18.889114 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.889080    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fp6ht"]
May 26 06:57:18.891511 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.891431    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 26 06:57:18.891511 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.891432    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 26 06:57:18.891511 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.891477    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 26 06:57:18.891791 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.891777    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 26 06:57:18.925810 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.925789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-certificates\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:18.925924 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.925827    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:18.925924 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.925846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14cd0641-8c2d-4f5b-8504-860c2a0eebea-config-volume\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:18.925924 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.925869    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:18.925924 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.925898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-image-registry-private-configuration\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:18.926148 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.925926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f9vn\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-kube-api-access-9f9vn\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:18.926148 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:18.926037    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:57:18.926148 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:18.926058    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:57:18.926148 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:18.926071    2564 projected.go:194] Error preparing data for projected volume kube-api-access-c2bcw for pod openshift-network-diagnostics/network-check-target-58c86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:18.926148 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.926075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-trusted-ca\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:18.926148 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.926114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14cd0641-8c2d-4f5b-8504-860c2a0eebea-tmp-dir\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:18.926148 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:18.926135    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw podName:c3147f4f-fad0-4325-9137-e80f70229ae6 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:50.926116621 +0000 UTC m=+66.488472310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2bcw" (UniqueName: "kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw") pod "network-check-target-58c86" (UID: "c3147f4f-fad0-4325-9137-e80f70229ae6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:18.926567 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.926188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqql7\" (UniqueName: \"kubernetes.io/projected/14cd0641-8c2d-4f5b-8504-860c2a0eebea-kube-api-access-bqql7\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:18.926567 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.926226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:18.926567 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.926260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:18.926567 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.926303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:18.926567 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.926346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-bound-sa-token\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:18.926567 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.926425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a77bfa10-6c0d-4190-9a66-ff71d232ec59-ca-trust-extracted\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:18.926567 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:18.926455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-installation-pull-secrets\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.027229 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027194    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14cd0641-8c2d-4f5b-8504-860c2a0eebea-tmp-dir\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:19.027229 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027234    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqql7\" (UniqueName: \"kubernetes.io/projected/14cd0641-8c2d-4f5b-8504-860c2a0eebea-kube-api-access-bqql7\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:19.027460 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwwkc\" (UniqueName: \"kubernetes.io/projected/4a5957ec-7a76-4ae7-a53f-3966d9086741-kube-api-access-dwwkc\") pod \"klusterlet-addon-workmgr-7c8c56fd9b-2bhhx\" (UID: \"4a5957ec-7a76-4ae7-a53f-3966d9086741\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.027460 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-ca\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.027460 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027398    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:19.027460 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027439    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027466    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-bound-sa-token\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.027488    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.027510    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.027531    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c9c85bbc-snlz5: secret "image-registry-tls" not found
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.027549    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert podName:2c4037dc-121e-43a0-b3b6-ae75ae4054b9 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:19.527530207 +0000 UTC m=+35.089885894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7ln8s" (UID: "2c4037dc-121e-43a0-b3b6-ae75ae4054b9") : secret "networking-console-plugin-cert" not found
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027562    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14cd0641-8c2d-4f5b-8504-860c2a0eebea-tmp-dir\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.027588    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls podName:a77bfa10-6c0d-4190-9a66-ff71d232ec59 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:19.527569658 +0000 UTC m=+35.089925331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls") pod "image-registry-67c9c85bbc-snlz5" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59") : secret "image-registry-tls" not found
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027491    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a77bfa10-6c0d-4190-9a66-ff71d232ec59-ca-trust-extracted\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:19.027691 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027668    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-certificates\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2fd\" (UniqueName: \"kubernetes.io/projected/e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5-kube-api-access-gm2fd\") pod \"managed-serviceaccount-addon-agent-578c7999db-z59lz\" (UID: \"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578c7999db-z59lz\" (UID: \"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027806    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-image-registry-private-configuration\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027837    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a77bfa10-6c0d-4190-9a66-ff71d232ec59-ca-trust-extracted\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027869    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027900    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f9vn\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-kube-api-access-9f9vn\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027936    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027968    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-trusted-ca\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.027997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a5957ec-7a76-4ae7-a53f-3966d9086741-tmp\") pod \"klusterlet-addon-workmgr-7c8c56fd9b-2bhhx\" (UID: \"4a5957ec-7a76-4ae7-a53f-3966d9086741\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4a5957ec-7a76-4ae7-a53f-3966d9086741-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c8c56fd9b-2bhhx\" (UID: \"4a5957ec-7a76-4ae7-a53f-3966d9086741\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028093    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-installation-pull-secrets\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.028223 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028160    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14cd0641-8c2d-4f5b-8504-860c2a0eebea-config-volume\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:19.028762 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028236    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-certificates\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.028762 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028282    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:19.028762 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028310    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-hub\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.028762 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2w77\" (UniqueName: \"kubernetes.io/projected/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-kube-api-access-d2w77\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.028762 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6nl5\" (UniqueName: \"kubernetes.io/projected/1f0cbbdd-590a-409e-9b3f-433989f2940e-kube-api-access-r6nl5\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:19.028762 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.028418    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:19.028762 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.028467    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls podName:14cd0641-8c2d-4f5b-8504-860c2a0eebea nodeName:}" failed. No retries permitted until 2026-05-26 06:57:19.528450902 +0000 UTC m=+35.090806589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls") pod "dns-default-7ccz7" (UID: "14cd0641-8c2d-4f5b-8504-860c2a0eebea") : secret "dns-default-metrics-tls" not found
May 26 06:57:19.028762 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028661    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:19.028762 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028700    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14cd0641-8c2d-4f5b-8504-860c2a0eebea-config-volume\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:19.029074 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.028980    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-trusted-ca\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.031984 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.031960    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-installation-pull-secrets\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.032120 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.031960    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-image-registry-private-configuration\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.038557 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.038537    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-bound-sa-token\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.038649 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.038633    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqql7\" (UniqueName: \"kubernetes.io/projected/14cd0641-8c2d-4f5b-8504-860c2a0eebea-kube-api-access-bqql7\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:19.039152 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.039133    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f9vn\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-kube-api-access-9f9vn\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.058220 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.058201    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:19.058220 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.058226    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:19.058337 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.058232    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:19.060837 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.060819    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 06:57:19.061272 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.061252    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 06:57:19.061739 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.061724    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 06:57:19.061887 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.061870    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ph2b6\""
May 26 06:57:19.062185 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.062171    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 06:57:19.062290 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.062276    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59vdl\""
May 26 06:57:19.129577 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.129545    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a5957ec-7a76-4ae7-a53f-3966d9086741-tmp\") pod \"klusterlet-addon-workmgr-7c8c56fd9b-2bhhx\" (UID: \"4a5957ec-7a76-4ae7-a53f-3966d9086741\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.129720 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.129604    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4a5957ec-7a76-4ae7-a53f-3966d9086741-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c8c56fd9b-2bhhx\" (UID: \"4a5957ec-7a76-4ae7-a53f-3966d9086741\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.129720 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.129646    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.129859 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.129839    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-hub\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.129936 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.129919    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2w77\" (UniqueName: \"kubernetes.io/projected/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-kube-api-access-d2w77\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.129990 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.129955    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6nl5\" (UniqueName: \"kubernetes.io/projected/1f0cbbdd-590a-409e-9b3f-433989f2940e-kube-api-access-r6nl5\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:19.130071 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.129982    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a5957ec-7a76-4ae7-a53f-3966d9086741-tmp\") pod \"klusterlet-addon-workmgr-7c8c56fd9b-2bhhx\" (UID: \"4a5957ec-7a76-4ae7-a53f-3966d9086741\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.130071 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.129994    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dwwkc\" (UniqueName: \"kubernetes.io/projected/4a5957ec-7a76-4ae7-a53f-3966d9086741-kube-api-access-dwwkc\") pod \"klusterlet-addon-workmgr-7c8c56fd9b-2bhhx\" (UID: \"4a5957ec-7a76-4ae7-a53f-3966d9086741\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.130196 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.130093    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-ca\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.130358 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.130328    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:19.132392 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.130989    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2fd\" (UniqueName: \"kubernetes.io/projected/e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5-kube-api-access-gm2fd\") pod \"managed-serviceaccount-addon-agent-578c7999db-z59lz\" (UID: \"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"
May 26 06:57:19.132392 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.131067    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578c7999db-z59lz\" (UID: \"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"
May 26 06:57:19.132392 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.131107    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.132392 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.131140    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.132392 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.131817    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.133365 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.132926    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-hub\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.133365 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.132932    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:19.133365 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.133074    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert podName:1f0cbbdd-590a-409e-9b3f-433989f2940e nodeName:}" failed. No retries permitted until 2026-05-26 06:57:19.633042677 +0000 UTC m=+35.195398350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert") pod "ingress-canary-fp6ht" (UID: "1f0cbbdd-590a-409e-9b3f-433989f2940e") : secret "canary-serving-cert" not found
May 26 06:57:19.133607 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.133505    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.133607 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.133507    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4a5957ec-7a76-4ae7-a53f-3966d9086741-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c8c56fd9b-2bhhx\" (UID: \"4a5957ec-7a76-4ae7-a53f-3966d9086741\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.138609 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.138553    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.139377 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.139328    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6nl5\" (UniqueName: \"kubernetes.io/projected/1f0cbbdd-590a-409e-9b3f-433989f2940e-kube-api-access-r6nl5\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:19.140319 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.139956    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-ca\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.140319 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.140174    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578c7999db-z59lz\" (UID: \"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"
May 26 06:57:19.141404 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.141385    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2fd\" (UniqueName: \"kubernetes.io/projected/e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5-kube-api-access-gm2fd\") pod \"managed-serviceaccount-addon-agent-578c7999db-z59lz\" (UID: \"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"
May 26 06:57:19.141980 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.141903    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2w77\" (UniqueName: \"kubernetes.io/projected/6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b-kube-api-access-d2w77\") pod \"cluster-proxy-proxy-agent-75c8d479c-ng4rx\" (UID: \"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.142546 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.142525    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwwkc\" (UniqueName: \"kubernetes.io/projected/4a5957ec-7a76-4ae7-a53f-3966d9086741-kube-api-access-dwwkc\") pod \"klusterlet-addon-workmgr-7c8c56fd9b-2bhhx\" (UID: \"4a5957ec-7a76-4ae7-a53f-3966d9086741\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.171456 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.171428    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:19.191126 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.191099    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"
May 26 06:57:19.199869 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.199838    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 06:57:19.388141 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.388092    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"]
May 26 06:57:19.392092 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.391869    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"]
May 26 06:57:19.392577 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:57:19.392550    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5957ec_7a76_4ae7_a53f_3966d9086741.slice/crio-2db0cfd688073e831e4b28bac7d6b5b6c14baf289a2a8ef89ca1061f2256b54d WatchSource:0}: Error finding container 2db0cfd688073e831e4b28bac7d6b5b6c14baf289a2a8ef89ca1061f2256b54d: Status 404 returned error can't find the container with id 2db0cfd688073e831e4b28bac7d6b5b6c14baf289a2a8ef89ca1061f2256b54d
May 26 06:57:19.395492 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:57:19.395468    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a56163d_e2ef_4b63_b160_9f0f8a3e9b9b.slice/crio-470111f2853e598d239dfef5362fbe66ef8dedcf6dacf75f0f6fc079fdb5e938 WatchSource:0}: Error finding container 470111f2853e598d239dfef5362fbe66ef8dedcf6dacf75f0f6fc079fdb5e938: Status 404 returned error can't find the container with id 470111f2853e598d239dfef5362fbe66ef8dedcf6dacf75f0f6fc079fdb5e938
May 26 06:57:19.413619 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.413588    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"]
May 26 06:57:19.416470 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:57:19.416447    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1a90adb_9f7a_4c9a_8a8d_c3afebe320f5.slice/crio-f0896e47d3ade804ae4d1fc9eb0941035d5165404bc13fafafc806d45c2d46a1 WatchSource:0}: Error finding container f0896e47d3ade804ae4d1fc9eb0941035d5165404bc13fafafc806d45c2d46a1: Status 404 returned error can't find the container with id f0896e47d3ade804ae4d1fc9eb0941035d5165404bc13fafafc806d45c2d46a1
May 26 06:57:19.534653 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.534617    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:19.534840 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.534664    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:19.534840 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.534770    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:19.534840 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.534786    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c9c85bbc-snlz5: secret "image-registry-tls" not found
May 26 06:57:19.534840 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.534802    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 06:57:19.534840 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.534832    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls podName:a77bfa10-6c0d-4190-9a66-ff71d232ec59 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:20.534819089 +0000 UTC m=+36.097174779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls") pod "image-registry-67c9c85bbc-snlz5" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59") : secret "image-registry-tls" not found
May 26 06:57:19.535121 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.534883    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert podName:2c4037dc-121e-43a0-b3b6-ae75ae4054b9 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:20.534867416 +0000 UTC m=+36.097223090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7ln8s" (UID: "2c4037dc-121e-43a0-b3b6-ae75ae4054b9") : secret "networking-console-plugin-cert" not found
May 26 06:57:19.535121 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.534951    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:19.535121 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.535087    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:19.535290 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.535137    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls podName:14cd0641-8c2d-4f5b-8504-860c2a0eebea nodeName:}" failed. No retries permitted until 2026-05-26 06:57:20.535123935 +0000 UTC m=+36.097479623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls") pod "dns-default-7ccz7" (UID: "14cd0641-8c2d-4f5b-8504-860c2a0eebea") : secret "dns-default-metrics-tls" not found
May 26 06:57:19.636455 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:19.636413    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:19.636630 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.636583    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:19.636676 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:19.636662    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert podName:1f0cbbdd-590a-409e-9b3f-433989f2940e nodeName:}" failed. No retries permitted until 2026-05-26 06:57:20.63664111 +0000 UTC m=+36.198996782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert") pod "ingress-canary-fp6ht" (UID: "1f0cbbdd-590a-409e-9b3f-433989f2940e") : secret "canary-serving-cert" not found
May 26 06:57:20.212684 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:20.212646    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz" event={"ID":"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5","Type":"ContainerStarted","Data":"f0896e47d3ade804ae4d1fc9eb0941035d5165404bc13fafafc806d45c2d46a1"}
May 26 06:57:20.214158 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:20.214132    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" event={"ID":"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b","Type":"ContainerStarted","Data":"470111f2853e598d239dfef5362fbe66ef8dedcf6dacf75f0f6fc079fdb5e938"}
May 26 06:57:20.215375 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:20.215350    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx" event={"ID":"4a5957ec-7a76-4ae7-a53f-3966d9086741","Type":"ContainerStarted","Data":"2db0cfd688073e831e4b28bac7d6b5b6c14baf289a2a8ef89ca1061f2256b54d"}
May 26 06:57:20.544507 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:20.544384    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:20.544507 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:20.544480    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:20.544739 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:20.544511    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:20.544739 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:20.544708    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:20.544739 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:20.544723    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c9c85bbc-snlz5: secret "image-registry-tls" not found
May 26 06:57:20.544897 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:20.544779    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls podName:a77bfa10-6c0d-4190-9a66-ff71d232ec59 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:22.544760978 +0000 UTC m=+38.107116655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls") pod "image-registry-67c9c85bbc-snlz5" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59") : secret "image-registry-tls" not found
May 26 06:57:20.545369 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:20.545188    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:20.545369 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:20.545243    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls podName:14cd0641-8c2d-4f5b-8504-860c2a0eebea nodeName:}" failed. No retries permitted until 2026-05-26 06:57:22.545226704 +0000 UTC m=+38.107582376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls") pod "dns-default-7ccz7" (UID: "14cd0641-8c2d-4f5b-8504-860c2a0eebea") : secret "dns-default-metrics-tls" not found
May 26 06:57:20.545369 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:20.545304    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 06:57:20.545369 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:20.545335    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert podName:2c4037dc-121e-43a0-b3b6-ae75ae4054b9 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:22.54532485 +0000 UTC m=+38.107680522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7ln8s" (UID: "2c4037dc-121e-43a0-b3b6-ae75ae4054b9") : secret "networking-console-plugin-cert" not found
May 26 06:57:20.645524 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:20.645485    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:20.645704 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:20.645661    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:20.645832 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:20.645724    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert podName:1f0cbbdd-590a-409e-9b3f-433989f2940e nodeName:}" failed. No retries permitted until 2026-05-26 06:57:22.645702778 +0000 UTC m=+38.208058452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert") pod "ingress-canary-fp6ht" (UID: "1f0cbbdd-590a-409e-9b3f-433989f2940e") : secret "canary-serving-cert" not found
May 26 06:57:22.564812 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:22.564776    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:22.565341 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:22.564862    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:22.565341 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:22.564893    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:22.565341 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:22.564954    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:22.565341 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:22.565033    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 06:57:22.565341 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:22.565040    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:22.565341 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:22.565059    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c9c85bbc-snlz5: secret "image-registry-tls" not found
May 26 06:57:22.565341 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:22.565046    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls podName:14cd0641-8c2d-4f5b-8504-860c2a0eebea nodeName:}" failed. No retries permitted until 2026-05-26 06:57:26.56502877 +0000 UTC m=+42.127384446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls") pod "dns-default-7ccz7" (UID: "14cd0641-8c2d-4f5b-8504-860c2a0eebea") : secret "dns-default-metrics-tls" not found
May 26 06:57:22.565341 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:22.565113    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert podName:2c4037dc-121e-43a0-b3b6-ae75ae4054b9 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:26.565096006 +0000 UTC m=+42.127451684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7ln8s" (UID: "2c4037dc-121e-43a0-b3b6-ae75ae4054b9") : secret "networking-console-plugin-cert" not found
May 26 06:57:22.565341 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:22.565131    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls podName:a77bfa10-6c0d-4190-9a66-ff71d232ec59 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:26.565120907 +0000 UTC m=+42.127476585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls") pod "image-registry-67c9c85bbc-snlz5" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59") : secret "image-registry-tls" not found
May 26 06:57:22.665978 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:22.665943    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:22.666156 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:22.666104    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:22.666197 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:22.666164    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert podName:1f0cbbdd-590a-409e-9b3f-433989f2940e nodeName:}" failed. No retries permitted until 2026-05-26 06:57:26.666148062 +0000 UTC m=+42.228503751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert") pod "ingress-canary-fp6ht" (UID: "1f0cbbdd-590a-409e-9b3f-433989f2940e") : secret "canary-serving-cert" not found
May 26 06:57:26.602130 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:26.602087    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:26.602584 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:26.602248    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:26.602584 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:26.602280    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:26.602584 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:26.602288    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:26.602584 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:26.602357    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls podName:14cd0641-8c2d-4f5b-8504-860c2a0eebea nodeName:}" failed. No retries permitted until 2026-05-26 06:57:34.602335834 +0000 UTC m=+50.164691535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls") pod "dns-default-7ccz7" (UID: "14cd0641-8c2d-4f5b-8504-860c2a0eebea") : secret "dns-default-metrics-tls" not found
May 26 06:57:26.602584 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:26.602413    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 06:57:26.602584 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:26.602480    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert podName:2c4037dc-121e-43a0-b3b6-ae75ae4054b9 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:34.602461936 +0000 UTC m=+50.164817623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7ln8s" (UID: "2c4037dc-121e-43a0-b3b6-ae75ae4054b9") : secret "networking-console-plugin-cert" not found
May 26 06:57:26.602584 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:26.602520    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:26.602584 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:26.602534    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c9c85bbc-snlz5: secret "image-registry-tls" not found
May 26 06:57:26.602584 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:26.602576    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls podName:a77bfa10-6c0d-4190-9a66-ff71d232ec59 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:34.602563366 +0000 UTC m=+50.164919060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls") pod "image-registry-67c9c85bbc-snlz5" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59") : secret "image-registry-tls" not found
May 26 06:57:26.703228 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:26.703193    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:26.703372 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:26.703295    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:26.703372 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:26.703345    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert podName:1f0cbbdd-590a-409e-9b3f-433989f2940e nodeName:}" failed. No retries permitted until 2026-05-26 06:57:34.70333223 +0000 UTC m=+50.265687915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert") pod "ingress-canary-fp6ht" (UID: "1f0cbbdd-590a-409e-9b3f-433989f2940e") : secret "canary-serving-cert" not found
May 26 06:57:28.237472 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:28.237433    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz" event={"ID":"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5","Type":"ContainerStarted","Data":"644e87d574f6883baad5a6d9d90ea4328c91aa3f85e4ac1864a75d3a100f5959"}
May 26 06:57:28.238751 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:28.238722    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" event={"ID":"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b","Type":"ContainerStarted","Data":"907a5b3c420ea33b5dfb369206a9fd35f7f7c21b5f678b3ec019faedd5b29ff8"}
May 26 06:57:28.239879 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:28.239860    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx" event={"ID":"4a5957ec-7a76-4ae7-a53f-3966d9086741","Type":"ContainerStarted","Data":"65554fe89382739ef9132df551cff5f4c0a8291b8fb04b0b6734f27f300d25e1"}
May 26 06:57:28.240130 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:28.240100    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:28.241760 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:28.241742    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:57:28.242407 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:28.242388    2564 generic.go:358] "Generic (PLEG): container finished" podID="4f05b089-b857-4e44-81f5-86cd388b45fa" containerID="927a8bb70d9bcd4fddd1f80d274ba8e44ff47373dd3894940f69c9860f05e891" exitCode=0
May 26 06:57:28.242478 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:28.242419    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" event={"ID":"4f05b089-b857-4e44-81f5-86cd388b45fa","Type":"ContainerDied","Data":"927a8bb70d9bcd4fddd1f80d274ba8e44ff47373dd3894940f69c9860f05e891"}
May 26 06:57:28.255793 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:28.255753    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz" podStartSLOduration=9.786080194 podStartE2EDuration="18.255742518s" podCreationTimestamp="2026-05-26 06:57:10 +0000 UTC" firstStartedPulling="2026-05-26 06:57:19.41968292 +0000 UTC m=+34.982038608" lastFinishedPulling="2026-05-26 06:57:27.889345249 +0000 UTC m=+43.451700932" observedRunningTime="2026-05-26 06:57:28.255023014 +0000 UTC m=+43.817378707" watchObservedRunningTime="2026-05-26 06:57:28.255742518 +0000 UTC m=+43.818098203"
May 26 06:57:28.298034 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:28.297981    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx" podStartSLOduration=9.725332716 podStartE2EDuration="18.29797009s" podCreationTimestamp="2026-05-26 06:57:10 +0000 UTC" firstStartedPulling="2026-05-26 06:57:19.3951606 +0000 UTC m=+34.957516276" lastFinishedPulling="2026-05-26 06:57:27.967797965 +0000 UTC m=+43.530153650" observedRunningTime="2026-05-26 06:57:28.297289342 +0000 UTC m=+43.859645037" watchObservedRunningTime="2026-05-26 06:57:28.29797009 +0000 UTC m=+43.860325790"
May 26 06:57:29.247591 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:29.247560    2564 generic.go:358] "Generic (PLEG): container finished" podID="4f05b089-b857-4e44-81f5-86cd388b45fa" containerID="c997abcb31e133ab011520aade4797800b50469f75694ede201d018b45cf56ed" exitCode=0
May 26 06:57:29.248038 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:29.247642    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" event={"ID":"4f05b089-b857-4e44-81f5-86cd388b45fa","Type":"ContainerDied","Data":"c997abcb31e133ab011520aade4797800b50469f75694ede201d018b45cf56ed"}
May 26 06:57:30.251673 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:30.251643    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" event={"ID":"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b","Type":"ContainerStarted","Data":"2d7346f2b5983d86c01696ba81e669b44096e3ab708c5e02b701e779d4308557"}
May 26 06:57:30.251673 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:30.251677    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" event={"ID":"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b","Type":"ContainerStarted","Data":"0c3574b408281d3f56d7c1cdc5051c148f9ad2770b302b29ee54901a8120e460"}
May 26 06:57:30.254686 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:30.254664    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" event={"ID":"4f05b089-b857-4e44-81f5-86cd388b45fa","Type":"ContainerStarted","Data":"648c03d92e82ff967fb644c91ce7c68acc2a05aca2c6673c33d042c313233011"}
May 26 06:57:30.273718 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:30.273674    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" podStartSLOduration=9.877783992 podStartE2EDuration="20.273661363s" podCreationTimestamp="2026-05-26 06:57:10 +0000 UTC" firstStartedPulling="2026-05-26 06:57:19.39774942 +0000 UTC m=+34.960105103" lastFinishedPulling="2026-05-26 06:57:29.793626802 +0000 UTC m=+45.355982474" observedRunningTime="2026-05-26 06:57:30.269944993 +0000 UTC m=+45.832300689" watchObservedRunningTime="2026-05-26 06:57:30.273661363 +0000 UTC m=+45.836017057"
May 26 06:57:30.292627 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:30.292583    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j5bdr" podStartSLOduration=5.319309224 podStartE2EDuration="45.292572097s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:56:47.915858355 +0000 UTC m=+3.478214042" lastFinishedPulling="2026-05-26 06:57:27.889121242 +0000 UTC m=+43.451476915" observedRunningTime="2026-05-26 06:57:30.291575548 +0000 UTC m=+45.853931242" watchObservedRunningTime="2026-05-26 06:57:30.292572097 +0000 UTC m=+45.854927782"
May 26 06:57:30.535516 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:30.535414    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:30.538516 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:30.538484    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89a930c8-bcd2-44f5-9039-a2e0789bb89a-original-pull-secret\") pod \"global-pull-secret-syncer-gsdx9\" (UID: \"89a930c8-bcd2-44f5-9039-a2e0789bb89a\") " pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:30.788835 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:30.788742    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsdx9"
May 26 06:57:30.905479 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:30.905446    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gsdx9"]
May 26 06:57:30.908542 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:57:30.908507    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a930c8_bcd2_44f5_9039_a2e0789bb89a.slice/crio-6f084c861f53d6f2537aca0d214cb86ba4bce63158cc1242c22f74e897b3ad56 WatchSource:0}: Error finding container 6f084c861f53d6f2537aca0d214cb86ba4bce63158cc1242c22f74e897b3ad56: Status 404 returned error can't find the container with id 6f084c861f53d6f2537aca0d214cb86ba4bce63158cc1242c22f74e897b3ad56
May 26 06:57:31.257097 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:31.257056    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gsdx9" event={"ID":"89a930c8-bcd2-44f5-9039-a2e0789bb89a","Type":"ContainerStarted","Data":"6f084c861f53d6f2537aca0d214cb86ba4bce63158cc1242c22f74e897b3ad56"}
May 26 06:57:34.669725 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:34.669682    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:34.670222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:34.669768    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:34.670222 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:34.669799    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:34.670222 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:34.669861    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:34.670222 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:34.669913    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 06:57:34.670222 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:34.669938    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls podName:14cd0641-8c2d-4f5b-8504-860c2a0eebea nodeName:}" failed. No retries permitted until 2026-05-26 06:57:50.669912871 +0000 UTC m=+66.232268563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls") pod "dns-default-7ccz7" (UID: "14cd0641-8c2d-4f5b-8504-860c2a0eebea") : secret "dns-default-metrics-tls" not found
May 26 06:57:34.670222 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:34.669965    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:34.670222 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:34.669979    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c9c85bbc-snlz5: secret "image-registry-tls" not found
May 26 06:57:34.670222 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:34.669980    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert podName:2c4037dc-121e-43a0-b3b6-ae75ae4054b9 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:50.669963374 +0000 UTC m=+66.232319064 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7ln8s" (UID: "2c4037dc-121e-43a0-b3b6-ae75ae4054b9") : secret "networking-console-plugin-cert" not found
May 26 06:57:34.670222 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:34.670043    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls podName:a77bfa10-6c0d-4190-9a66-ff71d232ec59 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:50.670031191 +0000 UTC m=+66.232386867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls") pod "image-registry-67c9c85bbc-snlz5" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59") : secret "image-registry-tls" not found
May 26 06:57:34.771382 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:34.771340    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:34.771565 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:34.771487    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:34.771565 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:34.771554    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert podName:1f0cbbdd-590a-409e-9b3f-433989f2940e nodeName:}" failed. No retries permitted until 2026-05-26 06:57:50.771539432 +0000 UTC m=+66.333895104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert") pod "ingress-canary-fp6ht" (UID: "1f0cbbdd-590a-409e-9b3f-433989f2940e") : secret "canary-serving-cert" not found
May 26 06:57:36.267984 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:36.267944    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gsdx9" event={"ID":"89a930c8-bcd2-44f5-9039-a2e0789bb89a","Type":"ContainerStarted","Data":"9888261d62e730aadd3d2b0b3e6ec5cb06e4d226eae62d93caf466fb90496992"}
May 26 06:57:36.284807 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:36.284762    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gsdx9" podStartSLOduration=33.454850952 podStartE2EDuration="38.284747925s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:30.912390019 +0000 UTC m=+46.474745692" lastFinishedPulling="2026-05-26 06:57:35.742286976 +0000 UTC m=+51.304642665" observedRunningTime="2026-05-26 06:57:36.284363838 +0000 UTC m=+51.846719532" watchObservedRunningTime="2026-05-26 06:57:36.284747925 +0000 UTC m=+51.847103636"
May 26 06:57:44.206810 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:44.206782    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8zhkh"
May 26 06:57:50.702957 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:50.702908    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:57:50.703498 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:50.702969    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:57:50.703498 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:50.702991    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:57:50.703498 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.703085    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:50.703498 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.703119    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:50.703498 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.703132    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c9c85bbc-snlz5: secret "image-registry-tls" not found
May 26 06:57:50.703498 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.703147    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls podName:14cd0641-8c2d-4f5b-8504-860c2a0eebea nodeName:}" failed. No retries permitted until 2026-05-26 06:58:22.703130886 +0000 UTC m=+98.265486558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls") pod "dns-default-7ccz7" (UID: "14cd0641-8c2d-4f5b-8504-860c2a0eebea") : secret "dns-default-metrics-tls" not found
May 26 06:57:50.703498 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.703182    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls podName:a77bfa10-6c0d-4190-9a66-ff71d232ec59 nodeName:}" failed. No retries permitted until 2026-05-26 06:58:22.703170188 +0000 UTC m=+98.265525861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls") pod "image-registry-67c9c85bbc-snlz5" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59") : secret "image-registry-tls" not found
May 26 06:57:50.703498 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.703118    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 06:57:50.703498 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.703211    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert podName:2c4037dc-121e-43a0-b3b6-ae75ae4054b9 nodeName:}" failed. No retries permitted until 2026-05-26 06:58:22.703205329 +0000 UTC m=+98.265561001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7ln8s" (UID: "2c4037dc-121e-43a0-b3b6-ae75ae4054b9") : secret "networking-console-plugin-cert" not found
May 26 06:57:50.804148 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:50.804116    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:57:50.804252 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:50.804177    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:57:50.804309 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.804284    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:50.804378 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.804366    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert podName:1f0cbbdd-590a-409e-9b3f-433989f2940e nodeName:}" failed. No retries permitted until 2026-05-26 06:58:22.804345713 +0000 UTC m=+98.366701400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert") pod "ingress-canary-fp6ht" (UID: "1f0cbbdd-590a-409e-9b3f-433989f2940e") : secret "canary-serving-cert" not found
May 26 06:57:50.807152 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:50.807134    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 06:57:50.814605 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.814582    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 06:57:50.814700 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:57:50.814651    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs podName:0801ad22-d4d0-4de1-9866-986fc02f72f3 nodeName:}" failed. No retries permitted until 2026-05-26 06:58:54.814630437 +0000 UTC m=+130.376986109 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs") pod "network-metrics-daemon-q4gb7" (UID: "0801ad22-d4d0-4de1-9866-986fc02f72f3") : secret "metrics-daemon-secret" not found
May 26 06:57:51.005344 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:51.005234    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:51.008207 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:51.008190    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 06:57:51.018602 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:51.018583    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 06:57:51.029325 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:51.029299    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2bcw\" (UniqueName: \"kubernetes.io/projected/c3147f4f-fad0-4325-9137-e80f70229ae6-kube-api-access-c2bcw\") pod \"network-check-target-58c86\" (UID: \"c3147f4f-fad0-4325-9137-e80f70229ae6\") " pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:51.198394 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:51.198356    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59vdl\""
May 26 06:57:51.205622 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:51.205596    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:51.333646 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:51.333613    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-58c86"]
May 26 06:57:51.336963 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:57:51.336933    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3147f4f_fad0_4325_9137_e80f70229ae6.slice/crio-15db0ff89ebbbe6401e99af270ed93e02479dbf9d302c53deb5556f48efdf30c WatchSource:0}: Error finding container 15db0ff89ebbbe6401e99af270ed93e02479dbf9d302c53deb5556f48efdf30c: Status 404 returned error can't find the container with id 15db0ff89ebbbe6401e99af270ed93e02479dbf9d302c53deb5556f48efdf30c
May 26 06:57:52.309417 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:52.309375    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-58c86" event={"ID":"c3147f4f-fad0-4325-9137-e80f70229ae6","Type":"ContainerStarted","Data":"15db0ff89ebbbe6401e99af270ed93e02479dbf9d302c53deb5556f48efdf30c"}
May 26 06:57:55.321123 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:55.321088    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-58c86" event={"ID":"c3147f4f-fad0-4325-9137-e80f70229ae6","Type":"ContainerStarted","Data":"a9632c16eed1b72dd9dd3cee6414f9bb4dd19ccd81512cb5354a16e13e1e06aa"}
May 26 06:57:55.321506 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:55.321229    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:57:55.336915 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:57:55.336877    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-58c86" podStartSLOduration=67.080507979 podStartE2EDuration="1m10.336867042s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 06:57:51.338927232 +0000 UTC m=+66.901282903" lastFinishedPulling="2026-05-26 06:57:54.595286279 +0000 UTC m=+70.157641966" observedRunningTime="2026-05-26 06:57:55.336358901 +0000 UTC m=+70.898714607" watchObservedRunningTime="2026-05-26 06:57:55.336867042 +0000 UTC m=+70.899222736"
May 26 06:58:22.742468 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:58:22.742322    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:58:22.742468 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:58:22.742384    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:58:22.742468 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:58:22.742412    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:58:22.743064 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:22.742483    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:58:22.743064 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:22.742525    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:58:22.743064 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:22.742529    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 06:58:22.743064 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:22.742540    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c9c85bbc-snlz5: secret "image-registry-tls" not found
May 26 06:58:22.743064 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:22.742562    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls podName:14cd0641-8c2d-4f5b-8504-860c2a0eebea nodeName:}" failed. No retries permitted until 2026-05-26 06:59:26.742547075 +0000 UTC m=+162.304902746 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls") pod "dns-default-7ccz7" (UID: "14cd0641-8c2d-4f5b-8504-860c2a0eebea") : secret "dns-default-metrics-tls" not found
May 26 06:58:22.743064 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:22.742602    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert podName:2c4037dc-121e-43a0-b3b6-ae75ae4054b9 nodeName:}" failed. No retries permitted until 2026-05-26 06:59:26.742582705 +0000 UTC m=+162.304938412 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7ln8s" (UID: "2c4037dc-121e-43a0-b3b6-ae75ae4054b9") : secret "networking-console-plugin-cert" not found
May 26 06:58:22.743064 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:22.742619    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls podName:a77bfa10-6c0d-4190-9a66-ff71d232ec59 nodeName:}" failed. No retries permitted until 2026-05-26 06:59:26.742611405 +0000 UTC m=+162.304967088 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls") pod "image-registry-67c9c85bbc-snlz5" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59") : secret "image-registry-tls" not found
May 26 06:58:22.843098 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:58:22.843071    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:58:22.843228 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:22.843168    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:58:22.843228 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:22.843208    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert podName:1f0cbbdd-590a-409e-9b3f-433989f2940e nodeName:}" failed. No retries permitted until 2026-05-26 06:59:26.843197151 +0000 UTC m=+162.405552823 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert") pod "ingress-canary-fp6ht" (UID: "1f0cbbdd-590a-409e-9b3f-433989f2940e") : secret "canary-serving-cert" not found
May 26 06:58:26.326060 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:58:26.326003    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-58c86"
May 26 06:58:54.869775 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:58:54.869739    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:58:54.870274 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:54.869887    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 06:58:54.870274 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:58:54.869968    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs podName:0801ad22-d4d0-4de1-9866-986fc02f72f3 nodeName:}" failed. No retries permitted until 2026-05-26 07:00:56.869950558 +0000 UTC m=+252.432306231 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs") pod "network-metrics-daemon-q4gb7" (UID: "0801ad22-d4d0-4de1-9866-986fc02f72f3") : secret "metrics-daemon-secret" not found
May 26 06:59:21.803820 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:21.803779    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5" podUID="a77bfa10-6c0d-4190-9a66-ff71d232ec59"
May 26 06:59:21.823954 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:21.823924    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7ccz7" podUID="14cd0641-8c2d-4f5b-8504-860c2a0eebea"
May 26 06:59:21.837502 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:21.837477    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s" podUID="2c4037dc-121e-43a0-b3b6-ae75ae4054b9"
May 26 06:59:21.857674 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:21.857642    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fp6ht" podUID="1f0cbbdd-590a-409e-9b3f-433989f2940e"
May 26 06:59:22.081076 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:22.081042    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q4gb7" podUID="0801ad22-d4d0-4de1-9866-986fc02f72f3"
May 26 06:59:22.527743 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:22.527671    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7ccz7"
May 26 06:59:22.527871 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:22.527671    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:59:22.527871 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:22.527671    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:59:26.803685 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:26.803620    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 06:59:26.803685 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:26.803691    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") pod \"image-registry-67c9c85bbc-snlz5\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") " pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:59:26.804201 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:26.803782    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 06:59:26.804201 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:26.803832    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:59:26.804201 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:26.803784    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 06:59:26.804201 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:26.803849    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c9c85bbc-snlz5: secret "image-registry-tls" not found
May 26 06:59:26.804201 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:26.803857    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert podName:2c4037dc-121e-43a0-b3b6-ae75ae4054b9 nodeName:}" failed. No retries permitted until 2026-05-26 07:01:28.803841069 +0000 UTC m=+284.366196760 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7ln8s" (UID: "2c4037dc-121e-43a0-b3b6-ae75ae4054b9") : secret "networking-console-plugin-cert" not found
May 26 06:59:26.804201 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:26.803860    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:59:26.804201 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:26.803962    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls podName:a77bfa10-6c0d-4190-9a66-ff71d232ec59 nodeName:}" failed. No retries permitted until 2026-05-26 07:01:28.803933969 +0000 UTC m=+284.366289645 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls") pod "image-registry-67c9c85bbc-snlz5" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59") : secret "image-registry-tls" not found
May 26 06:59:26.804201 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:26.803989    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls podName:14cd0641-8c2d-4f5b-8504-860c2a0eebea nodeName:}" failed. No retries permitted until 2026-05-26 07:01:28.803981948 +0000 UTC m=+284.366337620 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls") pod "dns-default-7ccz7" (UID: "14cd0641-8c2d-4f5b-8504-860c2a0eebea") : secret "dns-default-metrics-tls" not found
May 26 06:59:26.904863 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:26.904827    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 06:59:26.905052 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:26.904969    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:59:26.905090 ip-10-0-134-143 kubenswrapper[2564]: E0526 06:59:26.905051    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert podName:1f0cbbdd-590a-409e-9b3f-433989f2940e nodeName:}" failed. No retries permitted until 2026-05-26 07:01:28.905033394 +0000 UTC m=+284.467389070 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert") pod "ingress-canary-fp6ht" (UID: "1f0cbbdd-590a-409e-9b3f-433989f2940e") : secret "canary-serving-cert" not found
May 26 06:59:27.592094 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:27.592066    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qkvvz_865291d6-3c5b-4739-a036-7ea8903b6c8e/dns-node-resolver/0.log"
May 26 06:59:28.192718 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:28.192692    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nn9b9_64b5633d-2ef9-4a32-acb5-3679ee903ae9/node-ca/0.log"
May 26 06:59:28.240598 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:28.240542    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx" podUID="4a5957ec-7a76-4ae7-a53f-3966d9086741" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
May 26 06:59:28.542692 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:28.542658    2564 generic.go:358] "Generic (PLEG): container finished" podID="e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5" containerID="644e87d574f6883baad5a6d9d90ea4328c91aa3f85e4ac1864a75d3a100f5959" exitCode=255
May 26 06:59:28.542871 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:28.542736    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz" event={"ID":"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5","Type":"ContainerDied","Data":"644e87d574f6883baad5a6d9d90ea4328c91aa3f85e4ac1864a75d3a100f5959"}
May 26 06:59:28.543111 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:28.543085    2564 scope.go:117] "RemoveContainer" containerID="644e87d574f6883baad5a6d9d90ea4328c91aa3f85e4ac1864a75d3a100f5959"
May 26 06:59:28.543923 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:28.543906    2564 generic.go:358] "Generic (PLEG): container finished" podID="4a5957ec-7a76-4ae7-a53f-3966d9086741" containerID="65554fe89382739ef9132df551cff5f4c0a8291b8fb04b0b6734f27f300d25e1" exitCode=1
May 26 06:59:28.543977 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:28.543949    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx" event={"ID":"4a5957ec-7a76-4ae7-a53f-3966d9086741","Type":"ContainerDied","Data":"65554fe89382739ef9132df551cff5f4c0a8291b8fb04b0b6734f27f300d25e1"}
May 26 06:59:28.544269 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:28.544253    2564 scope.go:117] "RemoveContainer" containerID="65554fe89382739ef9132df551cff5f4c0a8291b8fb04b0b6734f27f300d25e1"
May 26 06:59:29.172142 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:29.172059    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:59:29.192210 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:29.192190    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz"
May 26 06:59:29.547414 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:29.547328    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578c7999db-z59lz" event={"ID":"e1a90adb-9f7a-4c9a-8a8d-c3afebe320f5","Type":"ContainerStarted","Data":"dd94c3fc2bd81e1e2e7e15647827ae0ec5187276f6a1b13b2b9681c262e74273"}
May 26 06:59:29.548795 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:29.548776    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx" event={"ID":"4a5957ec-7a76-4ae7-a53f-3966d9086741","Type":"ContainerStarted","Data":"c82edc0e255e3f12f3d75caf9dc9a45666376e39ced19cdb8e29ef20cc53c156"}
May 26 06:59:29.549019 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:29.548990    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:59:29.549919 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:29.549901    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8c56fd9b-2bhhx"
May 26 06:59:35.056636 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:35.056607    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 06:59:35.057072 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:35.056687    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 06:59:48.254399 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.254340    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xkxlt"]
May 26 06:59:48.257404 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.257388    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.261687 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.261663    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 06:59:48.261808 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.261690    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 06:59:48.262621 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.262600    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 06:59:48.263168 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.263150    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 06:59:48.263436 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.263411    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jbx45\""
May 26 06:59:48.287127 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.287099    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xkxlt"]
May 26 06:59:48.355951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.355913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c0016b5-6e09-46cb-ac92-514e0a015abf-crio-socket\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.355951 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.355957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c0016b5-6e09-46cb-ac92-514e0a015abf-data-volume\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.356218 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.356059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c0016b5-6e09-46cb-ac92-514e0a015abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.356218 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.356098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c0016b5-6e09-46cb-ac92-514e0a015abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.356218 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.356125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj85l\" (UniqueName: \"kubernetes.io/projected/2c0016b5-6e09-46cb-ac92-514e0a015abf-kube-api-access-tj85l\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.456790 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.456756    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c0016b5-6e09-46cb-ac92-514e0a015abf-crio-socket\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.456790 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.456794    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c0016b5-6e09-46cb-ac92-514e0a015abf-data-volume\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.457053 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.456895    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c0016b5-6e09-46cb-ac92-514e0a015abf-crio-socket\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.457053 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.456920    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c0016b5-6e09-46cb-ac92-514e0a015abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.457053 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.456966    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c0016b5-6e09-46cb-ac92-514e0a015abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.457053 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.457033    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tj85l\" (UniqueName: \"kubernetes.io/projected/2c0016b5-6e09-46cb-ac92-514e0a015abf-kube-api-access-tj85l\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.457345 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.457317    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c0016b5-6e09-46cb-ac92-514e0a015abf-data-volume\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.457623 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.457607    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c0016b5-6e09-46cb-ac92-514e0a015abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.459150 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.459131    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c0016b5-6e09-46cb-ac92-514e0a015abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.469158 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.469136    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj85l\" (UniqueName: \"kubernetes.io/projected/2c0016b5-6e09-46cb-ac92-514e0a015abf-kube-api-access-tj85l\") pod \"insights-runtime-extractor-xkxlt\" (UID: \"2c0016b5-6e09-46cb-ac92-514e0a015abf\") " pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.566900 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.566866    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xkxlt"
May 26 06:59:48.692046 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:48.691995    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xkxlt"]
May 26 06:59:48.696139 ip-10-0-134-143 kubenswrapper[2564]: W0526 06:59:48.696111    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0016b5_6e09_46cb_ac92_514e0a015abf.slice/crio-5f966318ab122873c8183c3efa5064703fa4adcb85c4000eb438ba6c89a1483f WatchSource:0}: Error finding container 5f966318ab122873c8183c3efa5064703fa4adcb85c4000eb438ba6c89a1483f: Status 404 returned error can't find the container with id 5f966318ab122873c8183c3efa5064703fa4adcb85c4000eb438ba6c89a1483f
May 26 06:59:49.596505 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:49.596472    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkxlt" event={"ID":"2c0016b5-6e09-46cb-ac92-514e0a015abf","Type":"ContainerStarted","Data":"f33c0340a5d6c0c5d1f4e95a3834213d79a72e2271476ab065f5ca665b6dbbfb"}
May 26 06:59:49.596882 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:49.596513    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkxlt" event={"ID":"2c0016b5-6e09-46cb-ac92-514e0a015abf","Type":"ContainerStarted","Data":"4306be664dc31efeb9fdfd9a912d6c3b7802a99a076512096ebc3fc8a345fb15"}
May 26 06:59:49.596882 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:49.596524    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkxlt" event={"ID":"2c0016b5-6e09-46cb-ac92-514e0a015abf","Type":"ContainerStarted","Data":"5f966318ab122873c8183c3efa5064703fa4adcb85c4000eb438ba6c89a1483f"}
May 26 06:59:51.602725 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:51.602691    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkxlt" event={"ID":"2c0016b5-6e09-46cb-ac92-514e0a015abf","Type":"ContainerStarted","Data":"cb18a28c64330bd11d26e12902cfdb8246629da951fbe437d57c99312e69da43"}
May 26 06:59:51.620561 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:51.620515    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xkxlt" podStartSLOduration=1.7251263799999998 podStartE2EDuration="3.620500543s" podCreationTimestamp="2026-05-26 06:59:48 +0000 UTC" firstStartedPulling="2026-05-26 06:59:48.762311877 +0000 UTC m=+184.324667549" lastFinishedPulling="2026-05-26 06:59:50.657686029 +0000 UTC m=+186.220041712" observedRunningTime="2026-05-26 06:59:51.619953805 +0000 UTC m=+187.182309498" watchObservedRunningTime="2026-05-26 06:59:51.620500543 +0000 UTC m=+187.182856236"
May 26 06:59:59.200920 ip-10-0-134-143 kubenswrapper[2564]: I0526 06:59:59.200882    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" podUID="6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 07:00:03.313979 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.313942    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nzg5g"]
May 26 07:00:03.317272 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.317255    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.319855 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.319834    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-knnzs\""
May 26 07:00:03.320896 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.320881    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 07:00:03.321180 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.321166    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 07:00:03.321500 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.321485    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 07:00:03.328108 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.328089    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 07:00:03.328192 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.328126    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 07:00:03.328320 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.328308    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 07:00:03.369988 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.369951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-wtmp\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.370161 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.370001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-tls\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.370161 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.370067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.370161 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.370131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-textfile\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.370318 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.370161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12176643-703b-49c7-b5e5-a7539b5042a1-root\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.370318 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.370273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12176643-703b-49c7-b5e5-a7539b5042a1-sys\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.370408 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.370313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d77ct\" (UniqueName: \"kubernetes.io/projected/12176643-703b-49c7-b5e5-a7539b5042a1-kube-api-access-d77ct\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.370408 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.370343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.370408 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.370396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12176643-703b-49c7-b5e5-a7539b5042a1-metrics-client-ca\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.470833 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.470802    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-textfile\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.470985 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.470840    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12176643-703b-49c7-b5e5-a7539b5042a1-root\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.470985 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.470922    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12176643-703b-49c7-b5e5-a7539b5042a1-root\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.470985 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.470942    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12176643-703b-49c7-b5e5-a7539b5042a1-sys\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.470985 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.470973    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d77ct\" (UniqueName: \"kubernetes.io/projected/12176643-703b-49c7-b5e5-a7539b5042a1-kube-api-access-d77ct\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471204 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471049    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12176643-703b-49c7-b5e5-a7539b5042a1-sys\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471204 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471055    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471204 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471110    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12176643-703b-49c7-b5e5-a7539b5042a1-metrics-client-ca\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471364 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471222    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-textfile\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471364 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471278    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-wtmp\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471364 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471300    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-tls\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471364 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471327    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471561 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471391    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-wtmp\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471752 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471728    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12176643-703b-49c7-b5e5-a7539b5042a1-metrics-client-ca\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.471876 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.471817    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.473409 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.473383    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.473502 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.473465    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12176643-703b-49c7-b5e5-a7539b5042a1-node-exporter-tls\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.478469 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.478448    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d77ct\" (UniqueName: \"kubernetes.io/projected/12176643-703b-49c7-b5e5-a7539b5042a1-kube-api-access-d77ct\") pod \"node-exporter-nzg5g\" (UID: \"12176643-703b-49c7-b5e5-a7539b5042a1\") " pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:03.626176 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:03.626071    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nzg5g"
May 26 07:00:04.636918 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:04.636880    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzg5g" event={"ID":"12176643-703b-49c7-b5e5-a7539b5042a1","Type":"ContainerStarted","Data":"b145680fbba9ff6b1c6f387858d4a33c9d21f112bffcd02e00fe09ede96c479b"}
May 26 07:00:04.637491 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:04.636930    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzg5g" event={"ID":"12176643-703b-49c7-b5e5-a7539b5042a1","Type":"ContainerStarted","Data":"2bfa6022267f2c1eebfe1409b348385cc3a57123f5ecb14afd43162a9082a28d"}
May 26 07:00:05.640546 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:05.640513    2564 generic.go:358] "Generic (PLEG): container finished" podID="12176643-703b-49c7-b5e5-a7539b5042a1" containerID="b145680fbba9ff6b1c6f387858d4a33c9d21f112bffcd02e00fe09ede96c479b" exitCode=0
May 26 07:00:05.640546 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:05.640555    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzg5g" event={"ID":"12176643-703b-49c7-b5e5-a7539b5042a1","Type":"ContainerDied","Data":"b145680fbba9ff6b1c6f387858d4a33c9d21f112bffcd02e00fe09ede96c479b"}
May 26 07:00:06.644990 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:06.644951    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzg5g" event={"ID":"12176643-703b-49c7-b5e5-a7539b5042a1","Type":"ContainerStarted","Data":"4a922469c978ffdc524e7823550c9afc2c6991187f58824e5d0b6a81ff6760e6"}
May 26 07:00:06.645373 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:06.645003    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzg5g" event={"ID":"12176643-703b-49c7-b5e5-a7539b5042a1","Type":"ContainerStarted","Data":"274f1fdc585993729c4ccf0891f6e283f79bd0af1c2bc0f8b30355aae1faec39"}
May 26 07:00:06.665672 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:06.665630    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nzg5g" podStartSLOduration=2.780587332 podStartE2EDuration="3.665615749s" podCreationTimestamp="2026-05-26 07:00:03 +0000 UTC" firstStartedPulling="2026-05-26 07:00:03.638086446 +0000 UTC m=+199.200442125" lastFinishedPulling="2026-05-26 07:00:04.523114858 +0000 UTC m=+200.085470542" observedRunningTime="2026-05-26 07:00:06.665424813 +0000 UTC m=+202.227780507" watchObservedRunningTime="2026-05-26 07:00:06.665615749 +0000 UTC m=+202.227971443"
May 26 07:00:09.201392 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:09.201339    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" podUID="6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 07:00:10.014143 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.014110    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67c9c85bbc-snlz5"]
May 26 07:00:10.014335 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:00:10.014316    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5" podUID="a77bfa10-6c0d-4190-9a66-ff71d232ec59"
May 26 07:00:10.654225 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.654197    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 07:00:10.658292 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.658271    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 07:00:10.731906 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.731867    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a77bfa10-6c0d-4190-9a66-ff71d232ec59-ca-trust-extracted\") pod \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") "
May 26 07:00:10.732076 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.731938    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-bound-sa-token\") pod \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") "
May 26 07:00:10.732076 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.731969    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-certificates\") pod \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") "
May 26 07:00:10.732076 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.731987    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-image-registry-private-configuration\") pod \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") "
May 26 07:00:10.732076 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.732044    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-trusted-ca\") pod \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") "
May 26 07:00:10.732286 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.732116    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77bfa10-6c0d-4190-9a66-ff71d232ec59-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a77bfa10-6c0d-4190-9a66-ff71d232ec59" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:00:10.732286 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.732176    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f9vn\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-kube-api-access-9f9vn\") pod \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") "
May 26 07:00:10.732286 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.732228    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-installation-pull-secrets\") pod \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\" (UID: \"a77bfa10-6c0d-4190-9a66-ff71d232ec59\") "
May 26 07:00:10.732456 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.732427    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a77bfa10-6c0d-4190-9a66-ff71d232ec59" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:10.732456 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.732439    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a77bfa10-6c0d-4190-9a66-ff71d232ec59" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:10.732576 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.732557    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-certificates\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:00:10.732639 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.732583    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a77bfa10-6c0d-4190-9a66-ff71d232ec59-trusted-ca\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:00:10.732639 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.732599    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a77bfa10-6c0d-4190-9a66-ff71d232ec59-ca-trust-extracted\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:00:10.734411 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.734380    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a77bfa10-6c0d-4190-9a66-ff71d232ec59" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:10.734525 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.734422    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-kube-api-access-9f9vn" (OuterVolumeSpecName: "kube-api-access-9f9vn") pod "a77bfa10-6c0d-4190-9a66-ff71d232ec59" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59"). InnerVolumeSpecName "kube-api-access-9f9vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:00:10.734525 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.734439    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a77bfa10-6c0d-4190-9a66-ff71d232ec59" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:10.734525 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.734468    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a77bfa10-6c0d-4190-9a66-ff71d232ec59" (UID: "a77bfa10-6c0d-4190-9a66-ff71d232ec59"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:00:10.833763 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.833730    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-installation-pull-secrets\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:00:10.833763 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.833756    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-bound-sa-token\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:00:10.833763 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.833766    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a77bfa10-6c0d-4190-9a66-ff71d232ec59-image-registry-private-configuration\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:00:10.833987 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:10.833776    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f9vn\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-kube-api-access-9f9vn\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:00:11.656606 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:11.656574    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c9c85bbc-snlz5"
May 26 07:00:11.689561 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:11.689532    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67c9c85bbc-snlz5"]
May 26 07:00:11.693795 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:11.693772    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67c9c85bbc-snlz5"]
May 26 07:00:11.843547 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:11.843514    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a77bfa10-6c0d-4190-9a66-ff71d232ec59-registry-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:00:13.058955 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:13.058922    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a77bfa10-6c0d-4190-9a66-ff71d232ec59" path="/var/lib/kubelet/pods/a77bfa10-6c0d-4190-9a66-ff71d232ec59/volumes"
May 26 07:00:19.200906 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:19.200865    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" podUID="6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 07:00:19.201292 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:19.200944    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx"
May 26 07:00:19.201511 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:19.201471    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2d7346f2b5983d86c01696ba81e669b44096e3ab708c5e02b701e779d4308557"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 26 07:00:19.201572 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:19.201554    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" podUID="6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b" containerName="service-proxy" containerID="cri-o://2d7346f2b5983d86c01696ba81e669b44096e3ab708c5e02b701e779d4308557" gracePeriod=30
May 26 07:00:19.679168 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:19.679129    2564 generic.go:358] "Generic (PLEG): container finished" podID="6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b" containerID="2d7346f2b5983d86c01696ba81e669b44096e3ab708c5e02b701e779d4308557" exitCode=2
May 26 07:00:19.679335 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:19.679207    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" event={"ID":"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b","Type":"ContainerDied","Data":"2d7346f2b5983d86c01696ba81e669b44096e3ab708c5e02b701e779d4308557"}
May 26 07:00:19.679335 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:19.679254    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75c8d479c-ng4rx" event={"ID":"6a56163d-e2ef-4b63-b160-9f0f8a3e9b9b","Type":"ContainerStarted","Data":"bc461dc78be8dd12a0b52f0a75100b266cc49a14da180684d4d45d467b5aa28a"}
May 26 07:00:56.876923 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:56.876872    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 07:00:56.879182 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:56.879161    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0801ad22-d4d0-4de1-9866-986fc02f72f3-metrics-certs\") pod \"network-metrics-daemon-q4gb7\" (UID: \"0801ad22-d4d0-4de1-9866-986fc02f72f3\") " pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 07:00:56.960180 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:56.960149    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ph2b6\""
May 26 07:00:56.968207 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:56.968189    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4gb7"
May 26 07:00:57.092828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:57.092795    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4gb7"]
May 26 07:00:57.095919 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:00:57.095892    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0801ad22_d4d0_4de1_9866_986fc02f72f3.slice/crio-4a9f41a959a3788e556909599db08894ed1fb8b5ba99d4ec87a7968691477fe9 WatchSource:0}: Error finding container 4a9f41a959a3788e556909599db08894ed1fb8b5ba99d4ec87a7968691477fe9: Status 404 returned error can't find the container with id 4a9f41a959a3788e556909599db08894ed1fb8b5ba99d4ec87a7968691477fe9
May 26 07:00:57.769812 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:57.769775    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4gb7" event={"ID":"0801ad22-d4d0-4de1-9866-986fc02f72f3","Type":"ContainerStarted","Data":"4a9f41a959a3788e556909599db08894ed1fb8b5ba99d4ec87a7968691477fe9"}
May 26 07:00:58.774079 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:58.774045    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4gb7" event={"ID":"0801ad22-d4d0-4de1-9866-986fc02f72f3","Type":"ContainerStarted","Data":"03114983532c836e332770a95282a2b80fca8a8373a8be927d7af3d4b59b1cd3"}
May 26 07:00:58.774079 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:58.774080    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4gb7" event={"ID":"0801ad22-d4d0-4de1-9866-986fc02f72f3","Type":"ContainerStarted","Data":"94550fc4b59f97cc47889b9fc1c9719efa87e13ee725aa3dda239d8405f1a452"}
May 26 07:00:58.791599 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:00:58.791554    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q4gb7" podStartSLOduration=252.659736027 podStartE2EDuration="4m13.791536987s" podCreationTimestamp="2026-05-26 06:56:45 +0000 UTC" firstStartedPulling="2026-05-26 07:00:57.098098663 +0000 UTC m=+252.660454339" lastFinishedPulling="2026-05-26 07:00:58.229899627 +0000 UTC m=+253.792255299" observedRunningTime="2026-05-26 07:00:58.791057361 +0000 UTC m=+254.353413056" watchObservedRunningTime="2026-05-26 07:00:58.791536987 +0000 UTC m=+254.353892687"
May 26 07:01:25.528186 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:01:25.528122    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7ccz7" podUID="14cd0641-8c2d-4f5b-8504-860c2a0eebea"
May 26 07:01:25.528186 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:01:25.528129    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s" podUID="2c4037dc-121e-43a0-b3b6-ae75ae4054b9"
May 26 07:01:25.528605 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:01:25.528284    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fp6ht" podUID="1f0cbbdd-590a-409e-9b3f-433989f2940e"
May 26 07:01:25.842315 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:25.842282    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7ccz7"
May 26 07:01:25.842315 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:25.842312    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 07:01:25.842315 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:25.842325    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 07:01:28.815677 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.815634    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 07:01:28.816191 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.815697    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 07:01:28.818118 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.818086    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14cd0641-8c2d-4f5b-8504-860c2a0eebea-metrics-tls\") pod \"dns-default-7ccz7\" (UID: \"14cd0641-8c2d-4f5b-8504-860c2a0eebea\") " pod="openshift-dns/dns-default-7ccz7"
May 26 07:01:28.818238 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.818170    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c4037dc-121e-43a0-b3b6-ae75ae4054b9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7ln8s\" (UID: \"2c4037dc-121e-43a0-b3b6-ae75ae4054b9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 07:01:28.847587 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.847552    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2jnx6\""
May 26 07:01:28.847587 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.847552    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c7clz\""
May 26 07:01:28.853110 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.853083    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"
May 26 07:01:28.853110 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.853101    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7ccz7"
May 26 07:01:28.916916 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.916424    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 07:01:28.920907 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.920793    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0cbbdd-590a-409e-9b3f-433989f2940e-cert\") pod \"ingress-canary-fp6ht\" (UID: \"1f0cbbdd-590a-409e-9b3f-433989f2940e\") " pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 07:01:28.990951 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:28.990897    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7ccz7"]
May 26 07:01:28.993728 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:01:28.993694    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14cd0641_8c2d_4f5b_8504_860c2a0eebea.slice/crio-ec4907600fcff07007c6d795a4c6363bed55749faffa4307ce5f799e8bbaefa6 WatchSource:0}: Error finding container ec4907600fcff07007c6d795a4c6363bed55749faffa4307ce5f799e8bbaefa6: Status 404 returned error can't find the container with id ec4907600fcff07007c6d795a4c6363bed55749faffa4307ce5f799e8bbaefa6
May 26 07:01:29.007058 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:29.007030    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s"]
May 26 07:01:29.010313 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:01:29.010276    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4037dc_121e_43a0_b3b6_ae75ae4054b9.slice/crio-a0aa0d1bd727c2cf6b596f2be8bdf58a2efbabce2c9abb76d5c65d3546ae9617 WatchSource:0}: Error finding container a0aa0d1bd727c2cf6b596f2be8bdf58a2efbabce2c9abb76d5c65d3546ae9617: Status 404 returned error can't find the container with id a0aa0d1bd727c2cf6b596f2be8bdf58a2efbabce2c9abb76d5c65d3546ae9617
May 26 07:01:29.145804 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:29.145720    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zm2vh\""
May 26 07:01:29.153855 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:29.153830    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fp6ht"
May 26 07:01:29.274542 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:29.274504    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fp6ht"]
May 26 07:01:29.277258 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:01:29.277229    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0cbbdd_590a_409e_9b3f_433989f2940e.slice/crio-303b3d78fc7d0f21025d113146dd0925e5bec065bc11604868200cd70c572a1f WatchSource:0}: Error finding container 303b3d78fc7d0f21025d113146dd0925e5bec065bc11604868200cd70c572a1f: Status 404 returned error can't find the container with id 303b3d78fc7d0f21025d113146dd0925e5bec065bc11604868200cd70c572a1f
May 26 07:01:29.852696 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:29.852658    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s" event={"ID":"2c4037dc-121e-43a0-b3b6-ae75ae4054b9","Type":"ContainerStarted","Data":"a0aa0d1bd727c2cf6b596f2be8bdf58a2efbabce2c9abb76d5c65d3546ae9617"}
May 26 07:01:29.854443 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:29.854391    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fp6ht" event={"ID":"1f0cbbdd-590a-409e-9b3f-433989f2940e","Type":"ContainerStarted","Data":"303b3d78fc7d0f21025d113146dd0925e5bec065bc11604868200cd70c572a1f"}
May 26 07:01:29.855782 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:29.855736    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7ccz7" event={"ID":"14cd0641-8c2d-4f5b-8504-860c2a0eebea","Type":"ContainerStarted","Data":"ec4907600fcff07007c6d795a4c6363bed55749faffa4307ce5f799e8bbaefa6"}
May 26 07:01:31.863451 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:31.863411    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7ccz7" event={"ID":"14cd0641-8c2d-4f5b-8504-860c2a0eebea","Type":"ContainerStarted","Data":"833c385cff887af0eaedafcc0be4d0f1a7e485b9fec135511d4826d69728dcdf"}
May 26 07:01:31.863451 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:31.863449    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7ccz7" event={"ID":"14cd0641-8c2d-4f5b-8504-860c2a0eebea","Type":"ContainerStarted","Data":"e06139547a6e3d49d91b605ad714c27e8b341870e0ae60bf0460850f9c54c454"}
May 26 07:01:31.863965 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:31.863496    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7ccz7"
May 26 07:01:31.864666 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:31.864645    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s" event={"ID":"2c4037dc-121e-43a0-b3b6-ae75ae4054b9","Type":"ContainerStarted","Data":"dcdf1e72be98c485d7a576864fccdc019ab3b41eb51e131bf9d12aa992451829"}
May 26 07:01:31.865836 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:31.865815    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fp6ht" event={"ID":"1f0cbbdd-590a-409e-9b3f-433989f2940e","Type":"ContainerStarted","Data":"6d8cae9a1fd75e670dc36057f1d372d47b883a342c3825eb43a289a030b2fa82"}
May 26 07:01:31.880978 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:31.880937    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-7ccz7" podStartSLOduration=252.255015241 podStartE2EDuration="4m13.880925125s" podCreationTimestamp="2026-05-26 06:57:18 +0000 UTC" firstStartedPulling="2026-05-26 07:01:28.995617654 +0000 UTC m=+284.557973330" lastFinishedPulling="2026-05-26 07:01:30.621527535 +0000 UTC m=+286.183883214" observedRunningTime="2026-05-26 07:01:31.880696268 +0000 UTC m=+287.443051963" watchObservedRunningTime="2026-05-26 07:01:31.880925125 +0000 UTC m=+287.443280819"
May 26 07:01:31.896784 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:31.896742    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7ln8s" podStartSLOduration=267.291404529 podStartE2EDuration="4m28.896730028s" podCreationTimestamp="2026-05-26 06:57:03 +0000 UTC" firstStartedPulling="2026-05-26 07:01:29.012238295 +0000 UTC m=+284.574593967" lastFinishedPulling="2026-05-26 07:01:30.617563789 +0000 UTC m=+286.179919466" observedRunningTime="2026-05-26 07:01:31.895476989 +0000 UTC m=+287.457832684" watchObservedRunningTime="2026-05-26 07:01:31.896730028 +0000 UTC m=+287.459085745"
May 26 07:01:31.911320 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:31.911280    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fp6ht" podStartSLOduration=252.047384456 podStartE2EDuration="4m13.911268011s" podCreationTimestamp="2026-05-26 06:57:18 +0000 UTC" firstStartedPulling="2026-05-26 07:01:29.279110155 +0000 UTC m=+284.841465826" lastFinishedPulling="2026-05-26 07:01:31.142993709 +0000 UTC m=+286.705349381" observedRunningTime="2026-05-26 07:01:31.91056252 +0000 UTC m=+287.472918214" watchObservedRunningTime="2026-05-26 07:01:31.911268011 +0000 UTC m=+287.473623734"
May 26 07:01:41.870810 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:41.870777    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7ccz7"
May 26 07:01:44.965146 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:44.965113    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:01:44.965604 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:44.965581    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:01:44.971092 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:01:44.971070    2564 kubelet.go:1628] "Image garbage collection succeeded"
May 26 07:06:44.985876 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:06:44.985848    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:06:44.986334 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:06:44.986160    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:10:11.177632 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.177549    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-cdcxn"]
May 26 07:10:11.180645 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.180627    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-cdcxn"
May 26 07:10:11.183115 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.183092    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 07:10:11.183220 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.183140    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-c5m58\""
May 26 07:10:11.183220 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.183154    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 26 07:10:11.183220 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.183092    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 07:10:11.188753 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.188729    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-cdcxn"]
May 26 07:10:11.272983 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.272946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9wpt\" (UniqueName: \"kubernetes.io/projected/8869b5ee-1055-4e22-bbb2-1af5059233a4-kube-api-access-h9wpt\") pod \"feast-test-apply-cdcxn\" (UID: \"8869b5ee-1055-4e22-bbb2-1af5059233a4\") " pod="test-ns-feast/feast-test-apply-cdcxn"
May 26 07:10:11.373803 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.373757    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9wpt\" (UniqueName: \"kubernetes.io/projected/8869b5ee-1055-4e22-bbb2-1af5059233a4-kube-api-access-h9wpt\") pod \"feast-test-apply-cdcxn\" (UID: \"8869b5ee-1055-4e22-bbb2-1af5059233a4\") " pod="test-ns-feast/feast-test-apply-cdcxn"
May 26 07:10:11.382435 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.382409    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9wpt\" (UniqueName: \"kubernetes.io/projected/8869b5ee-1055-4e22-bbb2-1af5059233a4-kube-api-access-h9wpt\") pod \"feast-test-apply-cdcxn\" (UID: \"8869b5ee-1055-4e22-bbb2-1af5059233a4\") " pod="test-ns-feast/feast-test-apply-cdcxn"
May 26 07:10:11.490835 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.490750    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-cdcxn"
May 26 07:10:11.616502 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.616467    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-cdcxn"]
May 26 07:10:11.619647 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:10:11.619617    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8869b5ee_1055_4e22_bbb2_1af5059233a4.slice/crio-449e169e587b6664e82b4db82e5e851d03c0e1bdb3401f58d7a8ca5e37cbc848 WatchSource:0}: Error finding container 449e169e587b6664e82b4db82e5e851d03c0e1bdb3401f58d7a8ca5e37cbc848: Status 404 returned error can't find the container with id 449e169e587b6664e82b4db82e5e851d03c0e1bdb3401f58d7a8ca5e37cbc848
May 26 07:10:11.621278 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:11.621261    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 07:10:12.182564 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:12.182522    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cdcxn" event={"ID":"8869b5ee-1055-4e22-bbb2-1af5059233a4","Type":"ContainerStarted","Data":"449e169e587b6664e82b4db82e5e851d03c0e1bdb3401f58d7a8ca5e37cbc848"}
May 26 07:10:18.201812 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:18.201763    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cdcxn" event={"ID":"8869b5ee-1055-4e22-bbb2-1af5059233a4","Type":"ContainerStarted","Data":"64ee54e8d9b43aab5568c3fc9cc4a5a6bd44fa7da8a05f7db53c03131dd37a0b"}
May 26 07:10:24.217785 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:24.217749    2564 generic.go:358] "Generic (PLEG): container finished" podID="8869b5ee-1055-4e22-bbb2-1af5059233a4" containerID="64ee54e8d9b43aab5568c3fc9cc4a5a6bd44fa7da8a05f7db53c03131dd37a0b" exitCode=0
May 26 07:10:24.218164 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:24.217812    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cdcxn" event={"ID":"8869b5ee-1055-4e22-bbb2-1af5059233a4","Type":"ContainerDied","Data":"64ee54e8d9b43aab5568c3fc9cc4a5a6bd44fa7da8a05f7db53c03131dd37a0b"}
May 26 07:10:25.221981 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:25.221946    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cdcxn" event={"ID":"8869b5ee-1055-4e22-bbb2-1af5059233a4","Type":"ContainerStarted","Data":"05e446e8fd609743b7ad264a6694efcaef8eb88ad5ff0ad0588c075f76f8dbdf"}
May 26 07:10:25.238230 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:25.238182    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-cdcxn" podStartSLOduration=8.155265471 podStartE2EDuration="14.238169451s" podCreationTimestamp="2026-05-26 07:10:11 +0000 UTC" firstStartedPulling="2026-05-26 07:10:11.621395012 +0000 UTC m=+807.183750684" lastFinishedPulling="2026-05-26 07:10:17.704298951 +0000 UTC m=+813.266654664" observedRunningTime="2026-05-26 07:10:25.236618578 +0000 UTC m=+820.798974272" watchObservedRunningTime="2026-05-26 07:10:25.238169451 +0000 UTC m=+820.800525145"
May 26 07:10:34.246346 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:34.246315    2564 generic.go:358] "Generic (PLEG): container finished" podID="8869b5ee-1055-4e22-bbb2-1af5059233a4" containerID="05e446e8fd609743b7ad264a6694efcaef8eb88ad5ff0ad0588c075f76f8dbdf" exitCode=0
May 26 07:10:34.246709 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:34.246382    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cdcxn" event={"ID":"8869b5ee-1055-4e22-bbb2-1af5059233a4","Type":"ContainerDied","Data":"05e446e8fd609743b7ad264a6694efcaef8eb88ad5ff0ad0588c075f76f8dbdf"}
May 26 07:10:35.369430 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:35.369406    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-cdcxn"
May 26 07:10:35.442663 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:35.442638    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9wpt\" (UniqueName: \"kubernetes.io/projected/8869b5ee-1055-4e22-bbb2-1af5059233a4-kube-api-access-h9wpt\") pod \"8869b5ee-1055-4e22-bbb2-1af5059233a4\" (UID: \"8869b5ee-1055-4e22-bbb2-1af5059233a4\") "
May 26 07:10:35.444606 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:35.444581    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8869b5ee-1055-4e22-bbb2-1af5059233a4-kube-api-access-h9wpt" (OuterVolumeSpecName: "kube-api-access-h9wpt") pod "8869b5ee-1055-4e22-bbb2-1af5059233a4" (UID: "8869b5ee-1055-4e22-bbb2-1af5059233a4"). InnerVolumeSpecName "kube-api-access-h9wpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:10:35.543155 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:35.543089    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9wpt\" (UniqueName: \"kubernetes.io/projected/8869b5ee-1055-4e22-bbb2-1af5059233a4-kube-api-access-h9wpt\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:10:36.252678 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:36.252640    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cdcxn" event={"ID":"8869b5ee-1055-4e22-bbb2-1af5059233a4","Type":"ContainerDied","Data":"449e169e587b6664e82b4db82e5e851d03c0e1bdb3401f58d7a8ca5e37cbc848"}
May 26 07:10:36.252678 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:36.252673    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-cdcxn"
May 26 07:10:36.252889 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:36.252675    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="449e169e587b6664e82b4db82e5e851d03c0e1bdb3401f58d7a8ca5e37cbc848"
May 26 07:10:36.426804 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:36.426774    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-cdcxn_8869b5ee-1055-4e22-bbb2-1af5059233a4/feast-0/0.log"
May 26 07:10:36.433154 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:10:36.433138    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-cdcxn_8869b5ee-1055-4e22-bbb2-1af5059233a4/feast-1/0.log"
May 26 07:11:12.358822 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:11:12.358787    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-cdcxn"]
May 26 07:11:12.371056 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:11:12.371027    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-cdcxn"]
May 26 07:11:13.058739 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:11:13.058706    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8869b5ee-1055-4e22-bbb2-1af5059233a4" path="/var/lib/kubelet/pods/8869b5ee-1055-4e22-bbb2-1af5059233a4/volumes"
May 26 07:11:45.003633 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:11:45.003605    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:11:45.005228 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:11:45.005204    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:15:56.594498 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.594461    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"]
May 26 07:15:56.594926 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.594710    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8869b5ee-1055-4e22-bbb2-1af5059233a4" containerName="feast-1"
May 26 07:15:56.594926 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.594721    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8869b5ee-1055-4e22-bbb2-1af5059233a4" containerName="feast-1"
May 26 07:15:56.594926 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.594735    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8869b5ee-1055-4e22-bbb2-1af5059233a4" containerName="feast-0"
May 26 07:15:56.594926 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.594741    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8869b5ee-1055-4e22-bbb2-1af5059233a4" containerName="feast-0"
May 26 07:15:56.594926 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.594781    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="8869b5ee-1055-4e22-bbb2-1af5059233a4" containerName="feast-1"
May 26 07:15:56.597479 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.597462    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"
May 26 07:15:56.599972 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.599947    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 07:15:56.600651 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.600631    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-rcr6g\""
May 26 07:15:56.600651 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.600642    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 07:15:56.616695 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.616661    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"]
May 26 07:15:56.684629 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.684588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzss\" (UniqueName: \"kubernetes.io/projected/992b3056-c8e2-41da-ba8e-cba11dd5eebc-kube-api-access-jfzss\") pod \"feast-operator-controller-manager-cf99db75-vsm6s\" (UID: \"992b3056-c8e2-41da-ba8e-cba11dd5eebc\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"
May 26 07:15:56.784994 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.784958    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzss\" (UniqueName: \"kubernetes.io/projected/992b3056-c8e2-41da-ba8e-cba11dd5eebc-kube-api-access-jfzss\") pod \"feast-operator-controller-manager-cf99db75-vsm6s\" (UID: \"992b3056-c8e2-41da-ba8e-cba11dd5eebc\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"
May 26 07:15:56.796301 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.796273    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzss\" (UniqueName: \"kubernetes.io/projected/992b3056-c8e2-41da-ba8e-cba11dd5eebc-kube-api-access-jfzss\") pod \"feast-operator-controller-manager-cf99db75-vsm6s\" (UID: \"992b3056-c8e2-41da-ba8e-cba11dd5eebc\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"
May 26 07:15:56.907546 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:56.907463    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"
May 26 07:15:57.027919 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:57.027894    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"]
May 26 07:15:57.030460 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:15:57.030434    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992b3056_c8e2_41da_ba8e_cba11dd5eebc.slice/crio-59ad224e0736a531c92742ca8e3938f8bd0584291a2b9bf06503ee3c2044a520 WatchSource:0}: Error finding container 59ad224e0736a531c92742ca8e3938f8bd0584291a2b9bf06503ee3c2044a520: Status 404 returned error can't find the container with id 59ad224e0736a531c92742ca8e3938f8bd0584291a2b9bf06503ee3c2044a520
May 26 07:15:57.032083 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:57.032066    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 07:15:57.071376 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:15:57.071348    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s" event={"ID":"992b3056-c8e2-41da-ba8e-cba11dd5eebc","Type":"ContainerStarted","Data":"59ad224e0736a531c92742ca8e3938f8bd0584291a2b9bf06503ee3c2044a520"}
May 26 07:16:01.088856 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:01.088798    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s" event={"ID":"992b3056-c8e2-41da-ba8e-cba11dd5eebc","Type":"ContainerStarted","Data":"506b7ed5cdeb00b03a195696441bbd9b52999f8e50c09cf7aa051d7be0597ab7"}
May 26 07:16:01.089283 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:01.089024    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"
May 26 07:16:01.107663 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:01.107616    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s" podStartSLOduration=1.469547715 podStartE2EDuration="5.10760033s" podCreationTimestamp="2026-05-26 07:15:56 +0000 UTC" firstStartedPulling="2026-05-26 07:15:57.032204323 +0000 UTC m=+1152.594559995" lastFinishedPulling="2026-05-26 07:16:00.670256926 +0000 UTC m=+1156.232612610" observedRunningTime="2026-05-26 07:16:01.106995777 +0000 UTC m=+1156.669351475" watchObservedRunningTime="2026-05-26 07:16:01.10760033 +0000 UTC m=+1156.669956028"
May 26 07:16:12.094171 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:12.094145    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"
May 26 07:16:13.353883 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.353850    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"]
May 26 07:16:13.357133 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.357116    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.359765 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.359745    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 07:16:13.359886 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.359773    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 07:16:13.359886 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.359795    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 07:16:13.360104 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.359921    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 07:16:13.360104 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.360055    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-hgd4q\""
May 26 07:16:13.360442 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.360421    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 07:16:13.360743 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.360721    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 07:16:13.367850 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.367827    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"]
May 26 07:16:13.400200 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.400180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0094589-b831-4074-bd69-f944b5476b29-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.400295 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.400210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kss7p\" (UniqueName: \"kubernetes.io/projected/e0094589-b831-4074-bd69-f944b5476b29-kube-api-access-kss7p\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.400295 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.400232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.400295 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.400253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.400398 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.400302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.400398 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.400328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.500685 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.500661    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0094589-b831-4074-bd69-f944b5476b29-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.500815 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.500695    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kss7p\" (UniqueName: \"kubernetes.io/projected/e0094589-b831-4074-bd69-f944b5476b29-kube-api-access-kss7p\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.500815 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.500719    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.500903 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.500835    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.500903 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.500882    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.501000 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.500932    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.501084 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:16:13.501001    2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 07:16:13.501084 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:16:13.501052    2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 26 07:16:13.501084 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.501025    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0094589-b831-4074-bd69-f944b5476b29-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.501224 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:16:13.501115    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-registry-tls podName:e0094589-b831-4074-bd69-f944b5476b29 nodeName:}" failed. No retries permitted until 2026-05-26 07:16:14.001092216 +0000 UTC m=+1169.563447902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-5m9b2" (UID: "e0094589-b831-4074-bd69-f944b5476b29") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 07:16:13.501224 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:16:13.501138    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-offline-tls podName:e0094589-b831-4074-bd69-f944b5476b29 nodeName:}" failed. No retries permitted until 2026-05-26 07:16:14.001127995 +0000 UTC m=+1169.563483673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-5m9b2" (UID: "e0094589-b831-4074-bd69-f944b5476b29") : secret "feast-simple-feast-setup-offline-tls" not found
May 26 07:16:13.506450 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.506426    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.506602 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.506454    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:13.511489 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:13.511468    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kss7p\" (UniqueName: \"kubernetes.io/projected/e0094589-b831-4074-bd69-f944b5476b29-kube-api-access-kss7p\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:14.005183 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:14.005146    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:14.005348 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:14.005255    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:14.007611 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:14.007583    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:14.007707 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:14.007611    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-5m9b2\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:14.266081 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:14.265990    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:14.390064 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:14.390038    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"]
May 26 07:16:14.392648 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:16:14.392625    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0094589_b831_4074_bd69_f944b5476b29.slice/crio-16bc7286ec71897706ad5acc366c8fc1200e0114e4688a5e54a81f0d96df700d WatchSource:0}: Error finding container 16bc7286ec71897706ad5acc366c8fc1200e0114e4688a5e54a81f0d96df700d: Status 404 returned error can't find the container with id 16bc7286ec71897706ad5acc366c8fc1200e0114e4688a5e54a81f0d96df700d
May 26 07:16:15.130187 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:15.130132    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerStarted","Data":"16bc7286ec71897706ad5acc366c8fc1200e0114e4688a5e54a81f0d96df700d"}
May 26 07:16:30.174983 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:30.174945    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerStarted","Data":"6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7"}
May 26 07:16:35.191696 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:35.191661    2564 generic.go:358] "Generic (PLEG): container finished" podID="e0094589-b831-4074-bd69-f944b5476b29" containerID="6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7" exitCode=0
May 26 07:16:35.192169 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:35.191739    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerDied","Data":"6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7"}
May 26 07:16:36.196015 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:36.195968    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerStarted","Data":"0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530"}
May 26 07:16:41.211227 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:41.211155    2564 generic.go:358] "Generic (PLEG): container finished" podID="e0094589-b831-4074-bd69-f944b5476b29" containerID="0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530" exitCode=0
May 26 07:16:41.211227 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:41.211190    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerDied","Data":"0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530"}
May 26 07:16:42.219325 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:42.219282    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerStarted","Data":"75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c"}
May 26 07:16:42.219325 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:42.219330    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerStarted","Data":"cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c"}
May 26 07:16:42.219865 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:42.219346    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerStarted","Data":"20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779"}
May 26 07:16:42.219865 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:42.219361    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerStarted","Data":"cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92"}
May 26 07:16:42.243242 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:42.243169    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podStartSLOduration=13.672315385 podStartE2EDuration="29.243151353s" podCreationTimestamp="2026-05-26 07:16:13 +0000 UTC" firstStartedPulling="2026-05-26 07:16:14.394379993 +0000 UTC m=+1169.956735670" lastFinishedPulling="2026-05-26 07:16:29.965215963 +0000 UTC m=+1185.527571638" observedRunningTime="2026-05-26 07:16:42.242048574 +0000 UTC m=+1197.804404274" watchObservedRunningTime="2026-05-26 07:16:42.243151353 +0000 UTC m=+1197.805507048"
May 26 07:16:44.267098 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.266927    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:44.267098 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.266986    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:44.267098 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.267001    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:44.267098 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.267030    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:44.267098 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.267043    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:44.267098 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.267055    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:44.267098 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.267067    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:44.267888 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.267471    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:44.269342 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.269301    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused"
May 26 07:16:44.269342 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.269325    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.16:8816: connect: connection refused"
May 26 07:16:44.269551 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.269358    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.16:6571: connect: connection refused"
May 26 07:16:44.269551 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:44.269498    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused"
May 26 07:16:45.021093 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:45.021057    2564 scope.go:117] "RemoveContainer" containerID="64ee54e8d9b43aab5568c3fc9cc4a5a6bd44fa7da8a05f7db53c03131dd37a0b"
May 26 07:16:45.032705 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:45.032678    2564 scope.go:117] "RemoveContainer" containerID="05e446e8fd609743b7ad264a6694efcaef8eb88ad5ff0ad0588c075f76f8dbdf"
May 26 07:16:45.037335 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:45.037307    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:16:45.038636 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:45.038615    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:16:47.267166 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:47.267133    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:47.267638 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:47.267410    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:47.267638 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:47.267555    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:47.268246 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:47.268219    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:47.268369 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:47.268343    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:47.268469 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:47.268451    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:47.271707 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:47.271690    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:16:48.240464 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:16:48.240432    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:17:50.708965 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:50.708927    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"]
May 26 07:17:50.709528 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:50.709287    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="registry" containerID="cri-o://cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92" gracePeriod=30
May 26 07:17:50.709528 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:50.709333    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="ui" containerID="cri-o://75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c" gracePeriod=30
May 26 07:17:50.709528 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:50.709363    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="offline" containerID="cri-o://cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c" gracePeriod=30
May 26 07:17:50.709528 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:50.709365    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="online" containerID="cri-o://20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779" gracePeriod=30
May 26 07:17:51.165772 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.165744    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"]
May 26 07:17:51.168994 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.168976    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.172508 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.172483    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tthjt\""
May 26 07:17:51.186380 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.186350    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"]
May 26 07:17:51.244286 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.244248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.244428 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.244333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.244428 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.244355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.244428 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.244382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.244428 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.244401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4l6p\" (UniqueName: \"kubernetes.io/projected/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-kube-api-access-t4l6p\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.244428 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.244427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.345275 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.345249    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.345385 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.345288    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4l6p\" (UniqueName: \"kubernetes.io/projected/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-kube-api-access-t4l6p\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.345385 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.345328    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.345385 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.345361    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.345548 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.345444    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.345593 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.345575    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.345642 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.345613    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.347758 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.347730    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.347758 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.347746    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.347916 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.347767    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.347916 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.347783    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.357228 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.357207    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4l6p\" (UniqueName: \"kubernetes.io/projected/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-kube-api-access-t4l6p\") pod \"feast-simple-feast-setup-664fcfcc58-hcf8m\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.420324 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.420256    2564 generic.go:358] "Generic (PLEG): container finished" podID="e0094589-b831-4074-bd69-f944b5476b29" containerID="75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c" exitCode=0
May 26 07:17:51.420324 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.420297    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerDied","Data":"75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c"}
May 26 07:17:51.477401 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.477375    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:17:51.615645 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:51.615599    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"]
May 26 07:17:52.425730 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:52.425694    2564 generic.go:358] "Generic (PLEG): container finished" podID="e0094589-b831-4074-bd69-f944b5476b29" containerID="20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779" exitCode=0
May 26 07:17:52.426151 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:52.425771    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerDied","Data":"20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779"}
May 26 07:17:52.427146 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:52.427125    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerStarted","Data":"19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19"}
May 26 07:17:52.427244 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:52.427153    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerStarted","Data":"2e24f25ec6637ec0580043b4e647c8aedce91940c5e6f37db317adefed9c20f9"}
May 26 07:17:56.443465 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:56.443431    2564 generic.go:358] "Generic (PLEG): container finished" podID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerID="19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19" exitCode=0
May 26 07:17:56.443972 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:56.443509    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerDied","Data":"19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19"}
May 26 07:17:57.268447 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:57.268394    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused"
May 26 07:17:57.448065 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:57.448024    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerStarted","Data":"dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54"}
May 26 07:17:58.238433 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:17:58.238381    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused"
May 26 07:18:02.462546 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:02.462511    2564 generic.go:358] "Generic (PLEG): container finished" podID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerID="dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54" exitCode=0
May 26 07:18:02.463030 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:02.462565    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerDied","Data":"dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54"}
May 26 07:18:03.469457 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.469419    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerStarted","Data":"1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f"}
May 26 07:18:03.469457 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.469461    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerStarted","Data":"dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422"}
May 26 07:18:03.469977 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.469475    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerStarted","Data":"d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c"}
May 26 07:18:03.469977 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.469490    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerStarted","Data":"d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54"}
May 26 07:18:03.477772 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.477739    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:03.477917 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.477785    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:03.477917 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.477805    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:03.477917 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.477818    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:03.479921 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.479888    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 26 07:18:03.480156 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.479938    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 26 07:18:03.480245 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.479940    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused"
May 26 07:18:03.480306 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.479985    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 26 07:18:03.496441 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:03.496316    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podStartSLOduration=12.496301266 podStartE2EDuration="12.496301266s" podCreationTimestamp="2026-05-26 07:17:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:18:03.4942966 +0000 UTC m=+1279.056652306" watchObservedRunningTime="2026-05-26 07:18:03.496301266 +0000 UTC m=+1279.058656962"
May 26 07:18:06.478126 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:06.477970    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 26 07:18:06.478126 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:06.477989    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 26 07:18:06.478866 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:06.478831    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 26 07:18:06.478968 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:06.478921    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused"
May 26 07:18:07.269252 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:07.269207    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused"
May 26 07:18:08.238317 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:08.238273    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused"
May 26 07:18:09.479293 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.479264    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.479646 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.479370    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.479686 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.479653    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.480226 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.480202    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.480348 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.480321    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.480348 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.480340    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.480488 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.480474    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.480557 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.480540    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.480659 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.480643    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.484002 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.483984    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.489526 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.489506    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:09.492132 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:09.492114    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:18:17.268729 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:17.268673    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused"
May 26 07:18:17.269174 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:17.268803    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:18:18.237895 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:18.237854    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused"
May 26 07:18:18.238100 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:18.238028    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:18:21.351577 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.351554    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:18:21.476448 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.476379    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kss7p\" (UniqueName: \"kubernetes.io/projected/e0094589-b831-4074-bd69-f944b5476b29-kube-api-access-kss7p\") pod \"e0094589-b831-4074-bd69-f944b5476b29\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") "
May 26 07:18:21.476448 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.476411    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-offline-tls\") pod \"e0094589-b831-4074-bd69-f944b5476b29\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") "
May 26 07:18:21.476448 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.476442    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0094589-b831-4074-bd69-f944b5476b29-feast-data\") pod \"e0094589-b831-4074-bd69-f944b5476b29\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") "
May 26 07:18:21.476685 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.476528    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-online-tls\") pod \"e0094589-b831-4074-bd69-f944b5476b29\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") "
May 26 07:18:21.476685 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.476564    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-ui-tls\") pod \"e0094589-b831-4074-bd69-f944b5476b29\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") "
May 26 07:18:21.476685 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.476604    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-registry-tls\") pod \"e0094589-b831-4074-bd69-f944b5476b29\" (UID: \"e0094589-b831-4074-bd69-f944b5476b29\") "
May 26 07:18:21.477114 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.477078    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0094589-b831-4074-bd69-f944b5476b29-feast-data" (OuterVolumeSpecName: "feast-data") pod "e0094589-b831-4074-bd69-f944b5476b29" (UID: "e0094589-b831-4074-bd69-f944b5476b29"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:18:21.478841 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.478812    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e0094589-b831-4074-bd69-f944b5476b29" (UID: "e0094589-b831-4074-bd69-f944b5476b29"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:18:21.478841 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.478828    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-online-tls" (OuterVolumeSpecName: "online-tls") pod "e0094589-b831-4074-bd69-f944b5476b29" (UID: "e0094589-b831-4074-bd69-f944b5476b29"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:18:21.478970 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.478828    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0094589-b831-4074-bd69-f944b5476b29-kube-api-access-kss7p" (OuterVolumeSpecName: "kube-api-access-kss7p") pod "e0094589-b831-4074-bd69-f944b5476b29" (UID: "e0094589-b831-4074-bd69-f944b5476b29"). InnerVolumeSpecName "kube-api-access-kss7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:18:21.479075 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.479055    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e0094589-b831-4074-bd69-f944b5476b29" (UID: "e0094589-b831-4074-bd69-f944b5476b29"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:18:21.479144 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.479127    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e0094589-b831-4074-bd69-f944b5476b29" (UID: "e0094589-b831-4074-bd69-f944b5476b29"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:18:21.523791 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.523766    2564 generic.go:358] "Generic (PLEG): container finished" podID="e0094589-b831-4074-bd69-f944b5476b29" containerID="cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c" exitCode=137
May 26 07:18:21.523791 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.523787    2564 generic.go:358] "Generic (PLEG): container finished" podID="e0094589-b831-4074-bd69-f944b5476b29" containerID="cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92" exitCode=137
May 26 07:18:21.523914 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.523811    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerDied","Data":"cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c"}
May 26 07:18:21.523914 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.523839    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerDied","Data":"cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92"}
May 26 07:18:21.523914 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.523845    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"
May 26 07:18:21.523914 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.523858    2564 scope.go:117] "RemoveContainer" containerID="75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c"
May 26 07:18:21.524121 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.523849    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2" event={"ID":"e0094589-b831-4074-bd69-f944b5476b29","Type":"ContainerDied","Data":"16bc7286ec71897706ad5acc366c8fc1200e0114e4688a5e54a81f0d96df700d"}
May 26 07:18:21.531739 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.531719    2564 scope.go:117] "RemoveContainer" containerID="cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c"
May 26 07:18:21.540340 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.540322    2564 scope.go:117] "RemoveContainer" containerID="20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779"
May 26 07:18:21.547364 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.547340    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"]
May 26 07:18:21.547661 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.547642    2564 scope.go:117] "RemoveContainer" containerID="cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92"
May 26 07:18:21.550404 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.550378    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-5m9b2"]
May 26 07:18:21.554412 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.554396    2564 scope.go:117] "RemoveContainer" containerID="0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530"
May 26 07:18:21.560840 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.560824    2564 scope.go:117] "RemoveContainer" containerID="6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7"
May 26 07:18:21.566831 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.566815    2564 scope.go:117] "RemoveContainer" containerID="75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c"
May 26 07:18:21.567083 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:18:21.567065    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c\": container with ID starting with 75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c not found: ID does not exist" containerID="75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c"
May 26 07:18:21.567159 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.567088    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c"} err="failed to get container status \"75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c\": rpc error: code = NotFound desc = could not find container \"75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c\": container with ID starting with 75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c not found: ID does not exist"
May 26 07:18:21.567159 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.567104    2564 scope.go:117] "RemoveContainer" containerID="cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c"
May 26 07:18:21.567334 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:18:21.567316    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c\": container with ID starting with cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c not found: ID does not exist" containerID="cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c"
May 26 07:18:21.567375 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.567340    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c"} err="failed to get container status \"cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c\": rpc error: code = NotFound desc = could not find container \"cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c\": container with ID starting with cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c not found: ID does not exist"
May 26 07:18:21.567375 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.567356    2564 scope.go:117] "RemoveContainer" containerID="20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779"
May 26 07:18:21.567569 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:18:21.567553    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779\": container with ID starting with 20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779 not found: ID does not exist" containerID="20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779"
May 26 07:18:21.567616 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.567572    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779"} err="failed to get container status \"20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779\": rpc error: code = NotFound desc = could not find container \"20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779\": container with ID starting with 20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779 not found: ID does not exist"
May 26 07:18:21.567616 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.567584    2564 scope.go:117] "RemoveContainer" containerID="cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92"
May 26 07:18:21.567793 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:18:21.567779    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92\": container with ID starting with cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92 not found: ID does not exist" containerID="cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92"
May 26 07:18:21.567828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.567795    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92"} err="failed to get container status \"cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92\": rpc error: code = NotFound desc = could not find container \"cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92\": container with ID starting with cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92 not found: ID does not exist"
May 26 07:18:21.567828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.567807    2564 scope.go:117] "RemoveContainer" containerID="0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530"
May 26 07:18:21.568000 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:18:21.567986    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530\": container with ID starting with 0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530 not found: ID does not exist" containerID="0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530"
May 26 07:18:21.568065 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568016    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530"} err="failed to get container status \"0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530\": rpc error: code = NotFound desc = could not find container \"0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530\": container with ID starting with 0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530 not found: ID does not exist"
May 26 07:18:21.568065 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568033    2564 scope.go:117] "RemoveContainer" containerID="6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7"
May 26 07:18:21.568256 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:18:21.568241    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7\": container with ID starting with 6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7 not found: ID does not exist" containerID="6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7"
May 26 07:18:21.568296 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568257    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7"} err="failed to get container status \"6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7\": rpc error: code = NotFound desc = could not find container \"6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7\": container with ID starting with 6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7 not found: ID does not exist"
May 26 07:18:21.568296 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568269    2564 scope.go:117] "RemoveContainer" containerID="75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c"
May 26 07:18:21.568463 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568449    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c"} err="failed to get container status \"75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c\": rpc error: code = NotFound desc = could not find container \"75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c\": container with ID starting with 75633add68951943fe3cc52b655a91294f35c4f0bbd4529a1ed512c6241ece8c not found: ID does not exist"
May 26 07:18:21.568505 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568464    2564 scope.go:117] "RemoveContainer" containerID="cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c"
May 26 07:18:21.568671 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568648    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c"} err="failed to get container status \"cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c\": rpc error: code = NotFound desc = could not find container \"cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c\": container with ID starting with cc855114b2e82db84567fcff2af394402b9c2d472d1c8fbb78d3f99a38f76b3c not found: ID does not exist"
May 26 07:18:21.568712 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568673    2564 scope.go:117] "RemoveContainer" containerID="20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779"
May 26 07:18:21.568882 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568863    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779"} err="failed to get container status \"20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779\": rpc error: code = NotFound desc = could not find container \"20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779\": container with ID starting with 20d6937b13210702ab818b41acea53886be086e048232fe075593a8aa9da1779 not found: ID does not exist"
May 26 07:18:21.568931 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.568883    2564 scope.go:117] "RemoveContainer" containerID="cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92"
May 26 07:18:21.569092 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.569075    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92"} err="failed to get container status \"cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92\": rpc error: code = NotFound desc = could not find container \"cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92\": container with ID starting with cb09417f73991b8f98d4d9a673808dbf1c1aa0df4bc38e42cfe1042052e4fa92 not found: ID does not exist"
May 26 07:18:21.569092 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.569091    2564 scope.go:117] "RemoveContainer" containerID="0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530"
May 26 07:18:21.569258 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.569244    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530"} err="failed to get container status \"0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530\": rpc error: code = NotFound desc = could not find container \"0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530\": container with ID starting with 0f9e64bb29825537dbce8875c1770b3bec85832def09fd2fcd93b632eb24d530 not found: ID does not exist"
May 26 07:18:21.569258 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.569258    2564 scope.go:117] "RemoveContainer" containerID="6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7"
May 26 07:18:21.569443 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.569422    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7"} err="failed to get container status \"6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7\": rpc error: code = NotFound desc = could not find container \"6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7\": container with ID starting with 6c854518ffef9254776d5d6f79d6c6e391e7ddd130db30b8f17ca61a487724c7 not found: ID does not exist"
May 26 07:18:21.577742 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.577722    2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0094589-b831-4074-bd69-f944b5476b29-feast-data\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:18:21.577803 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.577745    2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-online-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:18:21.577803 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.577754    2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-ui-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:18:21.577803 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.577762    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-registry-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:18:21.577803 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.577771    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kss7p\" (UniqueName: \"kubernetes.io/projected/e0094589-b831-4074-bd69-f944b5476b29-kube-api-access-kss7p\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:18:21.577803 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:21.577779    2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0094589-b831-4074-bd69-f944b5476b29-offline-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:18:23.059055 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:18:23.059026    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0094589-b831-4074-bd69-f944b5476b29" path="/var/lib/kubelet/pods/e0094589-b831-4074-bd69-f944b5476b29/volumes"
May 26 07:19:12.667226 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667024    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"]
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667396    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="feast-apply"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667414    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="feast-apply"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667437    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="online"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667447    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="online"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667462    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="registry"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667472    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="registry"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667487    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="feast-init"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667495    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="feast-init"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667506    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="offline"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667514    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="offline"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667524    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="ui"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667532    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="ui"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667610    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="ui"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667621    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="registry"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667631    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="offline"
May 26 07:19:12.667715 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.667644    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0094589-b831-4074-bd69-f944b5476b29" containerName="online"
May 26 07:19:12.670904 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.670887    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.675188 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.675162    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 07:19:12.675489 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.675472    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 07:19:12.678325 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.675758    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 07:19:12.678325 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.675975    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-pld89\""
May 26 07:19:12.678325 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.676204    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 07:19:12.678325 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.676403    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 07:19:12.678325 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.677085    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 07:19:12.681029 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.680994    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"]
May 26 07:19:12.724509 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.724483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.724613 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.724526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5a811c-9f55-40e0-99f5-39edb3f4265f-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.724613 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.724556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.724700 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.724672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac5a811c-9f55-40e0-99f5-39edb3f4265f-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.724744 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.724702    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw487\" (UniqueName: \"kubernetes.io/projected/ac5a811c-9f55-40e0-99f5-39edb3f4265f-kube-api-access-jw487\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.724744 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.724727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.825697 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.825674    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5a811c-9f55-40e0-99f5-39edb3f4265f-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.825816 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.825706    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.825876 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.825838    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac5a811c-9f55-40e0-99f5-39edb3f4265f-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.825876 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.825869    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jw487\" (UniqueName: \"kubernetes.io/projected/ac5a811c-9f55-40e0-99f5-39edb3f4265f-kube-api-access-jw487\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.825984 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.825887    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.825984 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.825912    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.826119 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:19:12.826025    2564 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 07:19:12.826119 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:19:12.826091    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-ui-tls podName:ac5a811c-9f55-40e0-99f5-39edb3f4265f nodeName:}" failed. No retries permitted until 2026-05-26 07:19:13.326071123 +0000 UTC m=+1348.888426813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-ui-tls") pod "feast-simple-feast-remote-setup-5cff94746b-rwjhp" (UID: "ac5a811c-9f55-40e0-99f5-39edb3f4265f") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 07:19:12.826222 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.826158    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5a811c-9f55-40e0-99f5-39edb3f4265f-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.826495 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.826472    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac5a811c-9f55-40e0-99f5-39edb3f4265f-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.828063 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.828041    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.828136 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.828116    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:12.834060 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:12.834036    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw487\" (UniqueName: \"kubernetes.io/projected/ac5a811c-9f55-40e0-99f5-39edb3f4265f-kube-api-access-jw487\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:13.329018 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:13.328968    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:13.331310 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:13.331291    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rwjhp\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:13.584243 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:13.584164    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:13.710717 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:13.710696    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"]
May 26 07:19:13.712353 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:19:13.712327    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac5a811c_9f55_40e0_99f5_39edb3f4265f.slice/crio-eca73a2c1d00c0f116d7db1a48487c84bac3ae3c86a30856564c79aa5fbac15e WatchSource:0}: Error finding container eca73a2c1d00c0f116d7db1a48487c84bac3ae3c86a30856564c79aa5fbac15e: Status 404 returned error can't find the container with id eca73a2c1d00c0f116d7db1a48487c84bac3ae3c86a30856564c79aa5fbac15e
May 26 07:19:14.672380 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:14.672342    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerStarted","Data":"2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2"}
May 26 07:19:14.672380 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:14.672384    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerStarted","Data":"eca73a2c1d00c0f116d7db1a48487c84bac3ae3c86a30856564c79aa5fbac15e"}
May 26 07:19:18.685554 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:18.685522    2564 generic.go:358] "Generic (PLEG): container finished" podID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerID="2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2" exitCode=0
May 26 07:19:18.686025 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:18.685610    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerDied","Data":"2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2"}
May 26 07:19:19.690024 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:19.689973    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerStarted","Data":"8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89"}
May 26 07:19:24.705152 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:24.705120    2564 generic.go:358] "Generic (PLEG): container finished" podID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerID="8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89" exitCode=0
May 26 07:19:24.705513 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:24.705161    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerDied","Data":"8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89"}
May 26 07:19:25.710654 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:25.710607    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerStarted","Data":"0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1"}
May 26 07:19:25.711065 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:25.710661    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerStarted","Data":"02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb"}
May 26 07:19:25.711065 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:25.710677    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerStarted","Data":"24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb"}
May 26 07:19:25.738921 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:25.738860    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podStartSLOduration=13.738841560000001 podStartE2EDuration="13.73884156s" podCreationTimestamp="2026-05-26 07:19:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:19:25.736616959 +0000 UTC m=+1361.298972676" watchObservedRunningTime="2026-05-26 07:19:25.73884156 +0000 UTC m=+1361.301197255"
May 26 07:19:28.584989 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:28.584944    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:28.584989 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:28.585038    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:28.585748 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:28.585705    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:28.587663 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:28.587610    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 26 07:19:28.587864 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:28.587620    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.18:8816: connect: connection refused"
May 26 07:19:28.587864 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:28.587688    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 26 07:19:31.585512 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:31.585480    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:31.585928 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:31.585845    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:31.585999 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:31.585979    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:31.586394 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:31.586373    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:31.589642 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:31.589628    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:31.730059 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:31.730035    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:31.730059 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:31.730062    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:31.730506 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:31.730487    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:19:31.732884 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:19:31.732869    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:20:34.022844 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.022757    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"]
May 26 07:20:34.023412 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.023105    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="online" containerID="cri-o://24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb" gracePeriod=30
May 26 07:20:34.023412 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.023191    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="offline" containerID="cri-o://02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb" gracePeriod=30
May 26 07:20:34.023412 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.023191    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="ui" containerID="cri-o://0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1" gracePeriod=30
May 26 07:20:34.134299 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.134260    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"]
May 26 07:20:34.134737 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.134704    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="registry" containerID="cri-o://d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54" gracePeriod=30
May 26 07:20:34.134871 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.134798    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="ui" containerID="cri-o://1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f" gracePeriod=30
May 26 07:20:34.134939 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.134850    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="online" containerID="cri-o://d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c" gracePeriod=30
May 26 07:20:34.135001 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.134809    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="offline" containerID="cri-o://dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422" gracePeriod=30
May 26 07:20:34.906251 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.906221    2564 generic.go:358] "Generic (PLEG): container finished" podID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerID="0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1" exitCode=0
May 26 07:20:34.906251 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.906245    2564 generic.go:358] "Generic (PLEG): container finished" podID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerID="24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb" exitCode=0
May 26 07:20:34.906407 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.906296    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerDied","Data":"0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1"}
May 26 07:20:34.906407 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.906325    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerDied","Data":"24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb"}
May 26 07:20:34.908713 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.908690    2564 generic.go:358] "Generic (PLEG): container finished" podID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerID="1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f" exitCode=0
May 26 07:20:34.908713 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.908710    2564 generic.go:358] "Generic (PLEG): container finished" podID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerID="d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c" exitCode=0
May 26 07:20:34.908831 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.908760    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerDied","Data":"1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f"}
May 26 07:20:34.908831 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:34.908785    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerDied","Data":"d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c"}
May 26 07:20:39.480864 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:39.480817    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 26 07:20:39.489597 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:39.489565    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 26 07:20:41.586408 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:41.586364    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 26 07:20:41.730636 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:41.730585    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 26 07:20:49.480403 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:49.480350    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 26 07:20:49.490404 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:49.490372    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 26 07:20:51.586755 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:51.586711    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 26 07:20:51.730869 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:51.730822    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 26 07:20:59.480881 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:59.480833    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 26 07:20:59.481311 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:59.480990    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:20:59.490470 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:59.490443    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 26 07:20:59.490594 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:20:59.490525    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:21:01.586470 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:01.586427    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 26 07:21:01.586921 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:01.586555    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:21:01.730215 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:01.730161    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 26 07:21:01.730383 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:01.730291    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:21:04.244617 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.244597    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:21:04.346501 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.346463    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5a811c-9f55-40e0-99f5-39edb3f4265f-feast-data\") pod \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") "
May 26 07:21:04.346686 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.346512    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac5a811c-9f55-40e0-99f5-39edb3f4265f-registry-tls\") pod \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") "
May 26 07:21:04.346686 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.346541    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw487\" (UniqueName: \"kubernetes.io/projected/ac5a811c-9f55-40e0-99f5-39edb3f4265f-kube-api-access-jw487\") pod \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") "
May 26 07:21:04.346686 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.346586    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-offline-tls\") pod \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") "
May 26 07:21:04.346686 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.346614    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-online-tls\") pod \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") "
May 26 07:21:04.346686 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.346648    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-ui-tls\") pod \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\" (UID: \"ac5a811c-9f55-40e0-99f5-39edb3f4265f\") "
May 26 07:21:04.346952 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.346877    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac5a811c-9f55-40e0-99f5-39edb3f4265f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ac5a811c-9f55-40e0-99f5-39edb3f4265f" (UID: "ac5a811c-9f55-40e0-99f5-39edb3f4265f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:21:04.346952 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.346896    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5a811c-9f55-40e0-99f5-39edb3f4265f-feast-data" (OuterVolumeSpecName: "feast-data") pod "ac5a811c-9f55-40e0-99f5-39edb3f4265f" (UID: "ac5a811c-9f55-40e0-99f5-39edb3f4265f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:21:04.347089 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.347068    2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5a811c-9f55-40e0-99f5-39edb3f4265f-feast-data\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:04.347142 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.347096    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ac5a811c-9f55-40e0-99f5-39edb3f4265f-registry-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:04.349100 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.349025    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ac5a811c-9f55-40e0-99f5-39edb3f4265f" (UID: "ac5a811c-9f55-40e0-99f5-39edb3f4265f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:21:04.349100 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.349024    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5a811c-9f55-40e0-99f5-39edb3f4265f-kube-api-access-jw487" (OuterVolumeSpecName: "kube-api-access-jw487") pod "ac5a811c-9f55-40e0-99f5-39edb3f4265f" (UID: "ac5a811c-9f55-40e0-99f5-39edb3f4265f"). InnerVolumeSpecName "kube-api-access-jw487". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:21:04.349100 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.349085    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-online-tls" (OuterVolumeSpecName: "online-tls") pod "ac5a811c-9f55-40e0-99f5-39edb3f4265f" (UID: "ac5a811c-9f55-40e0-99f5-39edb3f4265f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:21:04.349271 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.349114    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ac5a811c-9f55-40e0-99f5-39edb3f4265f" (UID: "ac5a811c-9f55-40e0-99f5-39edb3f4265f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:21:04.448095 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.448054    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw487\" (UniqueName: \"kubernetes.io/projected/ac5a811c-9f55-40e0-99f5-39edb3f4265f-kube-api-access-jw487\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:04.448095 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.448095    2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-offline-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:04.448356 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.448113    2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-online-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:04.448356 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.448127    2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5a811c-9f55-40e0-99f5-39edb3f4265f-ui-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:04.806676 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.806650    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:21:04.952374 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.952297    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4l6p\" (UniqueName: \"kubernetes.io/projected/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-kube-api-access-t4l6p\") pod \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") "
May 26 07:21:04.952627 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.952377    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-ui-tls\") pod \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") "
May 26 07:21:04.952627 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.952405    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-online-tls\") pod \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") "
May 26 07:21:04.952627 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.952443    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-offline-tls\") pod \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") "
May 26 07:21:04.952627 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.952483    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-registry-tls\") pod \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") "
May 26 07:21:04.952860 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.952523    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-feast-data\") pod \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\" (UID: \"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794\") "
May 26 07:21:04.953085 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.953047    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-feast-data" (OuterVolumeSpecName: "feast-data") pod "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" (UID: "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:21:04.955123 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.955094    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-online-tls" (OuterVolumeSpecName: "online-tls") pod "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" (UID: "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:21:04.955217 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.955117    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" (UID: "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:21:04.955217 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.955128    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" (UID: "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:21:04.955217 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.955136    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-kube-api-access-t4l6p" (OuterVolumeSpecName: "kube-api-access-t4l6p") pod "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" (UID: "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794"). InnerVolumeSpecName "kube-api-access-t4l6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:21:04.955217 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.955148    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" (UID: "ebd3d3e3-ccb3-4872-9fe1-7956e5d17794"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:21:04.994805 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.994778    2564 generic.go:358] "Generic (PLEG): container finished" podID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerID="02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb" exitCode=137
May 26 07:21:04.994922 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.994858    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerDied","Data":"02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb"}
May 26 07:21:04.994922 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.994902    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp" event={"ID":"ac5a811c-9f55-40e0-99f5-39edb3f4265f","Type":"ContainerDied","Data":"eca73a2c1d00c0f116d7db1a48487c84bac3ae3c86a30856564c79aa5fbac15e"}
May 26 07:21:04.995052 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.994924    2564 scope.go:117] "RemoveContainer" containerID="0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1"
May 26 07:21:04.995052 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.994867    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"
May 26 07:21:04.997859 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.997835    2564 generic.go:358] "Generic (PLEG): container finished" podID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerID="dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422" exitCode=137
May 26 07:21:04.997859 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.997859    2564 generic.go:358] "Generic (PLEG): container finished" podID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerID="d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54" exitCode=137
May 26 07:21:04.998046 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.997861    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerDied","Data":"dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422"}
May 26 07:21:04.998046 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.997895    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerDied","Data":"d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54"}
May 26 07:21:04.998046 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.997911    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m" event={"ID":"ebd3d3e3-ccb3-4872-9fe1-7956e5d17794","Type":"ContainerDied","Data":"2e24f25ec6637ec0580043b4e647c8aedce91940c5e6f37db317adefed9c20f9"}
May 26 07:21:04.998046 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:04.997914    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"
May 26 07:21:05.005640 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.005561    2564 scope.go:117] "RemoveContainer" containerID="02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb"
May 26 07:21:05.013446 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.013432    2564 scope.go:117] "RemoveContainer" containerID="24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb"
May 26 07:21:05.022145 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.022110    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"]
May 26 07:21:05.024645 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.024624    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rwjhp"]
May 26 07:21:05.028606 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.028386    2564 scope.go:117] "RemoveContainer" containerID="8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89"
May 26 07:21:05.034985 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.034967    2564 scope.go:117] "RemoveContainer" containerID="2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2"
May 26 07:21:05.037461 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.037429    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"]
May 26 07:21:05.040759 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.040739    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hcf8m"]
May 26 07:21:05.043407 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.043392    2564 scope.go:117] "RemoveContainer" containerID="0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1"
May 26 07:21:05.043678 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.043660    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1\": container with ID starting with 0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1 not found: ID does not exist" containerID="0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1"
May 26 07:21:05.043744 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.043684    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1"} err="failed to get container status \"0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1\": rpc error: code = NotFound desc = could not find container \"0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1\": container with ID starting with 0d643cdc43bea074a6734860614b5078f76e68d5b0db719f5a6f5f7bbfcf7ef1 not found: ID does not exist"
May 26 07:21:05.043744 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.043701    2564 scope.go:117] "RemoveContainer" containerID="02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb"
May 26 07:21:05.043951 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.043934    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb\": container with ID starting with 02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb not found: ID does not exist" containerID="02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb"
May 26 07:21:05.043994 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.043965    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb"} err="failed to get container status \"02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb\": rpc error: code = NotFound desc = could not find container \"02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb\": container with ID starting with 02a880118bd7ad259b053d655f19f2fafadfcf5e828001c7e0083dbaecc196cb not found: ID does not exist"
May 26 07:21:05.043994 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.043979    2564 scope.go:117] "RemoveContainer" containerID="24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb"
May 26 07:21:05.044244 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.044226    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb\": container with ID starting with 24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb not found: ID does not exist" containerID="24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb"
May 26 07:21:05.044332 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.044247    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb"} err="failed to get container status \"24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb\": rpc error: code = NotFound desc = could not find container \"24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb\": container with ID starting with 24c5cff4ca4f9e88f2bd2e9e816e29e9bedeca2d3758511d3623dc54f6f073eb not found: ID does not exist"
May 26 07:21:05.044332 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.044260    2564 scope.go:117] "RemoveContainer" containerID="8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89"
May 26 07:21:05.044522 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.044496    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89\": container with ID starting with 8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89 not found: ID does not exist" containerID="8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89"
May 26 07:21:05.044611 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.044530    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89"} err="failed to get container status \"8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89\": rpc error: code = NotFound desc = could not find container \"8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89\": container with ID starting with 8a40b2267a17801013c6b6138f6796cc4fac1422d9af35ebd1c213560432ef89 not found: ID does not exist"
May 26 07:21:05.044611 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.044553    2564 scope.go:117] "RemoveContainer" containerID="2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2"
May 26 07:21:05.044807 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.044790    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2\": container with ID starting with 2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2 not found: ID does not exist" containerID="2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2"
May 26 07:21:05.044848 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.044813    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2"} err="failed to get container status \"2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2\": rpc error: code = NotFound desc = could not find container \"2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2\": container with ID starting with 2fc52cf51e28e70b6036c9c3ee6fd7e856f0264c5131d87f89bc62edbec07ac2 not found: ID does not exist"
May 26 07:21:05.044848 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.044835    2564 scope.go:117] "RemoveContainer" containerID="1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f"
May 26 07:21:05.054129 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.054107    2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-ui-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:05.054222 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.054136    2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-online-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:05.054222 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.054150    2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-offline-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:05.054222 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.054162    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-registry-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:05.054222 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.054175    2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-feast-data\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:05.054222 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.054188    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4l6p\" (UniqueName: \"kubernetes.io/projected/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794-kube-api-access-t4l6p\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:05.059866 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.059841    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" path="/var/lib/kubelet/pods/ac5a811c-9f55-40e0-99f5-39edb3f4265f/volumes"
May 26 07:21:05.060495 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.060473    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" path="/var/lib/kubelet/pods/ebd3d3e3-ccb3-4872-9fe1-7956e5d17794/volumes"
May 26 07:21:05.061820 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.061790    2564 scope.go:117] "RemoveContainer" containerID="dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422"
May 26 07:21:05.074281 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.071819    2564 scope.go:117] "RemoveContainer" containerID="d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c"
May 26 07:21:05.079895 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.079875    2564 scope.go:117] "RemoveContainer" containerID="d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54"
May 26 07:21:05.086148 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.086130    2564 scope.go:117] "RemoveContainer" containerID="dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54"
May 26 07:21:05.093885 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.093869    2564 scope.go:117] "RemoveContainer" containerID="19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19"
May 26 07:21:05.100775 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.100755    2564 scope.go:117] "RemoveContainer" containerID="1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f"
May 26 07:21:05.101054 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.101030    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f\": container with ID starting with 1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f not found: ID does not exist" containerID="1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f"
May 26 07:21:05.101117 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.101062    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f"} err="failed to get container status \"1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f\": rpc error: code = NotFound desc = could not find container \"1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f\": container with ID starting with 1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f not found: ID does not exist"
May 26 07:21:05.101117 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.101086    2564 scope.go:117] "RemoveContainer" containerID="dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422"
May 26 07:21:05.101361 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.101342    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422\": container with ID starting with dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422 not found: ID does not exist" containerID="dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422"
May 26 07:21:05.101417 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.101368    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422"} err="failed to get container status \"dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422\": rpc error: code = NotFound desc = could not find container \"dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422\": container with ID starting with dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422 not found: ID does not exist"
May 26 07:21:05.101417 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.101384    2564 scope.go:117] "RemoveContainer" containerID="d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c"
May 26 07:21:05.101652 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.101636    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c\": container with ID starting with d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c not found: ID does not exist" containerID="d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c"
May 26 07:21:05.101706 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.101654    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c"} err="failed to get container status \"d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c\": rpc error: code = NotFound desc = could not find container \"d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c\": container with ID starting with d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c not found: ID does not exist"
May 26 07:21:05.101706 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.101675    2564 scope.go:117] "RemoveContainer" containerID="d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54"
May 26 07:21:05.101922 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.101904    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54\": container with ID starting with d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54 not found: ID does not exist" containerID="d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54"
May 26 07:21:05.101985 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.101925    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54"} err="failed to get container status \"d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54\": rpc error: code = NotFound desc = could not find container \"d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54\": container with ID starting with d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54 not found: ID does not exist"
May 26 07:21:05.101985 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.101943    2564 scope.go:117] "RemoveContainer" containerID="dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54"
May 26 07:21:05.102204 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.102163    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54\": container with ID starting with dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54 not found: ID does not exist" containerID="dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54"
May 26 07:21:05.102288 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.102208    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54"} err="failed to get container status \"dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54\": rpc error: code = NotFound desc = could not find container \"dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54\": container with ID starting with dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54 not found: ID does not exist"
May 26 07:21:05.102288 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.102228    2564 scope.go:117] "RemoveContainer" containerID="19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19"
May 26 07:21:05.102439 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:21:05.102424    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19\": container with ID starting with 19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19 not found: ID does not exist" containerID="19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19"
May 26 07:21:05.102481 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.102444    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19"} err="failed to get container status \"19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19\": rpc error: code = NotFound desc = could not find container \"19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19\": container with ID starting with 19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19 not found: ID does not exist"
May 26 07:21:05.102481 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.102461    2564 scope.go:117] "RemoveContainer" containerID="1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f"
May 26 07:21:05.102671 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.102651    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f"} err="failed to get container status \"1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f\": rpc error: code = NotFound desc = could not find container \"1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f\": container with ID starting with 1f4defab7f7421d6b301348467de42976c3e41c376c882ffb95610b1869e735f not found: ID does not exist"
May 26 07:21:05.102734 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.102673    2564 scope.go:117] "RemoveContainer" containerID="dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422"
May 26 07:21:05.103091 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.102907    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422"} err="failed to get container status \"dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422\": rpc error: code = NotFound desc = could not find container \"dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422\": container with ID starting with dc0853ad2e14d5ceebdc8c0d25079b6548a918a184086f2614a44723a7e8f422 not found: ID does not exist"
May 26 07:21:05.103091 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.102933    2564 scope.go:117] "RemoveContainer" containerID="d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c"
May 26 07:21:05.103231 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.103200    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c"} err="failed to get container status \"d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c\": rpc error: code = NotFound desc = could not find container \"d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c\": container with ID starting with d3bd5e26a23a7ccf390d08edf51259e15c42be75021852c347560517e669481c not found: ID does not exist"
May 26 07:21:05.103231 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.103220    2564 scope.go:117] "RemoveContainer" containerID="d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54"
May 26 07:21:05.103425 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.103408    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54"} err="failed to get container status \"d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54\": rpc error: code = NotFound desc = could not find container \"d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54\": container with ID starting with d34bbff3d94ae476572eb71cefa474508f361802b69bcc58985747ef380f1c54 not found: ID does not exist"
May 26 07:21:05.103478 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.103425    2564 scope.go:117] "RemoveContainer" containerID="dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54"
May 26 07:21:05.103657 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.103630    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54"} err="failed to get container status \"dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54\": rpc error: code = NotFound desc = could not find container \"dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54\": container with ID starting with dba0b10c218660299f04abb6eaa8efa0f0a0b20747f0f41260e4b7c3b7e2ad54 not found: ID does not exist"
May 26 07:21:05.103738 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.103658    2564 scope.go:117] "RemoveContainer" containerID="19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19"
May 26 07:21:05.103918 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:05.103896    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19"} err="failed to get container status \"19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19\": rpc error: code = NotFound desc = could not find container \"19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19\": container with ID starting with 19125004e7f35b89ac67c6957b552ba514ba97c210b12286d2773e7d417bef19 not found: ID does not exist"
May 26 07:21:22.837661 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:22.837625    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"]
May 26 07:21:22.838178 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:22.837861    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s" podUID="992b3056-c8e2-41da-ba8e-cba11dd5eebc" containerName="manager" containerID="cri-o://506b7ed5cdeb00b03a195696441bbd9b52999f8e50c09cf7aa051d7be0597ab7" gracePeriod=10
May 26 07:21:23.050702 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:23.050669    2564 generic.go:358] "Generic (PLEG): container finished" podID="992b3056-c8e2-41da-ba8e-cba11dd5eebc" containerID="506b7ed5cdeb00b03a195696441bbd9b52999f8e50c09cf7aa051d7be0597ab7" exitCode=0
May 26 07:21:23.050867 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:23.050739    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s" event={"ID":"992b3056-c8e2-41da-ba8e-cba11dd5eebc","Type":"ContainerDied","Data":"506b7ed5cdeb00b03a195696441bbd9b52999f8e50c09cf7aa051d7be0597ab7"}
May 26 07:21:23.076435 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:23.076409    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"
May 26 07:21:23.178674 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:23.178585    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfzss\" (UniqueName: \"kubernetes.io/projected/992b3056-c8e2-41da-ba8e-cba11dd5eebc-kube-api-access-jfzss\") pod \"992b3056-c8e2-41da-ba8e-cba11dd5eebc\" (UID: \"992b3056-c8e2-41da-ba8e-cba11dd5eebc\") "
May 26 07:21:23.180700 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:23.180668    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992b3056-c8e2-41da-ba8e-cba11dd5eebc-kube-api-access-jfzss" (OuterVolumeSpecName: "kube-api-access-jfzss") pod "992b3056-c8e2-41da-ba8e-cba11dd5eebc" (UID: "992b3056-c8e2-41da-ba8e-cba11dd5eebc"). InnerVolumeSpecName "kube-api-access-jfzss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:21:23.279529 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:23.279496    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfzss\" (UniqueName: \"kubernetes.io/projected/992b3056-c8e2-41da-ba8e-cba11dd5eebc-kube-api-access-jfzss\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:21:24.054688 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:24.054654    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s" event={"ID":"992b3056-c8e2-41da-ba8e-cba11dd5eebc","Type":"ContainerDied","Data":"59ad224e0736a531c92742ca8e3938f8bd0584291a2b9bf06503ee3c2044a520"}
May 26 07:21:24.054688 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:24.054677    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"
May 26 07:21:24.054688 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:24.054692    2564 scope.go:117] "RemoveContainer" containerID="506b7ed5cdeb00b03a195696441bbd9b52999f8e50c09cf7aa051d7be0597ab7"
May 26 07:21:24.077018 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:24.076983    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"]
May 26 07:21:24.080442 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:24.080423    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vsm6s"]
May 26 07:21:25.058792 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:25.058760    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="992b3056-c8e2-41da-ba8e-cba11dd5eebc" path="/var/lib/kubelet/pods/992b3056-c8e2-41da-ba8e-cba11dd5eebc/volumes"
May 26 07:21:27.074478 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074449    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"]
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074653    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992b3056-c8e2-41da-ba8e-cba11dd5eebc" containerName="manager"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074663    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="992b3056-c8e2-41da-ba8e-cba11dd5eebc" containerName="manager"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074670    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="ui"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074675    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="ui"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074683    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="feast-apply"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074689    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="feast-apply"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074696    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="registry"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074701    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="registry"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074711    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="feast-apply"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074716    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="feast-apply"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074721    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="online"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074727    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="online"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074732    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="offline"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074737    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="offline"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074743    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="ui"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074749    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="ui"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074759    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="offline"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074764    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="offline"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074770    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="feast-init"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074775    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="feast-init"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074781    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="feast-init"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074786    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="feast-init"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074791    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="online"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074795    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="online"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074831    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="992b3056-c8e2-41da-ba8e-cba11dd5eebc" containerName="manager"
May 26 07:21:27.074828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074839    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="offline"
May 26 07:21:27.075626 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074845    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="ui"
May 26 07:21:27.075626 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074854    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="online"
May 26 07:21:27.075626 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074859    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="registry"
May 26 07:21:27.075626 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074865    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="online"
May 26 07:21:27.075626 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074871    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebd3d3e3-ccb3-4872-9fe1-7956e5d17794" containerName="offline"
May 26 07:21:27.075626 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.074877    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac5a811c-9f55-40e0-99f5-39edb3f4265f" containerName="ui"
May 26 07:21:27.078780 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.078763    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"
May 26 07:21:27.081198 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.081177    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 07:21:27.081328 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.081180    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-rcr6g\""
May 26 07:21:27.081948 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.081931    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 07:21:27.083558 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.083536    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"]
May 26 07:21:27.206709 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.206680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkqgc\" (UniqueName: \"kubernetes.io/projected/e342787a-c33c-431d-95e4-a5c509fc057b-kube-api-access-tkqgc\") pod \"feast-operator-controller-manager-cf99db75-mrjjw\" (UID: \"e342787a-c33c-431d-95e4-a5c509fc057b\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"
May 26 07:21:27.307993 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.307959    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkqgc\" (UniqueName: \"kubernetes.io/projected/e342787a-c33c-431d-95e4-a5c509fc057b-kube-api-access-tkqgc\") pod \"feast-operator-controller-manager-cf99db75-mrjjw\" (UID: \"e342787a-c33c-431d-95e4-a5c509fc057b\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"
May 26 07:21:27.316560 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.316534    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkqgc\" (UniqueName: \"kubernetes.io/projected/e342787a-c33c-431d-95e4-a5c509fc057b-kube-api-access-tkqgc\") pod \"feast-operator-controller-manager-cf99db75-mrjjw\" (UID: \"e342787a-c33c-431d-95e4-a5c509fc057b\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"
May 26 07:21:27.389152 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.389094    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"
May 26 07:21:27.505727 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.505696    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"]
May 26 07:21:27.508973 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:21:27.508942    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode342787a_c33c_431d_95e4_a5c509fc057b.slice/crio-207543303caa81a4ba331c688915324a8b2cd06c548884f5bbbc4707092732b8 WatchSource:0}: Error finding container 207543303caa81a4ba331c688915324a8b2cd06c548884f5bbbc4707092732b8: Status 404 returned error can't find the container with id 207543303caa81a4ba331c688915324a8b2cd06c548884f5bbbc4707092732b8
May 26 07:21:27.510549 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:27.510532    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 07:21:28.067804 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:28.067767    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw" event={"ID":"e342787a-c33c-431d-95e4-a5c509fc057b","Type":"ContainerStarted","Data":"247ca796137aea057467c1a60251fd5a81722fa090c11d1563288dad50a815b5"}
May 26 07:21:28.067804 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:28.067803    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw" event={"ID":"e342787a-c33c-431d-95e4-a5c509fc057b","Type":"ContainerStarted","Data":"207543303caa81a4ba331c688915324a8b2cd06c548884f5bbbc4707092732b8"}
May 26 07:21:28.068086 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:28.067895    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"
May 26 07:21:28.083381 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:28.083343    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw" podStartSLOduration=1.083330678 podStartE2EDuration="1.083330678s" podCreationTimestamp="2026-05-26 07:21:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:21:28.08162737 +0000 UTC m=+1483.643983064" watchObservedRunningTime="2026-05-26 07:21:28.083330678 +0000 UTC m=+1483.645686371"
May 26 07:21:39.071577 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:39.071545    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-mrjjw"
May 26 07:21:44.538528 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.538495    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"]
May 26 07:21:44.541970 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.541948    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.544424 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.544391    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 07:21:44.544424 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.544421    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 07:21:44.544648 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.544400    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 07:21:44.544648 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.544480    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-9nncd\""
May 26 07:21:44.545351 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.545329    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 07:21:44.545460 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.545352    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 07:21:44.545460 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.545352    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 07:21:44.553259 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.553238    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"]
May 26 07:21:44.621649 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.621619    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.621769 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.621653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.621769 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.621677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.621769 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.621711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12e0af52-b70c-4415-b1b2-5d49565bcd70-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.621913 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.621773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsg4t\" (UniqueName: \"kubernetes.io/projected/12e0af52-b70c-4415-b1b2-5d49565bcd70-kube-api-access-dsg4t\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.621913 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.621810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.722624 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.722580    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.722812 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.722631    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12e0af52-b70c-4415-b1b2-5d49565bcd70-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.722812 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.722665    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsg4t\" (UniqueName: \"kubernetes.io/projected/12e0af52-b70c-4415-b1b2-5d49565bcd70-kube-api-access-dsg4t\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.722812 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.722693    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.722812 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.722729    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.722812 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.722754    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.723119 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.723093    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12e0af52-b70c-4415-b1b2-5d49565bcd70-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.725269 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.725243    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.725477 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.725455    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.725523 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.725464    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.725557 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.725530    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.730566 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.730542    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsg4t\" (UniqueName: \"kubernetes.io/projected/12e0af52-b70c-4415-b1b2-5d49565bcd70-kube-api-access-dsg4t\") pod \"feast-simple-feast-setup-664fcfcc58-mbhx9\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.850764 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.850738    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:44.977339 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:44.977303    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"]
May 26 07:21:44.979387 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:21:44.979359    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12e0af52_b70c_4415_b1b2_5d49565bcd70.slice/crio-685733c3458d7e6629edf2234d08b2043bebf062bba66c3b503872e6c6b36450 WatchSource:0}: Error finding container 685733c3458d7e6629edf2234d08b2043bebf062bba66c3b503872e6c6b36450: Status 404 returned error can't find the container with id 685733c3458d7e6629edf2234d08b2043bebf062bba66c3b503872e6c6b36450
May 26 07:21:45.060728 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:45.060698    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:21:45.061518 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:45.061497    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:21:45.108888 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:45.108822    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerStarted","Data":"2f06c0924109af7e9d32020f008be7381728064b4b9e24d407429fd8602cd784"}
May 26 07:21:45.108888 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:45.108855    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerStarted","Data":"685733c3458d7e6629edf2234d08b2043bebf062bba66c3b503872e6c6b36450"}
May 26 07:21:50.122377 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:50.122342    2564 generic.go:358] "Generic (PLEG): container finished" podID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerID="2f06c0924109af7e9d32020f008be7381728064b4b9e24d407429fd8602cd784" exitCode=0
May 26 07:21:50.122731 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:50.122421    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerDied","Data":"2f06c0924109af7e9d32020f008be7381728064b4b9e24d407429fd8602cd784"}
May 26 07:21:51.126060 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:51.126026    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerStarted","Data":"e5c8f77d587f8bd2a8b82c85964a3b673ce232723858373529d1a744431f4545"}
May 26 07:21:56.141017 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:56.140976    2564 generic.go:358] "Generic (PLEG): container finished" podID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerID="e5c8f77d587f8bd2a8b82c85964a3b673ce232723858373529d1a744431f4545" exitCode=0
May 26 07:21:56.141520 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:56.141053    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerDied","Data":"e5c8f77d587f8bd2a8b82c85964a3b673ce232723858373529d1a744431f4545"}
May 26 07:21:57.148177 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:57.148134    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerStarted","Data":"9bb1e6223a6e393faeebc72d92a71fc994700bbc1b3d5c34a63fe0da2ea56c74"}
May 26 07:21:57.148659 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:57.148188    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerStarted","Data":"08d2b8d06c36f676ae888fcce4c72420f7e60f195b8a6341348e49015a9ceba3"}
May 26 07:21:57.148659 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:57.148204    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerStarted","Data":"e3e101c2bf87fd2c8f0f59e09110316e1dd39b3e48c1c95c7eba8108286da3fc"}
May 26 07:21:57.148659 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:57.148217    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerStarted","Data":"c0beac9ab2aecc0d2f284949cc2106aec2d0de459eb779ca112e8cf41147744a"}
May 26 07:21:57.172378 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:57.172313    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podStartSLOduration=13.172294169 podStartE2EDuration="13.172294169s" podCreationTimestamp="2026-05-26 07:21:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:21:57.17053011 +0000 UTC m=+1512.732885815" watchObservedRunningTime="2026-05-26 07:21:57.172294169 +0000 UTC m=+1512.734649865"
May 26 07:21:59.851670 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:59.851571    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:59.851670 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:59.851623    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:59.851670 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:59.851638    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:59.851670 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:59.851650    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:21:59.853597 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:59.853561    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 26 07:21:59.853720 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:59.853591    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused"
May 26 07:21:59.853720 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:59.853677    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused"
May 26 07:21:59.853835 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:21:59.853767    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 26 07:22:02.851933 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:02.851896    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:02.852412 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:02.852303    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:02.852476 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:02.852437    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:02.852476 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:02.852457    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:02.852476 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:02.852470    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:02.852703 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:02.852682    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:02.852823 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:02.852806    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:02.856730 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:02.856712    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:03.165829 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:03.165737    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:03.165829 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:03.165775    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:03.168643 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:03.168622    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:22:04.169152 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:22:04.169124    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:23:05.140178 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.140141    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"]
May 26 07:23:05.140737 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.140594    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="registry" containerID="cri-o://c0beac9ab2aecc0d2f284949cc2106aec2d0de459eb779ca112e8cf41147744a" gracePeriod=30
May 26 07:23:05.140737 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.140668    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="ui" containerID="cri-o://9bb1e6223a6e393faeebc72d92a71fc994700bbc1b3d5c34a63fe0da2ea56c74" gracePeriod=30
May 26 07:23:05.140859 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.140715    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="online" containerID="cri-o://e3e101c2bf87fd2c8f0f59e09110316e1dd39b3e48c1c95c7eba8108286da3fc" gracePeriod=30
May 26 07:23:05.140859 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.140828    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="offline" containerID="cri-o://08d2b8d06c36f676ae888fcce4c72420f7e60f195b8a6341348e49015a9ceba3" gracePeriod=30
May 26 07:23:05.502422 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.502328    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"]
May 26 07:23:05.506600 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.506577    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.509054 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.509029    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5kmpf\""
May 26 07:23:05.515672 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.515650    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"]
May 26 07:23:05.682069 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.682034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.682237 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.682090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.682237 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.682184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9qzp\" (UniqueName: \"kubernetes.io/projected/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-kube-api-access-t9qzp\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.682333 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.682251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.682333 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.682291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.682405 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.682372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.783672 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.783647    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.783779 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.783684    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.783779 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.783704    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qzp\" (UniqueName: \"kubernetes.io/projected/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-kube-api-access-t9qzp\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.783779 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.783728    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.783779 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.783751    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.783779 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.783773    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.784199 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.784175    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.786206 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.786182    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.786406 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.786383    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.786470 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.786383    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.788645 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.788623    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.791735 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.791710    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qzp\" (UniqueName: \"kubernetes.io/projected/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-kube-api-access-t9qzp\") pod \"feast-simple-feast-setup-664fcfcc58-7s2zh\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.817490 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.817459    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:05.938903 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:05.938858    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"]
May 26 07:23:05.942492 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:23:05.942465    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c0d5302_71d5_4c48_8448_1f1702cdf8a0.slice/crio-dfb1ab86de9c593def5cf50373c62b2754aace7bfe4fb934bae5ea72fa64fecb WatchSource:0}: Error finding container dfb1ab86de9c593def5cf50373c62b2754aace7bfe4fb934bae5ea72fa64fecb: Status 404 returned error can't find the container with id dfb1ab86de9c593def5cf50373c62b2754aace7bfe4fb934bae5ea72fa64fecb
May 26 07:23:06.331232 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:06.331201    2564 generic.go:358] "Generic (PLEG): container finished" podID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerID="9bb1e6223a6e393faeebc72d92a71fc994700bbc1b3d5c34a63fe0da2ea56c74" exitCode=0
May 26 07:23:06.331232 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:06.331225    2564 generic.go:358] "Generic (PLEG): container finished" podID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerID="e3e101c2bf87fd2c8f0f59e09110316e1dd39b3e48c1c95c7eba8108286da3fc" exitCode=0
May 26 07:23:06.331703 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:06.331268    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerDied","Data":"9bb1e6223a6e393faeebc72d92a71fc994700bbc1b3d5c34a63fe0da2ea56c74"}
May 26 07:23:06.331703 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:06.331304    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerDied","Data":"e3e101c2bf87fd2c8f0f59e09110316e1dd39b3e48c1c95c7eba8108286da3fc"}
May 26 07:23:06.332466 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:06.332441    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerStarted","Data":"5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01"}
May 26 07:23:06.332554 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:06.332474    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerStarted","Data":"dfb1ab86de9c593def5cf50373c62b2754aace7bfe4fb934bae5ea72fa64fecb"}
May 26 07:23:11.348944 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:11.348908    2564 generic.go:358] "Generic (PLEG): container finished" podID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerID="5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01" exitCode=0
May 26 07:23:11.349338 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:11.348979    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerDied","Data":"5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01"}
May 26 07:23:12.353796 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:12.353761    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerStarted","Data":"9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec"}
May 26 07:23:12.852861 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:12.852823    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 26 07:23:13.166717 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:13.166632    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 26 07:23:17.369087 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:17.369049    2564 generic.go:358] "Generic (PLEG): container finished" podID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerID="9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec" exitCode=0
May 26 07:23:17.369439 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:17.369121    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerDied","Data":"9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec"}
May 26 07:23:18.384048 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:18.383988    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerStarted","Data":"ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426"}
May 26 07:23:18.384520 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:18.384059    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerStarted","Data":"2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1"}
May 26 07:23:18.384520 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:18.384076    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerStarted","Data":"75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a"}
May 26 07:23:18.384520 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:18.384089    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerStarted","Data":"d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d"}
May 26 07:23:20.818220 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:20.818125    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:20.818220 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:20.818177    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:20.818220 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:20.818192    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:20.818220 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:20.818207    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:20.820111 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:20.820078    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused"
May 26 07:23:20.820321 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:20.820099    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 26 07:23:20.820507 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:20.820122    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused"
May 26 07:23:20.820604 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:20.820197    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 26 07:23:22.853317 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:22.853267    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 26 07:23:23.166764 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.166668    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 26 07:23:23.819178 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.819143    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.819367 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.819288    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.819565 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.819546    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.820040 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.819991    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.820180 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.820056    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.820180 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.820074    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.820180 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.820151    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.820338 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.820185    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.820389 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.820369    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.823857 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.823836    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:23.843786 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:23.843750    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podStartSLOduration=18.843739576 podStartE2EDuration="18.843739576s" podCreationTimestamp="2026-05-26 07:23:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:23:18.407556498 +0000 UTC m=+1593.969912221" watchObservedRunningTime="2026-05-26 07:23:23.843739576 +0000 UTC m=+1599.406095266"
May 26 07:23:24.404873 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:24.404844    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:24.407764 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:24.407747    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:23:32.852444 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:32.852342    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 26 07:23:32.852828 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:32.852515    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:23:33.166460 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:33.166361    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 26 07:23:33.166607 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:33.166500    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:23:35.434807 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.434718    2564 generic.go:358] "Generic (PLEG): container finished" podID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerID="08d2b8d06c36f676ae888fcce4c72420f7e60f195b8a6341348e49015a9ceba3" exitCode=137
May 26 07:23:35.434807 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.434743    2564 generic.go:358] "Generic (PLEG): container finished" podID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerID="c0beac9ab2aecc0d2f284949cc2106aec2d0de459eb779ca112e8cf41147744a" exitCode=137
May 26 07:23:35.434807 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.434790    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerDied","Data":"08d2b8d06c36f676ae888fcce4c72420f7e60f195b8a6341348e49015a9ceba3"}
May 26 07:23:35.435238 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.434831    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerDied","Data":"c0beac9ab2aecc0d2f284949cc2106aec2d0de459eb779ca112e8cf41147744a"}
May 26 07:23:35.787700 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.787676    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:23:35.899577 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.899544    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-ui-tls\") pod \"12e0af52-b70c-4415-b1b2-5d49565bcd70\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") "
May 26 07:23:35.899845 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.899585    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12e0af52-b70c-4415-b1b2-5d49565bcd70-feast-data\") pod \"12e0af52-b70c-4415-b1b2-5d49565bcd70\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") "
May 26 07:23:35.899845 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.899630    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-offline-tls\") pod \"12e0af52-b70c-4415-b1b2-5d49565bcd70\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") "
May 26 07:23:35.899845 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.899655    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-registry-tls\") pod \"12e0af52-b70c-4415-b1b2-5d49565bcd70\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") "
May 26 07:23:35.899845 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.899685    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-online-tls\") pod \"12e0af52-b70c-4415-b1b2-5d49565bcd70\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") "
May 26 07:23:35.899845 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.899761    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsg4t\" (UniqueName: \"kubernetes.io/projected/12e0af52-b70c-4415-b1b2-5d49565bcd70-kube-api-access-dsg4t\") pod \"12e0af52-b70c-4415-b1b2-5d49565bcd70\" (UID: \"12e0af52-b70c-4415-b1b2-5d49565bcd70\") "
May 26 07:23:35.900272 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.900239    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12e0af52-b70c-4415-b1b2-5d49565bcd70-feast-data" (OuterVolumeSpecName: "feast-data") pod "12e0af52-b70c-4415-b1b2-5d49565bcd70" (UID: "12e0af52-b70c-4415-b1b2-5d49565bcd70"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:23:35.901922 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.901885    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "12e0af52-b70c-4415-b1b2-5d49565bcd70" (UID: "12e0af52-b70c-4415-b1b2-5d49565bcd70"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:23:35.901922 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.901911    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e0af52-b70c-4415-b1b2-5d49565bcd70-kube-api-access-dsg4t" (OuterVolumeSpecName: "kube-api-access-dsg4t") pod "12e0af52-b70c-4415-b1b2-5d49565bcd70" (UID: "12e0af52-b70c-4415-b1b2-5d49565bcd70"). InnerVolumeSpecName "kube-api-access-dsg4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:23:35.902083 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.901946    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "12e0af52-b70c-4415-b1b2-5d49565bcd70" (UID: "12e0af52-b70c-4415-b1b2-5d49565bcd70"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:23:35.902172 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.902151    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "12e0af52-b70c-4415-b1b2-5d49565bcd70" (UID: "12e0af52-b70c-4415-b1b2-5d49565bcd70"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:23:35.902208 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:35.902182    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-online-tls" (OuterVolumeSpecName: "online-tls") pod "12e0af52-b70c-4415-b1b2-5d49565bcd70" (UID: "12e0af52-b70c-4415-b1b2-5d49565bcd70"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:23:36.001204 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.001092    2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-offline-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:23:36.001204 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.001140    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-registry-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:23:36.001204 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.001149    2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-online-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:23:36.001204 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.001159    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsg4t\" (UniqueName: \"kubernetes.io/projected/12e0af52-b70c-4415-b1b2-5d49565bcd70-kube-api-access-dsg4t\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:23:36.001204 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.001170    2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12e0af52-b70c-4415-b1b2-5d49565bcd70-ui-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:23:36.001204 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.001179    2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12e0af52-b70c-4415-b1b2-5d49565bcd70-feast-data\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:23:36.439891 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.439855    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9" event={"ID":"12e0af52-b70c-4415-b1b2-5d49565bcd70","Type":"ContainerDied","Data":"685733c3458d7e6629edf2234d08b2043bebf062bba66c3b503872e6c6b36450"}
May 26 07:23:36.440373 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.439903    2564 scope.go:117] "RemoveContainer" containerID="9bb1e6223a6e393faeebc72d92a71fc994700bbc1b3d5c34a63fe0da2ea56c74"
May 26 07:23:36.440373 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.439961    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"
May 26 07:23:36.447884 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.447847    2564 scope.go:117] "RemoveContainer" containerID="08d2b8d06c36f676ae888fcce4c72420f7e60f195b8a6341348e49015a9ceba3"
May 26 07:23:36.455141 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.455123    2564 scope.go:117] "RemoveContainer" containerID="e3e101c2bf87fd2c8f0f59e09110316e1dd39b3e48c1c95c7eba8108286da3fc"
May 26 07:23:36.461918 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.461888    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"]
May 26 07:23:36.462820 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.462803    2564 scope.go:117] "RemoveContainer" containerID="c0beac9ab2aecc0d2f284949cc2106aec2d0de459eb779ca112e8cf41147744a"
May 26 07:23:36.465502 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.465471    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mbhx9"]
May 26 07:23:36.470056 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.470038    2564 scope.go:117] "RemoveContainer" containerID="e5c8f77d587f8bd2a8b82c85964a3b673ce232723858373529d1a744431f4545"
May 26 07:23:36.476513 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:36.476496    2564 scope.go:117] "RemoveContainer" containerID="2f06c0924109af7e9d32020f008be7381728064b4b9e24d407429fd8602cd784"
May 26 07:23:37.059891 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:23:37.059856    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" path="/var/lib/kubelet/pods/12e0af52-b70c-4415-b1b2-5d49565bcd70/volumes"
May 26 07:24:26.889678 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.889641    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"]
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.889967    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="registry"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.889984    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="registry"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.889998    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="feast-init"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890022    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="feast-init"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890038    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="feast-apply"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890047    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="feast-apply"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890059    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="ui"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890067    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="ui"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890084    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="offline"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890093    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="offline"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890113    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="online"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890120    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="online"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890176    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="offline"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890187    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="ui"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890196    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="registry"
May 26 07:24:26.890221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.890207    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="12e0af52-b70c-4415-b1b2-5d49565bcd70" containerName="online"
May 26 07:24:26.893703 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.893676    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:26.896361 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.896322    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 07:24:26.896361 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.896343    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 07:24:26.896361 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.896345    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 07:24:26.896586 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.896406    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 07:24:26.896695 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.896676    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 07:24:26.896736 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.896688    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-5jdj8\""
May 26 07:24:26.896808 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.896793    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 07:24:26.902044 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:26.902000    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"]
May 26 07:24:27.045298 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.045249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.045298 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.045307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.045559 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.045393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a38a1e5-8452-48d4-a6e5-64d3255875ee-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.045559 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.045445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38a1e5-8452-48d4-a6e5-64d3255875ee-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.045559 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.045502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.045559 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.045534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbz4\" (UniqueName: \"kubernetes.io/projected/5a38a1e5-8452-48d4-a6e5-64d3255875ee-kube-api-access-mwbz4\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.146345 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.146269    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.146345 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.146306    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a38a1e5-8452-48d4-a6e5-64d3255875ee-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.146570 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.146454    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38a1e5-8452-48d4-a6e5-64d3255875ee-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.146570 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.146503    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.146570 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.146537    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbz4\" (UniqueName: \"kubernetes.io/projected/5a38a1e5-8452-48d4-a6e5-64d3255875ee-kube-api-access-mwbz4\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.146726 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.146583    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.146726 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:24:27.146676    2564 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
May 26 07:24:27.146835 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:24:27.146779    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-offline-tls podName:5a38a1e5-8452-48d4-a6e5-64d3255875ee nodeName:}" failed. No retries permitted until 2026-05-26 07:24:27.646756758 +0000 UTC m=+1663.209112430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-offline-tls") pod "feast-simple-feast-remote-setup-5cff94746b-r942m" (UID: "5a38a1e5-8452-48d4-a6e5-64d3255875ee") : secret "feast-simple-feast-remote-setup-offline-tls" not found
May 26 07:24:27.146835 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.146808    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38a1e5-8452-48d4-a6e5-64d3255875ee-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.147106 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.147086    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a38a1e5-8452-48d4-a6e5-64d3255875ee-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.148689 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.148669    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.149061 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.149043    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.154812 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.154790    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbz4\" (UniqueName: \"kubernetes.io/projected/5a38a1e5-8452-48d4-a6e5-64d3255875ee-kube-api-access-mwbz4\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.650161 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.650124    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.652478 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.652448    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-r942m\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.804309 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.804262    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:27.927413 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:27.927374    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"]
May 26 07:24:27.930040 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:24:27.930000    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a38a1e5_8452_48d4_a6e5_64d3255875ee.slice/crio-d1363696f30eedb4f8d09ff545b69c8e658b9dc484305c270d99a0c61e2e130f WatchSource:0}: Error finding container d1363696f30eedb4f8d09ff545b69c8e658b9dc484305c270d99a0c61e2e130f: Status 404 returned error can't find the container with id d1363696f30eedb4f8d09ff545b69c8e658b9dc484305c270d99a0c61e2e130f
May 26 07:24:28.572683 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:28.572647    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerStarted","Data":"e62de1676c3ae29a07e8625c309339756b5d4a1626d69123a8507f351a0c2c5e"}
May 26 07:24:28.572822 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:28.572690    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerStarted","Data":"d1363696f30eedb4f8d09ff545b69c8e658b9dc484305c270d99a0c61e2e130f"}
May 26 07:24:32.583470 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:32.583437    2564 generic.go:358] "Generic (PLEG): container finished" podID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerID="e62de1676c3ae29a07e8625c309339756b5d4a1626d69123a8507f351a0c2c5e" exitCode=0
May 26 07:24:32.583808 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:32.583512    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerDied","Data":"e62de1676c3ae29a07e8625c309339756b5d4a1626d69123a8507f351a0c2c5e"}
May 26 07:24:33.587805 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:33.587774    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerStarted","Data":"b710f48644a6e4f9d2a021d9a5ffcdf74bd29ea7681f1c1a7a0a6eaf4aad36ce"}
May 26 07:24:38.601187 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:38.601155    2564 generic.go:358] "Generic (PLEG): container finished" podID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerID="b710f48644a6e4f9d2a021d9a5ffcdf74bd29ea7681f1c1a7a0a6eaf4aad36ce" exitCode=0
May 26 07:24:38.601544 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:38.601197    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerDied","Data":"b710f48644a6e4f9d2a021d9a5ffcdf74bd29ea7681f1c1a7a0a6eaf4aad36ce"}
May 26 07:24:39.607540 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.607500    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerStarted","Data":"4c3720b3042b6ec2830ab8660f688f4111e2aee00b556c5c93b6405ccc1918ac"}
May 26 07:24:39.607902 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.607553    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerStarted","Data":"8d616a2ba9165c9cf523a96a042949cf1a241b3eaa499e44bf5b060c1d1b72b3"}
May 26 07:24:39.607902 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.607568    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerStarted","Data":"314dd15d6a40585c9e4dd7dd9fc9f5d3ebaf9eb0cd172eac29630b450c9e90c3"}
May 26 07:24:39.630243 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.630194    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podStartSLOduration=13.630177293 podStartE2EDuration="13.630177293s" podCreationTimestamp="2026-05-26 07:24:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:24:39.628801128 +0000 UTC m=+1675.191156835" watchObservedRunningTime="2026-05-26 07:24:39.630177293 +0000 UTC m=+1675.192532995"
May 26 07:24:39.804493 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.804456    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:39.804671 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.804508    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:39.804671 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.804525    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:39.805936 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.805898    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 07:24:39.806083 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.805938    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
May 26 07:24:39.806083 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:39.805973    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 07:24:42.805313 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:42.805200    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
May 26 07:24:42.805313 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:42.805225    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 07:24:42.805313 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:42.805255    2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 07:24:45.806144 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:45.806113    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:45.806576 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:45.806283    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:45.806778 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:45.806756    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:45.806953 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:45.806917    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:45.807164 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:45.807144    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:45.807217 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:45.807201    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:45.810212 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:45.810195    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:46.629423 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:46.629381    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:24:46.632530 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:24:46.632511    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:25:47.808886 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:47.808758    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"]
May 26 07:25:47.810298 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:47.809799    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="online" containerID="cri-o://314dd15d6a40585c9e4dd7dd9fc9f5d3ebaf9eb0cd172eac29630b450c9e90c3" gracePeriod=30
May 26 07:25:47.810298 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:47.809973    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="ui" containerID="cri-o://4c3720b3042b6ec2830ab8660f688f4111e2aee00b556c5c93b6405ccc1918ac" gracePeriod=30
May 26 07:25:47.810298 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:47.810058    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="offline" containerID="cri-o://8d616a2ba9165c9cf523a96a042949cf1a241b3eaa499e44bf5b060c1d1b72b3" gracePeriod=30
May 26 07:25:47.957597 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:47.957563    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"]
May 26 07:25:47.958050 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:47.958000    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="registry" containerID="cri-o://d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d" gracePeriod=30
May 26 07:25:47.958291 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:47.958052    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="ui" containerID="cri-o://ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426" gracePeriod=30
May 26 07:25:47.958389 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:47.958121    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="online" containerID="cri-o://75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a" gracePeriod=30
May 26 07:25:47.958452 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:47.958103    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="offline" containerID="cri-o://2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1" gracePeriod=30
May 26 07:25:48.795665 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:48.795599    2564 generic.go:358] "Generic (PLEG): container finished" podID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerID="4c3720b3042b6ec2830ab8660f688f4111e2aee00b556c5c93b6405ccc1918ac" exitCode=0
May 26 07:25:48.795665 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:48.795623    2564 generic.go:358] "Generic (PLEG): container finished" podID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerID="314dd15d6a40585c9e4dd7dd9fc9f5d3ebaf9eb0cd172eac29630b450c9e90c3" exitCode=0
May 26 07:25:48.795851 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:48.795659    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerDied","Data":"4c3720b3042b6ec2830ab8660f688f4111e2aee00b556c5c93b6405ccc1918ac"}
May 26 07:25:48.795851 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:48.795698    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerDied","Data":"314dd15d6a40585c9e4dd7dd9fc9f5d3ebaf9eb0cd172eac29630b450c9e90c3"}
May 26 07:25:48.798037 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:48.798001    2564 generic.go:358] "Generic (PLEG): container finished" podID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerID="ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426" exitCode=0
May 26 07:25:48.798135 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:48.798032    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerDied","Data":"ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426"}
May 26 07:25:48.798135 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:48.798064    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerDied","Data":"75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a"}
May 26 07:25:48.798135 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:48.798038    2564 generic.go:358] "Generic (PLEG): container finished" podID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerID="75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a" exitCode=0
May 26 07:25:53.820461 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:53.820408    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 26 07:25:54.405725 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:54.405676    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 26 07:25:55.807382 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:55.807341    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 07:25:56.629833 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:25:56.629786    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 07:26:03.820916 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:03.820864    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 26 07:26:04.405570 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:04.405513    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 26 07:26:05.807021 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:05.806971    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 07:26:06.630045 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:06.629979    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 07:26:13.820815 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:13.820767    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 26 07:26:13.821302 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:13.820932    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:26:14.405736 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:14.405690    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 26 07:26:14.405921 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:14.405861    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:26:15.807125 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:15.807080    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 26 07:26:15.807586 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:15.807234    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:26:16.630211 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:16.630172    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 26 07:26:16.630402 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:16.630297    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:26:17.875750 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:17.875721    2564 generic.go:358] "Generic (PLEG): container finished" podID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerID="8d616a2ba9165c9cf523a96a042949cf1a241b3eaa499e44bf5b060c1d1b72b3" exitCode=137
May 26 07:26:17.876053 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:17.875766    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerDied","Data":"8d616a2ba9165c9cf523a96a042949cf1a241b3eaa499e44bf5b060c1d1b72b3"}
May 26 07:26:18.450603 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.450577    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:26:18.516206 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.516176    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-online-tls\") pod \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") "
May 26 07:26:18.516378 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.516220    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a38a1e5-8452-48d4-a6e5-64d3255875ee-registry-tls\") pod \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") "
May 26 07:26:18.516378 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.516250    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38a1e5-8452-48d4-a6e5-64d3255875ee-feast-data\") pod \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") "
May 26 07:26:18.516378 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.516275    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-offline-tls\") pod \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") "
May 26 07:26:18.516378 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.516349    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwbz4\" (UniqueName: \"kubernetes.io/projected/5a38a1e5-8452-48d4-a6e5-64d3255875ee-kube-api-access-mwbz4\") pod \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") "
May 26 07:26:18.516578 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.516406    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-ui-tls\") pod \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\" (UID: \"5a38a1e5-8452-48d4-a6e5-64d3255875ee\") "
May 26 07:26:18.516801 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.516758    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a38a1e5-8452-48d4-a6e5-64d3255875ee-feast-data" (OuterVolumeSpecName: "feast-data") pod "5a38a1e5-8452-48d4-a6e5-64d3255875ee" (UID: "5a38a1e5-8452-48d4-a6e5-64d3255875ee"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:26:18.517191 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.517163    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a38a1e5-8452-48d4-a6e5-64d3255875ee-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5a38a1e5-8452-48d4-a6e5-64d3255875ee" (UID: "5a38a1e5-8452-48d4-a6e5-64d3255875ee"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:26:18.518651 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.518615    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5a38a1e5-8452-48d4-a6e5-64d3255875ee" (UID: "5a38a1e5-8452-48d4-a6e5-64d3255875ee"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:26:18.518651 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.518633    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-online-tls" (OuterVolumeSpecName: "online-tls") pod "5a38a1e5-8452-48d4-a6e5-64d3255875ee" (UID: "5a38a1e5-8452-48d4-a6e5-64d3255875ee"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:26:18.518861 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.518838    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a38a1e5-8452-48d4-a6e5-64d3255875ee-kube-api-access-mwbz4" (OuterVolumeSpecName: "kube-api-access-mwbz4") pod "5a38a1e5-8452-48d4-a6e5-64d3255875ee" (UID: "5a38a1e5-8452-48d4-a6e5-64d3255875ee"). InnerVolumeSpecName "kube-api-access-mwbz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:26:18.518897 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.518853    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5a38a1e5-8452-48d4-a6e5-64d3255875ee" (UID: "5a38a1e5-8452-48d4-a6e5-64d3255875ee"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:26:18.600311 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.600285    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:26:18.617153 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.617131    2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-ui-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.617153 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.617154    2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-online-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.617310 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.617168    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5a38a1e5-8452-48d4-a6e5-64d3255875ee-registry-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.617310 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.617180    2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38a1e5-8452-48d4-a6e5-64d3255875ee-feast-data\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.617310 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.617192    2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5a38a1e5-8452-48d4-a6e5-64d3255875ee-offline-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.617310 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.617203    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwbz4\" (UniqueName: \"kubernetes.io/projected/5a38a1e5-8452-48d4-a6e5-64d3255875ee-kube-api-access-mwbz4\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.718235 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.718204    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-online-tls\") pod \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") "
May 26 07:26:18.718391 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.718247    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-registry-tls\") pod \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") "
May 26 07:26:18.718391 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.718273    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-feast-data\") pod \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") "
May 26 07:26:18.718391 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.718348    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-ui-tls\") pod \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") "
May 26 07:26:18.718391 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.718377    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-offline-tls\") pod \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") "
May 26 07:26:18.718585 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.718414    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9qzp\" (UniqueName: \"kubernetes.io/projected/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-kube-api-access-t9qzp\") pod \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\" (UID: \"3c0d5302-71d5-4c48-8448-1f1702cdf8a0\") "
May 26 07:26:18.718853 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.718819    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-feast-data" (OuterVolumeSpecName: "feast-data") pod "3c0d5302-71d5-4c48-8448-1f1702cdf8a0" (UID: "3c0d5302-71d5-4c48-8448-1f1702cdf8a0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:26:18.720473 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.720441    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-kube-api-access-t9qzp" (OuterVolumeSpecName: "kube-api-access-t9qzp") pod "3c0d5302-71d5-4c48-8448-1f1702cdf8a0" (UID: "3c0d5302-71d5-4c48-8448-1f1702cdf8a0"). InnerVolumeSpecName "kube-api-access-t9qzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:26:18.720565 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.720492    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3c0d5302-71d5-4c48-8448-1f1702cdf8a0" (UID: "3c0d5302-71d5-4c48-8448-1f1702cdf8a0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:26:18.720565 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.720509    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-online-tls" (OuterVolumeSpecName: "online-tls") pod "3c0d5302-71d5-4c48-8448-1f1702cdf8a0" (UID: "3c0d5302-71d5-4c48-8448-1f1702cdf8a0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:26:18.720711 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.720693    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3c0d5302-71d5-4c48-8448-1f1702cdf8a0" (UID: "3c0d5302-71d5-4c48-8448-1f1702cdf8a0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:26:18.720759 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.720711    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3c0d5302-71d5-4c48-8448-1f1702cdf8a0" (UID: "3c0d5302-71d5-4c48-8448-1f1702cdf8a0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:26:18.819203 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.819173    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9qzp\" (UniqueName: \"kubernetes.io/projected/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-kube-api-access-t9qzp\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.819203 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.819201    2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-online-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.819356 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.819211    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-registry-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.819356 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.819219    2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-feast-data\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.819356 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.819228    2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-ui-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.819356 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.819235    2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c0d5302-71d5-4c48-8448-1f1702cdf8a0-offline-tls\") on node \"ip-10-0-134-143.ec2.internal\" DevicePath \"\""
May 26 07:26:18.880606 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.880533    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m" event={"ID":"5a38a1e5-8452-48d4-a6e5-64d3255875ee","Type":"ContainerDied","Data":"d1363696f30eedb4f8d09ff545b69c8e658b9dc484305c270d99a0c61e2e130f"}
May 26 07:26:18.880606 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.880559    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"
May 26 07:26:18.880606 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.880583    2564 scope.go:117] "RemoveContainer" containerID="4c3720b3042b6ec2830ab8660f688f4111e2aee00b556c5c93b6405ccc1918ac"
May 26 07:26:18.883227 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.883206    2564 generic.go:358] "Generic (PLEG): container finished" podID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerID="2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1" exitCode=137
May 26 07:26:18.883227 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.883225    2564 generic.go:358] "Generic (PLEG): container finished" podID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerID="d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d" exitCode=137
May 26 07:26:18.883344 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.883242    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerDied","Data":"2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1"}
May 26 07:26:18.883344 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.883264    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerDied","Data":"d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d"}
May 26 07:26:18.883344 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.883278    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh" event={"ID":"3c0d5302-71d5-4c48-8448-1f1702cdf8a0","Type":"ContainerDied","Data":"dfb1ab86de9c593def5cf50373c62b2754aace7bfe4fb934bae5ea72fa64fecb"}
May 26 07:26:18.883344 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.883313    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"
May 26 07:26:18.889208 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.889190    2564 scope.go:117] "RemoveContainer" containerID="8d616a2ba9165c9cf523a96a042949cf1a241b3eaa499e44bf5b060c1d1b72b3"
May 26 07:26:18.900693 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.900676    2564 scope.go:117] "RemoveContainer" containerID="314dd15d6a40585c9e4dd7dd9fc9f5d3ebaf9eb0cd172eac29630b450c9e90c3"
May 26 07:26:18.907655 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.907631    2564 scope.go:117] "RemoveContainer" containerID="b710f48644a6e4f9d2a021d9a5ffcdf74bd29ea7681f1c1a7a0a6eaf4aad36ce"
May 26 07:26:18.908846 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.908825    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"]
May 26 07:26:18.911863 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.911840    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-r942m"]
May 26 07:26:18.914342 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.914323    2564 scope.go:117] "RemoveContainer" containerID="e62de1676c3ae29a07e8625c309339756b5d4a1626d69123a8507f351a0c2c5e"
May 26 07:26:18.920588 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.920571    2564 scope.go:117] "RemoveContainer" containerID="ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426"
May 26 07:26:18.923466 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.923445    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"]
May 26 07:26:18.926630 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.926601    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-7s2zh"]
May 26 07:26:18.927849 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.927835    2564 scope.go:117] "RemoveContainer" containerID="2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1"
May 26 07:26:18.934163 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.934147    2564 scope.go:117] "RemoveContainer" containerID="75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a"
May 26 07:26:18.939957 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.939943    2564 scope.go:117] "RemoveContainer" containerID="d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d"
May 26 07:26:18.947766 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.947746    2564 scope.go:117] "RemoveContainer" containerID="9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec"
May 26 07:26:18.954234 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.954218    2564 scope.go:117] "RemoveContainer" containerID="5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01"
May 26 07:26:18.960441 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.960427    2564 scope.go:117] "RemoveContainer" containerID="ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426"
May 26 07:26:18.960689 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:26:18.960660    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426\": container with ID starting with ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426 not found: ID does not exist" containerID="ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426"
May 26 07:26:18.960736 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.960687    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426"} err="failed to get container status \"ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426\": rpc error: code = NotFound desc = could not find container \"ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426\": container with ID starting with ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426 not found: ID does not exist"
May 26 07:26:18.960736 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.960707    2564 scope.go:117] "RemoveContainer" containerID="2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1"
May 26 07:26:18.960931 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:26:18.960916    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1\": container with ID starting with 2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1 not found: ID does not exist" containerID="2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1"
May 26 07:26:18.960974 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.960937    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1"} err="failed to get container status \"2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1\": rpc error: code = NotFound desc = could not find container \"2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1\": container with ID starting with 2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1 not found: ID does not exist"
May 26 07:26:18.960974 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.960955    2564 scope.go:117] "RemoveContainer" containerID="75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a"
May 26 07:26:18.961157 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:26:18.961141    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a\": container with ID starting with 75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a not found: ID does not exist" containerID="75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a"
May 26 07:26:18.961205 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.961163    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a"} err="failed to get container status \"75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a\": rpc error: code = NotFound desc = could not find container \"75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a\": container with ID starting with 75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a not found: ID does not exist"
May 26 07:26:18.961205 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.961177    2564 scope.go:117] "RemoveContainer" containerID="d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d"
May 26 07:26:18.961417 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:26:18.961401    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d\": container with ID starting with d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d not found: ID does not exist" containerID="d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d"
May 26 07:26:18.961455 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.961421    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d"} err="failed to get container status \"d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d\": rpc error: code = NotFound desc = could not find container \"d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d\": container with ID starting with d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d not found: ID does not exist"
May 26 07:26:18.961455 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.961435    2564 scope.go:117] "RemoveContainer" containerID="9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec"
May 26 07:26:18.961670 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:26:18.961648    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec\": container with ID starting with 9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec not found: ID does not exist" containerID="9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec"
May 26 07:26:18.961723 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.961675    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec"} err="failed to get container status \"9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec\": rpc error: code = NotFound desc = could not find container \"9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec\": container with ID starting with 9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec not found: ID does not exist"
May 26 07:26:18.961723 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.961689    2564 scope.go:117] "RemoveContainer" containerID="5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01"
May 26 07:26:18.961912 ip-10-0-134-143 kubenswrapper[2564]: E0526 07:26:18.961893    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01\": container with ID starting with 5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01 not found: ID does not exist" containerID="5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01"
May 26 07:26:18.961976 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.961920    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01"} err="failed to get container status \"5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01\": rpc error: code = NotFound desc = could not find container \"5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01\": container with ID starting with 5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01 not found: ID does not exist"
May 26 07:26:18.961976 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.961941    2564 scope.go:117] "RemoveContainer" containerID="ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426"
May 26 07:26:18.962201 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.962181    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426"} err="failed to get container status \"ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426\": rpc error: code = NotFound desc = could not find container \"ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426\": container with ID starting with ace9659561963d8a818c55176fba33589e6d417eefd9cc95c61662ac269dc426 not found: ID does not exist"
May 26 07:26:18.962256 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.962201    2564 scope.go:117] "RemoveContainer" containerID="2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1"
May 26 07:26:18.962438 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.962416    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1"} err="failed to get container status \"2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1\": rpc error: code = NotFound desc = could not find container \"2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1\": container with ID starting with 2ac499da9d8b231f1990e9d50d41f7aaa43ac49ba0078700bf4a180ba73490c1 not found: ID does not exist"
May 26 07:26:18.962514 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.962439    2564 scope.go:117] "RemoveContainer" containerID="75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a"
May 26 07:26:18.962665 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.962645    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a"} err="failed to get container status \"75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a\": rpc error: code = NotFound desc = could not find container \"75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a\": container with ID starting with 75156f5954060b44ec0c1f2c3159ddf428c91a938ef289fd7e39600ffd89f96a not found: ID does not exist"
May 26 07:26:18.962711 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.962666    2564 scope.go:117] "RemoveContainer" containerID="d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d"
May 26 07:26:18.962855 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.962839    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d"} err="failed to get container status \"d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d\": rpc error: code = NotFound desc = could not find container \"d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d\": container with ID starting with d8ff91ddfba0032b1f294c1fd9fa0e8bab64373bec10b6631ccc1e0d946e055d not found: ID does not exist"
May 26 07:26:18.962919 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.962857    2564 scope.go:117] "RemoveContainer" containerID="9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec"
May 26 07:26:18.963075 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.963047    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec"} err="failed to get container status \"9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec\": rpc error: code = NotFound desc = could not find container \"9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec\": container with ID starting with 9b7bf48f896d9b49066aa967096d7d42f14b14fc50285bb0e7f7da67b34b2fec not found: ID does not exist"
May 26 07:26:18.963075 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.963065    2564 scope.go:117] "RemoveContainer" containerID="5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01"
May 26 07:26:18.963270 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:18.963251    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01"} err="failed to get container status \"5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01\": rpc error: code = NotFound desc = could not find container \"5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01\": container with ID starting with 5f4f025c8d1a89a08978299193c55f02e558f0013c765c541bc3462b43d85b01 not found: ID does not exist"
May 26 07:26:19.058952 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:19.058925    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" path="/var/lib/kubelet/pods/3c0d5302-71d5-4c48-8448-1f1702cdf8a0/volumes"
May 26 07:26:19.059558 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:19.059542    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" path="/var/lib/kubelet/pods/5a38a1e5-8452-48d4-a6e5-64d3255875ee/volumes"
May 26 07:26:45.079899 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:45.079869    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:26:45.080972 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:45.080952    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:26:57.292086 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:57.292057    2564 ???:1] "http2: server: error reading preface from client 10.0.133.78:60266: read tcp 10.0.134.143:10250->10.0.133.78:60266: read: connection reset by peer"
May 26 07:26:57.297206 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:57.297177    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gsdx9_89a930c8-bcd2-44f5-9039-a2e0789bb89a/global-pull-secret-syncer/0.log"
May 26 07:26:57.482229 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:57.482199    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q4qj4_5e93292f-83e2-4ab1-9d48-ffd8d5aee46f/konnectivity-agent/0.log"
May 26 07:26:57.519118 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:26:57.519093    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-143.ec2.internal_1ad3d1c4ba6c2ff0bb291a936631deb2/haproxy/0.log"
May 26 07:27:01.000884 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:01.000854    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nzg5g_12176643-703b-49c7-b5e5-a7539b5042a1/node-exporter/0.log"
May 26 07:27:01.016875 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:01.016850    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nzg5g_12176643-703b-49c7-b5e5-a7539b5042a1/kube-rbac-proxy/0.log"
May 26 07:27:01.034855 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:01.034832    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nzg5g_12176643-703b-49c7-b5e5-a7539b5042a1/init-textfile/0.log"
May 26 07:27:02.705335 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:02.705304    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-7ln8s_2c4037dc-121e-43a0-b3b6-ae75ae4054b9/networking-console-plugin/0.log"
May 26 07:27:04.057282 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057246    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"]
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057471    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="feast-apply"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057482    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="feast-apply"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057501    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="online"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057507    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="online"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057513    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="ui"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057520    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="ui"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057529    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="registry"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057534    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="registry"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057543    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="feast-apply"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057548    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="feast-apply"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057555    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="ui"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057560    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="ui"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057566    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="online"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057571    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="online"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057576    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="offline"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057580    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="offline"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057587    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="feast-init"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057592    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="feast-init"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057600    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="offline"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057604    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="offline"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057610    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="feast-init"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057614    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="feast-init"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057648    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="online"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057655    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="ui"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057663    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="offline"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057669    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="ui"
May 26 07:27:04.057667 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057676    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="offline"
May 26 07:27:04.058453 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057683    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a38a1e5-8452-48d4-a6e5-64d3255875ee" containerName="online"
May 26 07:27:04.058453 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.057689    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c0d5302-71d5-4c48-8448-1f1702cdf8a0" containerName="registry"
May 26 07:27:04.061664 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.061642    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.064181 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.064163    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gtkbg\"/\"kube-root-ca.crt\""
May 26 07:27:04.065277 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.065258    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gtkbg\"/\"openshift-service-ca.crt\""
May 26 07:27:04.065406 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.065293    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gtkbg\"/\"default-dockercfg-c7p5t\""
May 26 07:27:04.071041 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.071001    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"]
May 26 07:27:04.229316 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.229282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-lib-modules\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.229493 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.229326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-proc\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.229493 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.229425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-podres\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.229493 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.229474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfggt\" (UniqueName: \"kubernetes.io/projected/20e02028-2734-46cd-affc-5f0a81eb3841-kube-api-access-lfggt\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.229625 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.229504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-sys\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.330603 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.330570    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfggt\" (UniqueName: \"kubernetes.io/projected/20e02028-2734-46cd-affc-5f0a81eb3841-kube-api-access-lfggt\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.330775 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.330611    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-sys\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.330775 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.330646    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-lib-modules\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.330775 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.330664    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-proc\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.330775 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.330693    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-podres\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.330775 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.330726    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-sys\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.330951 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.330793    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-lib-modules\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.330951 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.330794    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-proc\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.330951 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.330802    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20e02028-2734-46cd-affc-5f0a81eb3841-podres\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.338605 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.338582    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfggt\" (UniqueName: \"kubernetes.io/projected/20e02028-2734-46cd-affc-5f0a81eb3841-kube-api-access-lfggt\") pod \"perf-node-gather-daemonset-n797h\" (UID: \"20e02028-2734-46cd-affc-5f0a81eb3841\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.354386 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.354363    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7ccz7_14cd0641-8c2d-4f5b-8504-860c2a0eebea/dns/0.log"
May 26 07:27:04.371116 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.371094    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7ccz7_14cd0641-8c2d-4f5b-8504-860c2a0eebea/kube-rbac-proxy/0.log"
May 26 07:27:04.371221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.371102    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:04.497815 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.497780    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"]
May 26 07:27:04.500872 ip-10-0-134-143 kubenswrapper[2564]: W0526 07:27:04.500838    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod20e02028_2734_46cd_affc_5f0a81eb3841.slice/crio-1e3c7743fd4139d65b34abb59c798fdb7d41c6736736ec88e293a03dd01f0ceb WatchSource:0}: Error finding container 1e3c7743fd4139d65b34abb59c798fdb7d41c6736736ec88e293a03dd01f0ceb: Status 404 returned error can't find the container with id 1e3c7743fd4139d65b34abb59c798fdb7d41c6736736ec88e293a03dd01f0ceb
May 26 07:27:04.502649 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.502632    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 07:27:04.532819 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.532800    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qkvvz_865291d6-3c5b-4739-a036-7ea8903b6c8e/dns-node-resolver/0.log"
May 26 07:27:04.900221 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:04.900131    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nn9b9_64b5633d-2ef9-4a32-acb5-3679ee903ae9/node-ca/0.log"
May 26 07:27:05.003640 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:05.003604    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h" event={"ID":"20e02028-2734-46cd-affc-5f0a81eb3841","Type":"ContainerStarted","Data":"a1ba3b5e4ed8b2b56af1f962bffd17d1c1753cf0f24f2814c82975f9411f4850"}
May 26 07:27:05.003640 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:05.003638    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h" event={"ID":"20e02028-2734-46cd-affc-5f0a81eb3841","Type":"ContainerStarted","Data":"1e3c7743fd4139d65b34abb59c798fdb7d41c6736736ec88e293a03dd01f0ceb"}
May 26 07:27:05.003889 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:05.003663    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:05.019913 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:05.019872    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h" podStartSLOduration=1.019856477 podStartE2EDuration="1.019856477s" podCreationTimestamp="2026-05-26 07:27:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:27:05.018906226 +0000 UTC m=+1820.581261920" watchObservedRunningTime="2026-05-26 07:27:05.019856477 +0000 UTC m=+1820.582212170"
May 26 07:27:05.829449 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:05.829418    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fp6ht_1f0cbbdd-590a-409e-9b3f-433989f2940e/serve-healthcheck-canary/0.log"
May 26 07:27:06.230490 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:06.230407    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkxlt_2c0016b5-6e09-46cb-ac92-514e0a015abf/kube-rbac-proxy/0.log"
May 26 07:27:06.246891 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:06.246862    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkxlt_2c0016b5-6e09-46cb-ac92-514e0a015abf/exporter/0.log"
May 26 07:27:06.264301 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:06.264277    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkxlt_2c0016b5-6e09-46cb-ac92-514e0a015abf/extractor/0.log"
May 26 07:27:11.016150 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.016115    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-n797h"
May 26 07:27:11.218631 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.218599    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bdr_4f05b089-b857-4e44-81f5-86cd388b45fa/kube-multus-additional-cni-plugins/0.log"
May 26 07:27:11.235134 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.235104    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bdr_4f05b089-b857-4e44-81f5-86cd388b45fa/egress-router-binary-copy/0.log"
May 26 07:27:11.251014 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.250989    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bdr_4f05b089-b857-4e44-81f5-86cd388b45fa/cni-plugins/0.log"
May 26 07:27:11.266841 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.266770    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bdr_4f05b089-b857-4e44-81f5-86cd388b45fa/bond-cni-plugin/0.log"
May 26 07:27:11.283213 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.283185    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bdr_4f05b089-b857-4e44-81f5-86cd388b45fa/routeoverride-cni/0.log"
May 26 07:27:11.298997 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.298975    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bdr_4f05b089-b857-4e44-81f5-86cd388b45fa/whereabouts-cni-bincopy/0.log"
May 26 07:27:11.315590 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.315566    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bdr_4f05b089-b857-4e44-81f5-86cd388b45fa/whereabouts-cni/0.log"
May 26 07:27:11.387153 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.387124    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z9rzq_0baaf30b-4991-4ac5-b330-c379dac4ae4a/kube-multus/0.log"
May 26 07:27:11.403083 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.403047    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q4gb7_0801ad22-d4d0-4de1-9866-986fc02f72f3/network-metrics-daemon/0.log"
May 26 07:27:11.417496 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:11.417462    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q4gb7_0801ad22-d4d0-4de1-9866-986fc02f72f3/kube-rbac-proxy/0.log"
May 26 07:27:12.603656 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:12.603622    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-controller/0.log"
May 26 07:27:12.617659 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:12.617609    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/0.log"
May 26 07:27:12.633595 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:12.633566    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovn-acl-logging/1.log"
May 26 07:27:12.654270 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:12.654234    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/kube-rbac-proxy-node/0.log"
May 26 07:27:12.674029 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:12.673984    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/kube-rbac-proxy-ovn-metrics/0.log"
May 26 07:27:12.689199 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:12.689108    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/northd/0.log"
May 26 07:27:12.706498 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:12.706466    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/nbdb/0.log"
May 26 07:27:12.723869 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:12.723839    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/sbdb/0.log"
May 26 07:27:12.883921 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:12.883886    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8zhkh_ec043f56-b630-4ad1-b67d-de851a55d74b/ovnkube-controller/0.log"
May 26 07:27:13.905226 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:13.905193    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-58c86_c3147f4f-fad0-4325-9137-e80f70229ae6/network-check-target-container/0.log"
May 26 07:27:14.710032 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:14.709994    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8v2lq_04835322-4daf-4aae-a36a-17bc76d04cfd/iptables-alerter/0.log"
May 26 07:27:15.312776 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:15.312745    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5k5gf_93869d12-39bb-40f3-9529-edd714d8c0cc/tuned/0.log"
May 26 07:27:18.342786 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:18.342737    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-q7jh6_4640d633-bd23-41d6-87a5-3be959925a6b/csi-driver/0.log"
May 26 07:27:18.358656 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:18.358636    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-q7jh6_4640d633-bd23-41d6-87a5-3be959925a6b/csi-node-driver-registrar/0.log"
May 26 07:27:18.374113 ip-10-0-134-143 kubenswrapper[2564]: I0526 07:27:18.374091    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-q7jh6_4640d633-bd23-41d6-87a5-3be959925a6b/csi-liveness-probe/0.log"