May 25 05:54:33.311797 ip-10-0-135-159 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 25 05:54:33.311923 ip-10-0-135-159 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 25 05:54:33.312018 ip-10-0-135-159 systemd[1]: kubelet.service: Failed with result 'resources'.
May 25 05:54:33.312578 ip-10-0-135-159 systemd[1]: Failed to start Kubernetes Kubelet.
May 25 05:54:42.428500 ip-10-0-135-159 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 25 05:54:42.428514 ip-10-0-135-159 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1a2c34d86aa3479fa398e0b74364bb31 --
May 25 05:56:49.524854 ip-10-0-135-159 systemd[1]: Starting Kubernetes Kubelet...
May 25 05:56:50.032744 ip-10-0-135-159 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 05:56:50.032744 ip-10-0-135-159 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 05:56:50.032744 ip-10-0-135-159 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 05:56:50.033358 ip-10-0-135-159 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 05:56:50.033358 ip-10-0-135-159 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 05:56:50.034686 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.034600    2572 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 05:56:50.037762 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037747    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037764    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037770    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037773    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037777    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037780    2572 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037782    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037785    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037788    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037791    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037794    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037797    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037800    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037803    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037807    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:56:50.037803 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037810    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037813    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037816    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037818    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037821    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037823    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037826    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037828    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037830    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037833    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037836    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037838    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037840    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037843    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037845    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037848    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037850    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037853    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037855    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037858    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:56:50.038156 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037860    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037863    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037866    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037868    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037870    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037873    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037876    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037878    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037880    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037883    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037885    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037888    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037897    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037900    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037904    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037906    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037909    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037913    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037916    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037920    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:56:50.038719 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037922    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037926    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037929    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037931    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037934    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037937    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037939    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037941    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037944    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037947    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037949    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037952    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037954    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037957    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037960    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037962    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037964    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037967    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037969    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037972    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:56:50.039424 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037974    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037977    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037979    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037983    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037986    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037993    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.037998    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038001    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038004    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038006    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038009    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038665    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038688    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038694    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038699    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038703    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038709    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038713    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038718    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:56:50.039919 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038722    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038727    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038738    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038742    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038746    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038751    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038756    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038760    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038765    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038769    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038773    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038777    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038781    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038785    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038790    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038798    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038803    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038807    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038812    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038816    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:56:50.040426 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038820    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038824    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038828    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038832    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038837    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038846    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038852    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038861    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038868    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038873    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038877    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038881    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038885    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038889    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038893    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038898    2572 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038902    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038906    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038910    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:56:50.040931 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038919    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038923    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038927    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038932    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038936    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038940    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038944    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038949    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038953    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038960    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038965    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038969    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038977    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038981    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038988    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038995    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.038999    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039004    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039010    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:56:50.041411 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039015    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039021    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039025    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039029    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039033    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039043    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039047    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039051    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039055    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039060    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039064    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039068    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039072    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039077    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039081    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039085    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039089    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039093    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039103    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.039107    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:56:50.041873 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040148    2572 flags.go:64] FLAG: --address="0.0.0.0"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040183    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040208    2572 flags.go:64] FLAG: --anonymous-auth="true"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040215    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040222    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040228    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040235    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040261    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040266    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040269    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040276    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040367    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040371    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040375    2572 flags.go:64] FLAG: --cgroup-root=""
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040378    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040381    2572 flags.go:64] FLAG: --client-ca-file=""
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040384    2572 flags.go:64] FLAG: --cloud-config=""
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040387    2572 flags.go:64] FLAG: --cloud-provider="external"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040390    2572 flags.go:64] FLAG: --cluster-dns="[]"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040395    2572 flags.go:64] FLAG: --cluster-domain=""
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040398    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040401    2572 flags.go:64] FLAG: --config-dir=""
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040404    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040407    2572 flags.go:64] FLAG: --container-log-max-files="5"
May 25 05:56:50.042375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040412    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040415    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040418    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040422    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040425    2572 flags.go:64] FLAG: --contention-profiling="false"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040428    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040431    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040435    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040438    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040450    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040454    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040457    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040460    2572 flags.go:64] FLAG: --enable-load-reader="false"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040463    2572 flags.go:64] FLAG: --enable-server="true"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040466    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040475    2572 flags.go:64] FLAG: --event-burst="100"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040479    2572 flags.go:64] FLAG: --event-qps="50"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040482    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040485    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040488    2572 flags.go:64] FLAG: --eviction-hard=""
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040492    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040495    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040498    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040501    2572 flags.go:64] FLAG: --eviction-soft=""
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040505    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 05:56:50.043023 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040508    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040511    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040514    2572 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040516    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040519    2572 flags.go:64] FLAG: --fail-swap-on="true"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040522    2572 flags.go:64] FLAG: --feature-gates=""
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040526    2572 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040529    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040532    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040535    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040538    2572 flags.go:64] FLAG: --healthz-port="10248"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040541    2572 flags.go:64] FLAG: --help="false"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040544    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-135-159.ec2.internal"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040547    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040550    2572 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040553    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040558    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040562    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040565    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040567    2572 flags.go:64] FLAG: --image-service-endpoint=""
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040571    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040574    2572 flags.go:64] FLAG: --kube-api-burst="100"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040577    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040580    2572 flags.go:64] FLAG: --kube-api-qps="50"
May 25 05:56:50.043644 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040583    2572 flags.go:64] FLAG: --kube-reserved=""
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040596    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040599    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040603    2572 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040605    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040608    2572 flags.go:64] FLAG: --lock-file=""
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040611    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040614    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040617    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040623    2572 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040626    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040628    2572 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040632    2572 flags.go:64] FLAG: --logging-format="text"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040635    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040638    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040641    2572 flags.go:64] FLAG: --manifest-url=""
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040644    2572 flags.go:64] FLAG: --manifest-url-header=""
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040649    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040652    2572 flags.go:64] FLAG: --max-open-files="1000000"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040656    2572 flags.go:64] FLAG: --max-pods="110"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040660    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040663    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040666    2572 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040669    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040673    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 05:56:50.044224 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040676    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040679    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040687    2572 flags.go:64] FLAG: --node-status-max-images="50"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040690    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040694    2572 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040697    2572 flags.go:64] FLAG: --pod-cidr=""
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040700    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040706    2572 flags.go:64] FLAG: --pod-manifest-path=""
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040708    2572 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040711    2572 flags.go:64] FLAG: --pods-per-core="0"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040714    2572 flags.go:64] FLAG: --port="10250"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040717    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040720    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e2611f6bb8f9c0c"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040723    2572 flags.go:64] FLAG: --qos-reserved=""
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040726    2572 flags.go:64] FLAG: --read-only-port="10255"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040729    2572 flags.go:64] FLAG: --register-node="true"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040732    2572 flags.go:64] FLAG: --register-schedulable="true"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040735    2572 flags.go:64] FLAG: --register-with-taints=""
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040738    2572 flags.go:64] FLAG: --registry-burst="10"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040741    2572 flags.go:64] FLAG: --registry-qps="5"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040744    2572 flags.go:64] FLAG: --reserved-cpus=""
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040747    2572 flags.go:64] FLAG: --reserved-memory=""
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040754    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040758    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040761    2572 flags.go:64] FLAG: --rotate-certificates="false"
May 25 05:56:50.044904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040763    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040773    2572 flags.go:64] FLAG: --runonce="false"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040776    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040779    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040782    2572 flags.go:64] FLAG: --seccomp-default="false"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040785    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040788    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040791    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040795    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040798    2572 flags.go:64] FLAG: --storage-driver-password="root"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040801    2572 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040804    2572 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040807    2572 flags.go:64] FLAG: --storage-driver-user="root"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040810    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040813    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040816    2572 flags.go:64] FLAG: --system-cgroups=""
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040819    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040825    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040828    2572 flags.go:64] FLAG: --tls-cert-file=""
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040830    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040835    2572 flags.go:64] FLAG: --tls-min-version=""
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040837    2572 flags.go:64] FLAG: --tls-private-key-file=""
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040840    2572 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040843    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040845    2572 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 05:56:50.045486 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040848    2572 flags.go:64] FLAG: --v="2"
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040852    2572 flags.go:64] FLAG: --version="false"
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040856    2572 flags.go:64] FLAG: --vmodule=""
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040860    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.040865    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040954    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040958    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040961    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040964    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040973    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040976    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040979    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040982    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040984    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040987    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040991    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040996    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.040999    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041002    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041004    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:56:50.046092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041007    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041010    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041013    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041016    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041018    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041021    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041024    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041026    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041029    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041032    2572 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041036    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041039    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041043    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041045    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041048    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041051    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041055    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041057    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041060    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041063    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:56:50.046564 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041065    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041067    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041072    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041074    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041077    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041080    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041082    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041085    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041088    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041090    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041092    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041095    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041098    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041100    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041103    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041105    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041108    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041110    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041112    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041115    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:56:50.047092 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041118    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041120    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041123    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041126    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041128    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041130    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041133    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041135    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041139    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041141    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041144    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041147    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041149    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041152    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041154    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041157    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041160    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041162    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041166    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:56:50.047615 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041169    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041171    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041174    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041176    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041179    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041181    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041184    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041187    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041189    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041192    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041194    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.041197    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:56:50.048115 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.042225    2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 05:56:50.050918 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.050893    2572 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 05:56:50.050918 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.050916    2572 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.050980    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.050987    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.050992    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.050997    2572 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051001    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051006    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051010    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051015    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051019    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051023    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051027    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051031    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051035    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051040    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051044    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051048    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051052    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051056    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051060    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:56:50.051068 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051064    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051068    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051072    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051076    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051080    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051084    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051088    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051092    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051097    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051101    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051105    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051109    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051115    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051121    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051129    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051134    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051138    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051142    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051147    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:56:50.051971 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051151    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051155    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051159    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051163    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051167    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051171    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051175    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051179    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051183    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051187    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051192    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051196    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051199    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051204    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051208    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051213    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051217    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051221    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051225    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051229    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:56:50.052531 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051233    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051238    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051242    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051246    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051250    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051254    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051259    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051263    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051268    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051272    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051277    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051281    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051285    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051289    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051293    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051297    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051301    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051313    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051317    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051322    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:56:50.053109 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051326    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051331    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051335    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051339    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051344    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051348    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051355    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051360    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.051369    2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051527    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051534    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051539    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051544    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051548    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051553    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:56:50.053621 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051557    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051561    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051565    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051570    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051580    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051584    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051607    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051611    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051615    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051620    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051623    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051627    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051631    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051635    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051639    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051643    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051647    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051652    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051656    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051660    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:56:50.054239 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051664    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051669    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051672    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051677    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051681    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051686    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051690    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051694    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051698    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051702    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051707    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051711    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051715    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051719    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051723    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051727    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051731    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051736    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051740    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051744    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:56:50.054749 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051748    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051752    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051756    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051761    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051765    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051769    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051773    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051777    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051781    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051785    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051789    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051793    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051797    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051801    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051805    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051809    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051814    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051818    2572 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051822    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051826    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:56:50.055440 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051830    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051834    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051840    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051844    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051848    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051853    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051857    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051862    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051866    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051870    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051875    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051879    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051883    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051887    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051891    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051895    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051899    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051906    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051912    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:56:50.056197 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:50.051917    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:56:50.056775 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.051925    2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 05:56:50.056775 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.052833    2572 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 05:56:50.056879 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.056780    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 05:56:50.057869 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.057855    2572 server.go:1019] "Starting client certificate rotation"
May 25 05:56:50.057971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.057956    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 05:56:50.058009 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.057989    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 05:56:50.085115 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.085093    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 05:56:50.088728 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.088715    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 05:56:50.100117 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.100096    2572 log.go:25] "Validated CRI v1 runtime API"
May 25 05:56:50.106673 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.106658    2572 log.go:25] "Validated CRI v1 image API"
May 25 05:56:50.108076 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.108060    2572 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 05:56:50.113100 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.113078    2572 fs.go:135] Filesystem UUIDs: map[050db280-6b7c-4a02-89e3-0e4bf9742ae1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ffe5df33-adf8-42d4-9773-5be1b1ddacb4:/dev/nvme0n1p4]
May 25 05:56:50.113161 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.113100    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 05:56:50.117146 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.117128    2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 05:56:50.117551 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.117455    2572 manager.go:217] Machine: {Timestamp:2026-05-25 05:56:50.116929537 +0000 UTC m=+0.461547558 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101486 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27004a7e97c0e5a23b4e6ab9d9923f SystemUUID:ec27004a-7e97-c0e5-a23b-4e6ab9d9923f BootID:1a2c34d8-6aa3-479f-a398-e0b74364bb31 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:56:45:0d:40:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:56:45:0d:40:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:e9:ea:65:02:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 05:56:50.118317 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.118304    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 05:56:50.118421 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.118410    2572 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 05:56:50.119579 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.119554    2572 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 05:56:50.119726 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.119581    2572 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-159.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 05:56:50.119776 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.119736    2572 topology_manager.go:138] "Creating topology manager with none policy"
May 25 05:56:50.119776 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.119744    2572 container_manager_linux.go:306] "Creating device plugin manager"
May 25 05:56:50.119776 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.119751    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 05:56:50.120620 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.120610    2572 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 05:56:50.123169 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.123158    2572 state_mem.go:36] "Initialized new in-memory state store"
May 25 05:56:50.123431 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.123421    2572 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 05:56:50.126190 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.126180    2572 kubelet.go:491] "Attempting to sync node with API server"
May 25 05:56:50.126225 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.126198    2572 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 05:56:50.126225 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.126210    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 05:56:50.126225 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.126219    2572 kubelet.go:397] "Adding apiserver pod source"
May 25 05:56:50.126315 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.126226    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 05:56:50.128077 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.128065    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 05:56:50.128120 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.128083    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 05:56:50.131816 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.131801    2572 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 05:56:50.134166 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.134147    2572 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 05:56:50.135120 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135108    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 05:56:50.135169 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135125    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 05:56:50.135169 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135132    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 05:56:50.135169 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135137    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 05:56:50.135169 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135145    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 05:56:50.135169 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135150    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 05:56:50.135169 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135157    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 05:56:50.135169 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135166    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 05:56:50.135354 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135181    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 05:56:50.135354 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135187    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 05:56:50.135354 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135205    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 05:56:50.135630 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.135616    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 05:56:50.136627 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.136614    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 05:56:50.136627 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.136625    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 05:56:50.138471 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.138438    2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 25 05:56:50.138675 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.138656    2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 25 05:56:50.139697 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.139685    2572 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 05:56:50.139759 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.139719    2572 server.go:1295] "Started kubelet"
May 25 05:56:50.139858 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.139788    2572 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 05:56:50.139905 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.139894    2572 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 05:56:50.139952 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.139824    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 05:56:50.140570 ip-10-0-135-159 systemd[1]: Started Kubernetes Kubelet.
May 25 05:56:50.141346 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.141332    2572 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 05:56:50.141635 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.141544    2572 server.go:317] "Adding debug handlers to kubelet server"
May 25 05:56:50.150716 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.150692    2572 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-159.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 25 05:56:50.151860 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.150764    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-159.ec2.internal.18b2b95c9a2f6d27  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-159.ec2.internal,UID:ip-10-0-135-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-159.ec2.internal,},FirstTimestamp:2026-05-25 05:56:50.139696423 +0000 UTC m=+0.484314444,LastTimestamp:2026-05-25 05:56:50.139696423 +0000 UTC m=+0.484314444,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-159.ec2.internal,}"
May 25 05:56:50.153401 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.153378    2572 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 05:56:50.153477 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.153435    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 05:56:50.154095 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.154081    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 05:56:50.154280 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.154247    2572 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 05:56:50.154280 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.154281    2572 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 05:56:50.154389 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.154373    2572 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 05:56:50.154446 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.154409    2572 reconstruct.go:97] "Volume reconstruction finished"
May 25 05:56:50.154446 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.154418    2572 reconciler.go:26] "Reconciler: start to sync state"
May 25 05:56:50.154844 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.154828    2572 factory.go:55] Registering systemd factory
May 25 05:56:50.154907 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.154848    2572 factory.go:223] Registration of the systemd container factory successfully
May 25 05:56:50.155061 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.155048    2572 factory.go:153] Registering CRI-O factory
May 25 05:56:50.155098 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.155063    2572 factory.go:223] Registration of the crio container factory successfully
May 25 05:56:50.155125 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.155101    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 05:56:50.155125 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.155114    2572 factory.go:103] Registering Raw factory
May 25 05:56:50.155125 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.155124    2572 manager.go:1196] Started watching for new ooms in manager
May 25 05:56:50.155409 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.155399    2572 manager.go:319] Starting recovery of all containers
May 25 05:56:50.155677 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.155622    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.158672 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.158494    2572 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 25 05:56:50.158672 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.158617    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 25 05:56:50.162628 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.162436    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4sj2p"
May 25 05:56:50.165175 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.165161    2572 manager.go:324] Recovery completed
May 25 05:56:50.169414 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.169399    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4sj2p"
May 25 05:56:50.169626 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.169614    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:56:50.171472 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.171457    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:56:50.171556 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.171497    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:56:50.171556 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.171511    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientPID"
May 25 05:56:50.172002 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.171988    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 05:56:50.172002 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.172000    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 05:56:50.172087 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.172013    2572 state_mem.go:36] "Initialized new in-memory state store"
May 25 05:56:50.173534 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.173474    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-159.ec2.internal.18b2b95c9c14453d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-159.ec2.internal,UID:ip-10-0-135-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-159.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-159.ec2.internal,},FirstTimestamp:2026-05-25 05:56:50.171471165 +0000 UTC m=+0.516089192,LastTimestamp:2026-05-25 05:56:50.171471165 +0000 UTC m=+0.516089192,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-159.ec2.internal,}"
May 25 05:56:50.175954 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.175936    2572 policy_none.go:49] "None policy: Start"
May 25 05:56:50.175954 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.175953    2572 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 05:56:50.176061 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.175963    2572 state_mem.go:35] "Initializing new in-memory state store"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.216194    2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.217296    2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.217327    2572 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.217345    2572 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.217355    2572 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.217397    2572 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.221640    2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.222148    2572 manager.go:341] "Starting Device Plugin manager"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.222182    2572 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.222191    2572 server.go:85] "Starting device plugin registration server"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.222375    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.222386    2572 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.222456    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.222521    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.222530    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.223014    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 05:56:50.230652 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.223051    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.317995 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.317951    2572 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal"]
May 25 05:56:50.318052 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.318021    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:56:50.318956 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.318935    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:56:50.319042 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.318961    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:56:50.319042 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.318971    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientPID"
May 25 05:56:50.321272 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.321259    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:56:50.321432 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.321419    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.321466 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.321446    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:56:50.321904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.321889    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:56:50.321904 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.321899    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:56:50.321997 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.321916    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:56:50.321997 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.321922    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:56:50.321997 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.321929    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientPID"
May 25 05:56:50.321997 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.321936    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientPID"
May 25 05:56:50.322541 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.322527    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:56:50.323217 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.323203    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:56:50.323304 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.323225    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:56:50.323304 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.323234    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientPID"
May 25 05:56:50.323304 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.323250    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-159.ec2.internal"
May 25 05:56:50.324159 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.324142    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.324240 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.324164    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:56:50.324826 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.324812    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:56:50.324906 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.324837    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:56:50.324906 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.324850    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeHasSufficientPID"
May 25 05:56:50.330335 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.330321    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-159.ec2.internal"
May 25 05:56:50.330403 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.330340    2572 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-159.ec2.internal\": node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.346204 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.346180    2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-159.ec2.internal\" not found" node="ip-10-0-135-159.ec2.internal"
May 25 05:56:50.349553 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.349536    2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-159.ec2.internal\" not found" node="ip-10-0-135-159.ec2.internal"
May 25 05:56:50.362114 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.362094    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.455901 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.455881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/431f7d06e4fc0f9cc0a85823b0930efa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal\" (UID: \"431f7d06e4fc0f9cc0a85823b0930efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.455978 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.455905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/431f7d06e4fc0f9cc0a85823b0930efa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal\" (UID: \"431f7d06e4fc0f9cc0a85823b0930efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.455978 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.455922    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/186505e9c23065d31621bf141c3d9d6b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-159.ec2.internal\" (UID: \"186505e9c23065d31621bf141c3d9d6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.462978 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.462960    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.556290 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.556262    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/431f7d06e4fc0f9cc0a85823b0930efa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal\" (UID: \"431f7d06e4fc0f9cc0a85823b0930efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.556375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.556301    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/431f7d06e4fc0f9cc0a85823b0930efa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal\" (UID: \"431f7d06e4fc0f9cc0a85823b0930efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.556375 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.556325    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/186505e9c23065d31621bf141c3d9d6b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-159.ec2.internal\" (UID: \"186505e9c23065d31621bf141c3d9d6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.556455 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.556372    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/431f7d06e4fc0f9cc0a85823b0930efa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal\" (UID: \"431f7d06e4fc0f9cc0a85823b0930efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.556455 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.556372    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/431f7d06e4fc0f9cc0a85823b0930efa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal\" (UID: \"431f7d06e4fc0f9cc0a85823b0930efa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.556455 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.556374    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/186505e9c23065d31621bf141c3d9d6b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-159.ec2.internal\" (UID: \"186505e9c23065d31621bf141c3d9d6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.563385 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.563366    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.649882 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.649812    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.653575 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.653556    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal"
May 25 05:56:50.663897 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.663880    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.764356 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.764332    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.864807 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.864774    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.965304 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:50.965249    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:50.973638 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:50.973619    2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:56:51.057783 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.057766    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 05:56:51.058257 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.057899    2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 05:56:51.058257 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.057930    2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 05:56:51.065982 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:51.065964    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:51.153677 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.153644    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 05:56:51.166673 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:51.166651    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:51.171054 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.171032    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 05:51:50 +0000 UTC" deadline="2027-11-06 06:24:42.041079637 +0000 UTC"
May 25 05:56:51.171054 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.171053    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12720h27m50.870029467s"
May 25 05:56:51.172791 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.172779    2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 05:56:51.188626 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:51.188579    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431f7d06e4fc0f9cc0a85823b0930efa.slice/crio-7aae35c92a04f51629be3266dede6a60f773a8c9dc0581dfb496da7ef18b2410 WatchSource:0}: Error finding container 7aae35c92a04f51629be3266dede6a60f773a8c9dc0581dfb496da7ef18b2410: Status 404 returned error can't find the container with id 7aae35c92a04f51629be3266dede6a60f773a8c9dc0581dfb496da7ef18b2410
May 25 05:56:51.188833 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:51.188814    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186505e9c23065d31621bf141c3d9d6b.slice/crio-f1cb73dc4daf5b785a72957a390167cd9912cf12ff464a60e28b2bf48616a063 WatchSource:0}: Error finding container f1cb73dc4daf5b785a72957a390167cd9912cf12ff464a60e28b2bf48616a063: Status 404 returned error can't find the container with id f1cb73dc4daf5b785a72957a390167cd9912cf12ff464a60e28b2bf48616a063
May 25 05:56:51.192217 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.192194    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 05:56:51.193939 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.193922    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-65jjh"
May 25 05:56:51.199728 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.199712    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-65jjh"
May 25 05:56:51.219848 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.219786    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal" event={"ID":"186505e9c23065d31621bf141c3d9d6b","Type":"ContainerStarted","Data":"f1cb73dc4daf5b785a72957a390167cd9912cf12ff464a60e28b2bf48616a063"}
May 25 05:56:51.220679 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.220660    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal" event={"ID":"431f7d06e4fc0f9cc0a85823b0930efa","Type":"ContainerStarted","Data":"7aae35c92a04f51629be3266dede6a60f773a8c9dc0581dfb496da7ef18b2410"}
May 25 05:56:51.267276 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:51.267241    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:51.367699 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:51.367674    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-159.ec2.internal\" not found"
May 25 05:56:51.373292 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.373274    2572 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:56:51.455225 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.455206    2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal"
May 25 05:56:51.463739 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.463722    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 05:56:51.465690 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.465679    2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal"
May 25 05:56:51.476416 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.476375    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 05:56:51.667370 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:51.667343    2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:56:52.127880 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.127853    2572 apiserver.go:52] "Watching apiserver"
May 25 05:56:52.136899 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.136860    2572 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 05:56:52.139053 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.139023    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-p9qzc","kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx","openshift-cluster-node-tuning-operator/tuned-t9pjk","openshift-image-registry/node-ca-5gbp5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal","openshift-multus/multus-additional-cni-plugins-5g5mr","openshift-multus/network-metrics-daemon-6kqfz","openshift-dns/node-resolver-472vs","openshift-multus/multus-r8w6d","openshift-network-diagnostics/network-check-target-lww45","openshift-network-operator/iptables-alerter-tlmnl","openshift-ovn-kubernetes/ovnkube-node-sjlbb"]
May 25 05:56:52.141892 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.141870    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.144018 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.144000    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.144787 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.144537    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 05:56:52.144787 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.144564    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 05:56:52.144787 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.144643    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 05:56:52.144977 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.144822    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 05:56:52.144977 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.144886    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 05:56:52.144977 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.144902    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hl5mx\""
May 25 05:56:52.146970 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.146298    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 05:56:52.146970 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.146355    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.146970 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.146612    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 05:56:52.146970 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.146797    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 05:56:52.147202 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.146989    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qndq4\""
May 25 05:56:52.148633 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.148613    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 05:56:52.148799 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.148782    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tld6h\""
May 25 05:56:52.148919 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.148902    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 05:56:52.150919 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.150902    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.150995 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.150978    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:56:52.153082 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.153063    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:52.153180 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.153157    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:56:52.153222 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.153193    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 05:56:52.153679 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.153381    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 05:56:52.153679 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.153514    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 05:56:52.153679 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.153558    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 05:56:52.153679 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.153569    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 05:56:52.153918 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.153719    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5mcs9\""
May 25 05:56:52.153918 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.153838    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dhchm\""
May 25 05:56:52.155402 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.155383    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.157837 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.157814    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 05:56:52.157979 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.157826    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5d6r7\""
May 25 05:56:52.158049 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.158014    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 05:56:52.160189 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.160160    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.160288 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.160269    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:56:52.160352 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.160328    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:56:52.162544 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.162522    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.162544 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.162538    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 05:56:52.162770 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.162525    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kp8bf\""
May 25 05:56:52.164660 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.164630    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0624b917-1ca2-43da-b340-c5fb6e3d3d82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.164928 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.164911    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.165172 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165149    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-sysctl-conf\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.165255 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165190    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-lib-modules\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.165255 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165207    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-var-lib-kubelet\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.165255 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165223    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-host\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.165408 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165255    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.165408 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165281    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f38391ef-3d66-4962-b86b-b85a021d2ed3-konnectivity-ca\") pod \"konnectivity-agent-p9qzc\" (UID: \"f38391ef-3d66-4962-b86b-b85a021d2ed3\") " pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:56:52.165408 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165296    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpvs7\" (UniqueName: \"kubernetes.io/projected/0624b917-1ca2-43da-b340-c5fb6e3d3d82-kube-api-access-dpvs7\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.165408 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165312    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8nfg\" (UniqueName: \"kubernetes.io/projected/ae815701-2282-487d-b46f-85aad7c1c417-kube-api-access-b8nfg\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.165408 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqhgv\" (UniqueName: \"kubernetes.io/projected/366f4627-67e1-4237-bc30-b698c5877dc3-kube-api-access-jqhgv\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.165408 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165373    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0624b917-1ca2-43da-b340-c5fb6e3d3d82-cni-binary-copy\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165417    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0624b917-1ca2-43da-b340-c5fb6e3d3d82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165446    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-modprobe-d\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165471    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-shs4n\""
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165483    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165484    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-systemd\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165530    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165550    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165555    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae815701-2282-487d-b46f-85aad7c1c417-etc-tuned\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165612    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/718854ed-6ec3-4f1e-9349-6196422a2995-host\") pod \"node-ca-5gbp5\" (UID: \"718854ed-6ec3-4f1e-9349-6196422a2995\") " pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165628    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hv5t\" (UniqueName: \"kubernetes.io/projected/718854ed-6ec3-4f1e-9349-6196422a2995-kube-api-access-5hv5t\") pod \"node-ca-5gbp5\" (UID: \"718854ed-6ec3-4f1e-9349-6196422a2995\") " pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165642    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-os-release\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165658    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-sysctl-d\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.165719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-sys-fs\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.166232 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.165700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5ff7734-4e0b-417c-a06f-1a9ea55333c9-tmp-dir\") pod \"node-resolver-472vs\" (UID: \"c5ff7734-4e0b-417c-a06f-1a9ea55333c9\") " pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.166232 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166169    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbm2v\" (UniqueName: \"kubernetes.io/projected/c5ff7734-4e0b-417c-a06f-1a9ea55333c9-kube-api-access-hbm2v\") pod \"node-resolver-472vs\" (UID: \"c5ff7734-4e0b-417c-a06f-1a9ea55333c9\") " pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.166232 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166216    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-system-cni-dir\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.166377 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-cnibin\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.166377 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166285    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-sysconfig\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.166377 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166299    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f38391ef-3d66-4962-b86b-b85a021d2ed3-agent-certs\") pod \"konnectivity-agent-p9qzc\" (UID: \"f38391ef-3d66-4962-b86b-b85a021d2ed3\") " pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:56:52.166377 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166327    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/718854ed-6ec3-4f1e-9349-6196422a2995-serviceca\") pod \"node-ca-5gbp5\" (UID: \"718854ed-6ec3-4f1e-9349-6196422a2995\") " pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.166377 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5ff7734-4e0b-417c-a06f-1a9ea55333c9-hosts-file\") pod \"node-resolver-472vs\" (UID: \"c5ff7734-4e0b-417c-a06f-1a9ea55333c9\") " pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.166377 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166376    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.166665 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:52.166665 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166411    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvdkp\" (UniqueName: \"kubernetes.io/projected/ceedf6b0-232e-4dcf-a1d2-694317d0046d-kube-api-access-jvdkp\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:52.166665 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166424    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-socket-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.166665 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166437    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-device-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.166665 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-kubernetes\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.166665 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-run\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.166665 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166536    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-sys\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.166665 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae815701-2282-487d-b46f-85aad7c1c417-tmp\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.166665 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166644    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-registration-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.167001 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.166669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.167160 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.167138    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tlk6x\""
May 25 05:56:52.168094 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.167786    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 05:56:52.168356 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.168338    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 05:56:52.168507 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.168491    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 05:56:52.168995 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.168978    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 05:56:52.170858 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.170836    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 05:56:52.170858 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.170843    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 05:56:52.200788 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.200758    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 05:51:51 +0000 UTC" deadline="2028-01-31 20:31:59.713361712 +0000 UTC"
May 25 05:56:52.200863 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.200788    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14798h35m7.512576295s"
May 25 05:56:52.255528 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.255502    2572 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 05:56:52.267879 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.267853    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.268005 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.267882    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f38391ef-3d66-4962-b86b-b85a021d2ed3-konnectivity-ca\") pod \"konnectivity-agent-p9qzc\" (UID: \"f38391ef-3d66-4962-b86b-b85a021d2ed3\") " pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:56:52.268005 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.267900    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpvs7\" (UniqueName: \"kubernetes.io/projected/0624b917-1ca2-43da-b340-c5fb6e3d3d82-kube-api-access-dpvs7\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.268005 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.267916    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8nfg\" (UniqueName: \"kubernetes.io/projected/ae815701-2282-487d-b46f-85aad7c1c417-kube-api-access-b8nfg\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.268005 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.267987    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.268216 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268142    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-run-netns\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.268216 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268177    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/476dac2d-0fea-4248-a958-02680c3762d8-ovnkube-config\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.268332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268217    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhgv\" (UniqueName: \"kubernetes.io/projected/366f4627-67e1-4237-bc30-b698c5877dc3-kube-api-access-jqhgv\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.268332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268243    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-systemd\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.268332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268270    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-system-cni-dir\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.268332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268317    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-run-k8s-cni-cncf-io\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.268332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268329    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-systemd\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268341    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-var-lib-kubelet\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-daemon-config\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268393    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/718854ed-6ec3-4f1e-9349-6196422a2995-host\") pod \"node-ca-5gbp5\" (UID: \"718854ed-6ec3-4f1e-9349-6196422a2995\") " pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268419    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hv5t\" (UniqueName: \"kubernetes.io/projected/718854ed-6ec3-4f1e-9349-6196422a2995-kube-api-access-5hv5t\") pod \"node-ca-5gbp5\" (UID: \"718854ed-6ec3-4f1e-9349-6196422a2995\") " pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268464    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-kubelet\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268476    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/718854ed-6ec3-4f1e-9349-6196422a2995-host\") pod \"node-ca-5gbp5\" (UID: \"718854ed-6ec3-4f1e-9349-6196422a2995\") " pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268524    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-cnibin\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268546    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-var-lib-cni-bin\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268565    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f38391ef-3d66-4962-b86b-b85a021d2ed3-konnectivity-ca\") pod \"konnectivity-agent-p9qzc\" (UID: \"f38391ef-3d66-4962-b86b-b85a021d2ed3\") " pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:56:52.268582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268569    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-socket-dir-parent\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268640    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-sysctl-d\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268668    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5ff7734-4e0b-417c-a06f-1a9ea55333c9-tmp-dir\") pod \"node-resolver-472vs\" (UID: \"c5ff7734-4e0b-417c-a06f-1a9ea55333c9\") " pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268690    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-system-cni-dir\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268713    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-cnibin\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268742    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-run-openvswitch\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268767    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/718854ed-6ec3-4f1e-9349-6196422a2995-serviceca\") pod \"node-ca-5gbp5\" (UID: \"718854ed-6ec3-4f1e-9349-6196422a2995\") " pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268773    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-cnibin\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268791    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268816    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvdkp\" (UniqueName: \"kubernetes.io/projected/ceedf6b0-232e-4dcf-a1d2-694317d0046d-kube-api-access-jvdkp\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268830    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-sysctl-d\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268875    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24ac1167-5fd9-41e0-a10b-87e22e730e96-cni-binary-copy\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268901    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-var-lib-openvswitch\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268929    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-node-log\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.268936    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268957    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8d8j\" (UniqueName: \"kubernetes.io/projected/476dac2d-0fea-4248-a958-02680c3762d8-kube-api-access-g8d8j\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268982    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5ff7734-4e0b-417c-a06f-1a9ea55333c9-tmp-dir\") pod \"node-resolver-472vs\" (UID: \"c5ff7734-4e0b-417c-a06f-1a9ea55333c9\") " pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.269112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.268986    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-device-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.269037    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs podName:ceedf6b0-232e-4dcf-a1d2-694317d0046d nodeName:}" failed. No retries permitted until 2026-05-25 05:56:52.768987196 +0000 UTC m=+3.113605236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs") pod "network-metrics-daemon-6kqfz" (UID: "ceedf6b0-232e-4dcf-a1d2-694317d0046d") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269105    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-run\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269133    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c-iptables-alerter-script\") pod \"iptables-alerter-tlmnl\" (UID: \"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c\") " pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269035    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-device-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269167    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/718854ed-6ec3-4f1e-9349-6196422a2995-serviceca\") pod \"node-ca-5gbp5\" (UID: \"718854ed-6ec3-4f1e-9349-6196422a2995\") " pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269205    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-registration-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269205    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-run\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269239    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-system-cni-dir\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269251    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269255    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-registration-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269284    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0624b917-1ca2-43da-b340-c5fb6e3d3d82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269305    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-sysctl-conf\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269327    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-lib-modules\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269349    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.269895 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269350    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-var-lib-kubelet\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269395    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-var-lib-kubelet\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269405    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-host\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269440    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-systemd-units\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269463    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-os-release\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269463    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-lib-modules\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269487    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c-host-slash\") pod \"iptables-alerter-tlmnl\" (UID: \"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c\") " pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269503    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-sysctl-conf\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269511    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/476dac2d-0fea-4248-a958-02680c3762d8-ovn-node-metrics-cert\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269516    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-host\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269546    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-var-lib-cni-multus\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269568    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269608    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5bwf\" (UniqueName: \"kubernetes.io/projected/3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c-kube-api-access-r5bwf\") pod \"iptables-alerter-tlmnl\" (UID: \"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c\") " pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269652    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-run-systemd\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269690    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-log-socket\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-cni-netd\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269745    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/476dac2d-0fea-4248-a958-02680c3762d8-ovnkube-script-lib\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.270624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269843    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0624b917-1ca2-43da-b340-c5fb6e3d3d82-cni-binary-copy\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269847    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0624b917-1ca2-43da-b340-c5fb6e3d3d82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269888    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0624b917-1ca2-43da-b340-c5fb6e3d3d82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269934    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-modprobe-d\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.269959    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae815701-2282-487d-b46f-85aad7c1c417-etc-tuned\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270072    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-modprobe-d\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270106    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-hostroot\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270134    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-os-release\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270144    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0624b917-1ca2-43da-b340-c5fb6e3d3d82-cni-binary-copy\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-etc-kubernetes\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270200    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-run-netns\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-run-ovn\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270250    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-sys-fs\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270276    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbm2v\" (UniqueName: \"kubernetes.io/projected/c5ff7734-4e0b-417c-a06f-1a9ea55333c9-kube-api-access-hbm2v\") pod \"node-resolver-472vs\" (UID: \"c5ff7734-4e0b-417c-a06f-1a9ea55333c9\") " pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270302    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-sysconfig\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270328    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f38391ef-3d66-4962-b86b-b85a021d2ed3-agent-certs\") pod \"konnectivity-agent-p9qzc\" (UID: \"f38391ef-3d66-4962-b86b-b85a021d2ed3\") " pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270355    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-run-multus-certs\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.271312 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270380    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-etc-openvswitch\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270388    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-sysconfig\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270459    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-os-release\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270563    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270645    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-sys-fs\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-cni-bin\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270678    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0624b917-1ca2-43da-b340-c5fb6e3d3d82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270707    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5ff7734-4e0b-417c-a06f-1a9ea55333c9-hosts-file\") pod \"node-resolver-472vs\" (UID: \"c5ff7734-4e0b-417c-a06f-1a9ea55333c9\") " pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270735    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-cni-dir\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt78s\" (UniqueName: \"kubernetes.io/projected/24ac1167-5fd9-41e0-a10b-87e22e730e96-kube-api-access-lt78s\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270821    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-socket-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270827    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5ff7734-4e0b-417c-a06f-1a9ea55333c9-hosts-file\") pod \"node-resolver-472vs\" (UID: \"c5ff7734-4e0b-417c-a06f-1a9ea55333c9\") " pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270845    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-kubernetes\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270868    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-sys\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270899    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae815701-2282-487d-b46f-85aad7c1c417-tmp\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270909    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0624b917-1ca2-43da-b340-c5fb6e3d3d82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.271971 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/476dac2d-0fea-4248-a958-02680c3762d8-env-overrides\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.272488 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270953    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/366f4627-67e1-4237-bc30-b698c5877dc3-socket-dir\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.272488 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.270974    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-sys\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.272488 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.271005    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae815701-2282-487d-b46f-85aad7c1c417-etc-kubernetes\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.272488 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.271006    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-conf-dir\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.272488 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.271042    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-slash\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.272488 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.271730    2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:56:52.273697 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.273676    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae815701-2282-487d-b46f-85aad7c1c417-etc-tuned\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.273795 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.273727    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae815701-2282-487d-b46f-85aad7c1c417-tmp\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.274336 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.273976    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f38391ef-3d66-4962-b86b-b85a021d2ed3-agent-certs\") pod \"konnectivity-agent-p9qzc\" (UID: \"f38391ef-3d66-4962-b86b-b85a021d2ed3\") " pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:56:52.276579 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.276456    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hv5t\" (UniqueName: \"kubernetes.io/projected/718854ed-6ec3-4f1e-9349-6196422a2995-kube-api-access-5hv5t\") pod \"node-ca-5gbp5\" (UID: \"718854ed-6ec3-4f1e-9349-6196422a2995\") " pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.276579 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.276486    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpvs7\" (UniqueName: \"kubernetes.io/projected/0624b917-1ca2-43da-b340-c5fb6e3d3d82-kube-api-access-dpvs7\") pod \"multus-additional-cni-plugins-5g5mr\" (UID: \"0624b917-1ca2-43da-b340-c5fb6e3d3d82\") " pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.276579 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.276493    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqhgv\" (UniqueName: \"kubernetes.io/projected/366f4627-67e1-4237-bc30-b698c5877dc3-kube-api-access-jqhgv\") pod \"aws-ebs-csi-driver-node-2n4lx\" (UID: \"366f4627-67e1-4237-bc30-b698c5877dc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.276579 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.276541    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8nfg\" (UniqueName: \"kubernetes.io/projected/ae815701-2282-487d-b46f-85aad7c1c417-kube-api-access-b8nfg\") pod \"tuned-t9pjk\" (UID: \"ae815701-2282-487d-b46f-85aad7c1c417\") " pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.277632 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.277611    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvdkp\" (UniqueName: \"kubernetes.io/projected/ceedf6b0-232e-4dcf-a1d2-694317d0046d-kube-api-access-jvdkp\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:52.280124 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.280107    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbm2v\" (UniqueName: \"kubernetes.io/projected/c5ff7734-4e0b-417c-a06f-1a9ea55333c9-kube-api-access-hbm2v\") pod \"node-resolver-472vs\" (UID: \"c5ff7734-4e0b-417c-a06f-1a9ea55333c9\") " pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.372008 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.371970    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-hostroot\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372168 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372053    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-hostroot\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372168 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372113    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-etc-kubernetes\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372168 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372153    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-run-netns\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372168 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372123    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-etc-kubernetes\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372185    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-run-ovn\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372198    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-run-netns\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372216    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-run-ovn\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372216    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-run-multus-certs\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372238    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-run-multus-certs\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372250    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-etc-openvswitch\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372268    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-cni-bin\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372291    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-cni-dir\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372315    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lt78s\" (UniqueName: \"kubernetes.io/projected/24ac1167-5fd9-41e0-a10b-87e22e730e96-kube-api-access-lt78s\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372332 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372317    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-etc-openvswitch\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372327    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-cni-bin\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372343    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/476dac2d-0fea-4248-a958-02680c3762d8-env-overrides\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372377    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-conf-dir\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372381    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-cni-dir\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372401    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-slash\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372431    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-run-netns\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372453    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/476dac2d-0fea-4248-a958-02680c3762d8-ovnkube-config\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372459    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-slash\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372431    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-conf-dir\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372480    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-system-cni-dir\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372503    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-run-netns\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372506    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-run-k8s-cni-cncf-io\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372539    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-run-k8s-cni-cncf-io\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372540    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-var-lib-kubelet\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372604    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-daemon-config\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372618    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-system-cni-dir\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372637    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-kubelet\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.372790 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372656    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-var-lib-kubelet\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372675    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372702    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-cnibin\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372727    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-var-lib-cni-bin\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372750    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-socket-dir-parent\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372759    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-kubelet\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372779    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-run-openvswitch\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372828    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-cnibin\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372832    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/476dac2d-0fea-4248-a958-02680c3762d8-env-overrides\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372831    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24ac1167-5fd9-41e0-a10b-87e22e730e96-cni-binary-copy\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372888    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372899    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-socket-dir-parent\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372934    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-run-openvswitch\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372941    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-var-lib-cni-bin\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372968    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-var-lib-openvswitch\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.372993    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-node-log\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373007    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/476dac2d-0fea-4248-a958-02680c3762d8-ovnkube-config\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373021    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8d8j\" (UniqueName: \"kubernetes.io/projected/476dac2d-0fea-4248-a958-02680c3762d8-kube-api-access-g8d8j\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.373646 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373034    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-var-lib-openvswitch\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373057    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-node-log\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373048    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c-iptables-alerter-script\") pod \"iptables-alerter-tlmnl\" (UID: \"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c\") " pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373096    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373130    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-systemd-units\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373155    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-os-release\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373165    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24ac1167-5fd9-41e0-a10b-87e22e730e96-multus-daemon-config\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373185    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c-host-slash\") pod \"iptables-alerter-tlmnl\" (UID: \"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c\") " pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373212    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/476dac2d-0fea-4248-a958-02680c3762d8-ovn-node-metrics-cert\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373235    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373244    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24ac1167-5fd9-41e0-a10b-87e22e730e96-cni-binary-copy\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373237    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-var-lib-cni-multus\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373280    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373297    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c-host-slash\") pod \"iptables-alerter-tlmnl\" (UID: \"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c\") " pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373308    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-systemd-units\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373325    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5bwf\" (UniqueName: \"kubernetes.io/projected/3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c-kube-api-access-r5bwf\") pod \"iptables-alerter-tlmnl\" (UID: \"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c\") " pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373330    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-os-release\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.374333 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373280    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24ac1167-5fd9-41e0-a10b-87e22e730e96-host-var-lib-cni-multus\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.374872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373351    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-run-systemd\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373382    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-run-systemd\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373382    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-log-socket\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373415    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-log-socket\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373417    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-cni-netd\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373447    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/476dac2d-0fea-4248-a958-02680c3762d8-host-cni-netd\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373454    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/476dac2d-0fea-4248-a958-02680c3762d8-ovnkube-script-lib\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.374872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373663    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c-iptables-alerter-script\") pod \"iptables-alerter-tlmnl\" (UID: \"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c\") " pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.374872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.373909    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/476dac2d-0fea-4248-a958-02680c3762d8-ovnkube-script-lib\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.375362 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.375337    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/476dac2d-0fea-4248-a958-02680c3762d8-ovn-node-metrics-cert\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.378748 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.378695    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:56:52.378748 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.378714    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:56:52.378748 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.378727    2572 projected.go:194] Error preparing data for projected volume kube-api-access-v7k9m for pod openshift-network-diagnostics/network-check-target-lww45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:56:52.378949 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.378784    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m podName:c3a9be39-aa81-4cca-b40e-f9e5f3109621 nodeName:}" failed. No retries permitted until 2026-05-25 05:56:52.878766801 +0000 UTC m=+3.223384829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v7k9m" (UniqueName: "kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m") pod "network-check-target-lww45" (UID: "c3a9be39-aa81-4cca-b40e-f9e5f3109621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:56:52.380729 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.380712    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8d8j\" (UniqueName: \"kubernetes.io/projected/476dac2d-0fea-4248-a958-02680c3762d8-kube-api-access-g8d8j\") pod \"ovnkube-node-sjlbb\" (UID: \"476dac2d-0fea-4248-a958-02680c3762d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.381280 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.381262    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5bwf\" (UniqueName: \"kubernetes.io/projected/3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c-kube-api-access-r5bwf\") pod \"iptables-alerter-tlmnl\" (UID: \"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c\") " pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.381451 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.381426    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt78s\" (UniqueName: \"kubernetes.io/projected/24ac1167-5fd9-41e0-a10b-87e22e730e96-kube-api-access-lt78s\") pod \"multus-r8w6d\" (UID: \"24ac1167-5fd9-41e0-a10b-87e22e730e96\") " pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.454160 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.454122    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5g5mr"
May 25 05:56:52.461961 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.461936    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx"
May 25 05:56:52.472666 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.472644    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t9pjk"
May 25 05:56:52.476219 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.476202    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gbp5"
May 25 05:56:52.482750 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.482731    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:56:52.488680 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.488657    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-472vs"
May 25 05:56:52.495199 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.495181    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r8w6d"
May 25 05:56:52.502732 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.502712    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tlmnl"
May 25 05:56:52.508385 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.508364    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:56:52.776580 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.776497    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:52.776756 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.776640    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:56:52.776756 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.776719    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs podName:ceedf6b0-232e-4dcf-a1d2-694317d0046d nodeName:}" failed. No retries permitted until 2026-05-25 05:56:53.776696688 +0000 UTC m=+4.121314709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs") pod "network-metrics-daemon-6kqfz" (UID: "ceedf6b0-232e-4dcf-a1d2-694317d0046d") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:56:52.886766 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:52.886729    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ff7734_4e0b_417c_a06f_1a9ea55333c9.slice/crio-186ab158f1b54a37ff858c182a1b73fbb4f5c326bea62ea08fdccae1429c2b3b WatchSource:0}: Error finding container 186ab158f1b54a37ff858c182a1b73fbb4f5c326bea62ea08fdccae1429c2b3b: Status 404 returned error can't find the container with id 186ab158f1b54a37ff858c182a1b73fbb4f5c326bea62ea08fdccae1429c2b3b
May 25 05:56:52.887912 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:52.887894    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0624b917_1ca2_43da_b340_c5fb6e3d3d82.slice/crio-c01805d29f223e326701c708d470ba9d8d34a94b1d65cc61948ba04b5ed88d64 WatchSource:0}: Error finding container c01805d29f223e326701c708d470ba9d8d34a94b1d65cc61948ba04b5ed88d64: Status 404 returned error can't find the container with id c01805d29f223e326701c708d470ba9d8d34a94b1d65cc61948ba04b5ed88d64
May 25 05:56:52.891225 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:52.891198    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718854ed_6ec3_4f1e_9349_6196422a2995.slice/crio-8db8fd6e40ee3f10e37c3c0fac3f5870cd0baa5f4ed62b43c1d0925831a0609d WatchSource:0}: Error finding container 8db8fd6e40ee3f10e37c3c0fac3f5870cd0baa5f4ed62b43c1d0925831a0609d: Status 404 returned error can't find the container with id 8db8fd6e40ee3f10e37c3c0fac3f5870cd0baa5f4ed62b43c1d0925831a0609d
May 25 05:56:52.891826 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:52.891793    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae815701_2282_487d_b46f_85aad7c1c417.slice/crio-a2ade571bea9448314d6e9c5fae9e4794f028d52558b8522355fb639ec3aa247 WatchSource:0}: Error finding container a2ade571bea9448314d6e9c5fae9e4794f028d52558b8522355fb639ec3aa247: Status 404 returned error can't find the container with id a2ade571bea9448314d6e9c5fae9e4794f028d52558b8522355fb639ec3aa247
May 25 05:56:52.892547 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:52.892522    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ac1167_5fd9_41e0_a10b_87e22e730e96.slice/crio-32161598435a036a78e837d68bda95ead836e6ae5b85b75820117748f013adef WatchSource:0}: Error finding container 32161598435a036a78e837d68bda95ead836e6ae5b85b75820117748f013adef: Status 404 returned error can't find the container with id 32161598435a036a78e837d68bda95ead836e6ae5b85b75820117748f013adef
May 25 05:56:52.893496 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:52.893475    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366f4627_67e1_4237_bc30_b698c5877dc3.slice/crio-9212306d6e9ae4f393f530171fde80d82498fb3bd3bca9488712a7a4729157f5 WatchSource:0}: Error finding container 9212306d6e9ae4f393f530171fde80d82498fb3bd3bca9488712a7a4729157f5: Status 404 returned error can't find the container with id 9212306d6e9ae4f393f530171fde80d82498fb3bd3bca9488712a7a4729157f5
May 25 05:56:52.895214 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:52.894720    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd2d1aa_65b7_4138_bf8d_3d9ca3631e4c.slice/crio-b9ef14bd914c0167f1d3eeb3657b00dd8b3d30c9f1c2d46b0f26eab68912356e WatchSource:0}: Error finding container b9ef14bd914c0167f1d3eeb3657b00dd8b3d30c9f1c2d46b0f26eab68912356e: Status 404 returned error can't find the container with id b9ef14bd914c0167f1d3eeb3657b00dd8b3d30c9f1c2d46b0f26eab68912356e
May 25 05:56:52.895730 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:52.895635    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476dac2d_0fea_4248_a958_02680c3762d8.slice/crio-14e251b76df526904da779bd5510e43c644b0ca34d85d7e9802dad7a852f4695 WatchSource:0}: Error finding container 14e251b76df526904da779bd5510e43c644b0ca34d85d7e9802dad7a852f4695: Status 404 returned error can't find the container with id 14e251b76df526904da779bd5510e43c644b0ca34d85d7e9802dad7a852f4695
May 25 05:56:52.897466 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:56:52.897299    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38391ef_3d66_4962_b86b_b85a021d2ed3.slice/crio-70ba57a7a1d43bf228a39715cc86c350857d4b5e6f65ab24b9e55a484c2ab517 WatchSource:0}: Error finding container 70ba57a7a1d43bf228a39715cc86c350857d4b5e6f65ab24b9e55a484c2ab517: Status 404 returned error can't find the container with id 70ba57a7a1d43bf228a39715cc86c350857d4b5e6f65ab24b9e55a484c2ab517
May 25 05:56:52.978404 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:52.978294    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:56:52.978492 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.978447    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:56:52.978492 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.978482    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:56:52.978492 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.978491    2572 projected.go:194] Error preparing data for projected volume kube-api-access-v7k9m for pod openshift-network-diagnostics/network-check-target-lww45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:56:52.978617 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:52.978533    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m podName:c3a9be39-aa81-4cca-b40e-f9e5f3109621 nodeName:}" failed. No retries permitted until 2026-05-25 05:56:53.978519966 +0000 UTC m=+4.323137974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7k9m" (UniqueName: "kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m") pod "network-check-target-lww45" (UID: "c3a9be39-aa81-4cca-b40e-f9e5f3109621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:56:53.201238 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.201209    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 05:51:51 +0000 UTC" deadline="2027-11-27 16:05:41.207068402 +0000 UTC"
May 25 05:56:53.201238 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.201235    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13234h8m48.005835598s"
May 25 05:56:53.224820 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.224793    2572 generic.go:358] "Generic (PLEG): container finished" podID="431f7d06e4fc0f9cc0a85823b0930efa" containerID="bb3848162e2a87d1d724da5778280930633384e8394414f79e33a597d52636ab" exitCode=0
May 25 05:56:53.224925 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.224873    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal" event={"ID":"431f7d06e4fc0f9cc0a85823b0930efa","Type":"ContainerDied","Data":"bb3848162e2a87d1d724da5778280930633384e8394414f79e33a597d52636ab"}
May 25 05:56:53.225832 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.225810    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p9qzc" event={"ID":"f38391ef-3d66-4962-b86b-b85a021d2ed3","Type":"ContainerStarted","Data":"70ba57a7a1d43bf228a39715cc86c350857d4b5e6f65ab24b9e55a484c2ab517"}
May 25 05:56:53.226787 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.226769    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" event={"ID":"476dac2d-0fea-4248-a958-02680c3762d8","Type":"ContainerStarted","Data":"14e251b76df526904da779bd5510e43c644b0ca34d85d7e9802dad7a852f4695"}
May 25 05:56:53.227637 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.227609    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gbp5" event={"ID":"718854ed-6ec3-4f1e-9349-6196422a2995","Type":"ContainerStarted","Data":"8db8fd6e40ee3f10e37c3c0fac3f5870cd0baa5f4ed62b43c1d0925831a0609d"}
May 25 05:56:53.228456 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.228432    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-472vs" event={"ID":"c5ff7734-4e0b-417c-a06f-1a9ea55333c9","Type":"ContainerStarted","Data":"186ab158f1b54a37ff858c182a1b73fbb4f5c326bea62ea08fdccae1429c2b3b"}
May 25 05:56:53.229534 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.229513    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal" event={"ID":"186505e9c23065d31621bf141c3d9d6b","Type":"ContainerStarted","Data":"bd379baa1692d45b857ed5f749395b52824fc7a937bfa22d3b9d0fff16a9c65b"}
May 25 05:56:53.230537 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.230512    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t9pjk" event={"ID":"ae815701-2282-487d-b46f-85aad7c1c417","Type":"ContainerStarted","Data":"a2ade571bea9448314d6e9c5fae9e4794f028d52558b8522355fb639ec3aa247"}
May 25 05:56:53.231576 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.231553    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tlmnl" event={"ID":"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c","Type":"ContainerStarted","Data":"b9ef14bd914c0167f1d3eeb3657b00dd8b3d30c9f1c2d46b0f26eab68912356e"}
May 25 05:56:53.232528 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.232505    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx" event={"ID":"366f4627-67e1-4237-bc30-b698c5877dc3","Type":"ContainerStarted","Data":"9212306d6e9ae4f393f530171fde80d82498fb3bd3bca9488712a7a4729157f5"}
May 25 05:56:53.233419 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.233398    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r8w6d" event={"ID":"24ac1167-5fd9-41e0-a10b-87e22e730e96","Type":"ContainerStarted","Data":"32161598435a036a78e837d68bda95ead836e6ae5b85b75820117748f013adef"}
May 25 05:56:53.234299 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.234282    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g5mr" event={"ID":"0624b917-1ca2-43da-b340-c5fb6e3d3d82","Type":"ContainerStarted","Data":"c01805d29f223e326701c708d470ba9d8d34a94b1d65cc61948ba04b5ed88d64"}
May 25 05:56:53.788456 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.788422    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:53.788690 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:53.788604    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:56:53.788690 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:53.788672    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs podName:ceedf6b0-232e-4dcf-a1d2-694317d0046d nodeName:}" failed. No retries permitted until 2026-05-25 05:56:55.788654771 +0000 UTC m=+6.133272793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs") pod "network-metrics-daemon-6kqfz" (UID: "ceedf6b0-232e-4dcf-a1d2-694317d0046d") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:56:53.990929 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:53.990892    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:56:53.993996 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:53.993965    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:56:53.993996 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:53.993997    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:56:53.994169 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:53.994018    2572 projected.go:194] Error preparing data for projected volume kube-api-access-v7k9m for pod openshift-network-diagnostics/network-check-target-lww45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:56:53.994169 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:53.994089    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m podName:c3a9be39-aa81-4cca-b40e-f9e5f3109621 nodeName:}" failed. No retries permitted until 2026-05-25 05:56:55.994062878 +0000 UTC m=+6.338680901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7k9m" (UniqueName: "kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m") pod "network-check-target-lww45" (UID: "c3a9be39-aa81-4cca-b40e-f9e5f3109621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:56:54.220844 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:54.220757    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:56:54.221252 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:54.220895    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:56:54.221694 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:54.221669    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:54.221808 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:54.221786    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:56:54.225158 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:54.224980    2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:56:54.251994 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:54.251968    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal" event={"ID":"431f7d06e4fc0f9cc0a85823b0930efa","Type":"ContainerStarted","Data":"dfbc3b9e45b1427a364fe3d3182256ea4124d426dbff34ad34959a945cd3a38c"}
May 25 05:56:54.266128 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:54.265263    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-159.ec2.internal" podStartSLOduration=3.265249579 podStartE2EDuration="3.265249579s" podCreationTimestamp="2026-05-25 05:56:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 05:56:53.249648337 +0000 UTC m=+3.594266365" watchObservedRunningTime="2026-05-25 05:56:54.265249579 +0000 UTC m=+4.609867613"
May 25 05:56:55.807516 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:55.807479    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:55.807948 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:55.807699    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:56:55.807948 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:55.807765    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs podName:ceedf6b0-232e-4dcf-a1d2-694317d0046d nodeName:}" failed. No retries permitted until 2026-05-25 05:56:59.807744723 +0000 UTC m=+10.152362742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs") pod "network-metrics-daemon-6kqfz" (UID: "ceedf6b0-232e-4dcf-a1d2-694317d0046d") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:56:56.008658 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:56.008527    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:56:56.008840 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:56.008734    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:56:56.008840 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:56.008759    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:56:56.008840 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:56.008773    2572 projected.go:194] Error preparing data for projected volume kube-api-access-v7k9m for pod openshift-network-diagnostics/network-check-target-lww45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:56:56.008840 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:56.008832    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m podName:c3a9be39-aa81-4cca-b40e-f9e5f3109621 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:00.00881301 +0000 UTC m=+10.353431023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7k9m" (UniqueName: "kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m") pod "network-check-target-lww45" (UID: "c3a9be39-aa81-4cca-b40e-f9e5f3109621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:56:56.218723 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:56.218231    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:56.218723 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:56.218378    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:56:56.218938 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:56.218885    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:56:56.219032 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:56.218990    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:56:58.218292 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:58.218257    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:58.218735 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:58.218302    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:56:58.218735 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:58.218403    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:56:58.218735 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:58.218613    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:56:59.839459 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:56:59.839419    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:56:59.839945 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:59.839584    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:56:59.839945 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:56:59.839678    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs podName:ceedf6b0-232e-4dcf-a1d2-694317d0046d nodeName:}" failed. No retries permitted until 2026-05-25 05:57:07.839658096 +0000 UTC m=+18.184276127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs") pod "network-metrics-daemon-6kqfz" (UID: "ceedf6b0-232e-4dcf-a1d2-694317d0046d") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:00.040967 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:00.040934    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:00.041157 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:00.041098    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:00.041157 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:00.041117    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:00.041157 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:00.041130    2572 projected.go:194] Error preparing data for projected volume kube-api-access-v7k9m for pod openshift-network-diagnostics/network-check-target-lww45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:00.041313 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:00.041187    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m podName:c3a9be39-aa81-4cca-b40e-f9e5f3109621 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:08.041169202 +0000 UTC m=+18.385787234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7k9m" (UniqueName: "kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m") pod "network-check-target-lww45" (UID: "c3a9be39-aa81-4cca-b40e-f9e5f3109621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:00.220582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:00.219360    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:00.220582 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:00.219455    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:00.220582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:00.219800    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:00.220582 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:00.219886    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:02.218112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:02.218076    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:02.218654 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:02.218079    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:02.218654 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:02.218187    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:02.218654 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:02.218266    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:04.218423 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:04.218390    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:04.218423 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:04.218406    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:04.218969 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:04.218500    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:04.218969 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:04.218667    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:06.218322 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:06.218294    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:06.218714 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:06.218295    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:06.218714 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:06.218426    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:06.218714 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:06.218468    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:07.903423 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:07.903386    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:07.903883 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:07.903536    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:07.903883 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:07.903634    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs podName:ceedf6b0-232e-4dcf-a1d2-694317d0046d nodeName:}" failed. No retries permitted until 2026-05-25 05:57:23.903615881 +0000 UTC m=+34.248233902 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs") pod "network-metrics-daemon-6kqfz" (UID: "ceedf6b0-232e-4dcf-a1d2-694317d0046d") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:08.104472 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:08.104430    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:08.107087 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:08.104996    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:08.107087 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:08.105036    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:08.107087 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:08.105051    2572 projected.go:194] Error preparing data for projected volume kube-api-access-v7k9m for pod openshift-network-diagnostics/network-check-target-lww45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:08.107087 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:08.105120    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m podName:c3a9be39-aa81-4cca-b40e-f9e5f3109621 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:24.105100572 +0000 UTC m=+34.449718600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7k9m" (UniqueName: "kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m") pod "network-check-target-lww45" (UID: "c3a9be39-aa81-4cca-b40e-f9e5f3109621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:08.218523 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:08.218456    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:08.218692 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:08.218577    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:08.218692 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:08.218640    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:08.218806 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:08.218742    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:10.218856 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:10.218816    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:10.219208 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:10.218926    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:10.219208 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:10.218980    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:10.219208 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:10.219080    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:11.281824 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.281447    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t9pjk" event={"ID":"ae815701-2282-487d-b46f-85aad7c1c417","Type":"ContainerStarted","Data":"d5e85f75a294d3ea8c5fea978c8baaf3b0b6da36d50a2c81f496f36e7976ffde"}
May 25 05:57:11.282893 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.282870    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx" event={"ID":"366f4627-67e1-4237-bc30-b698c5877dc3","Type":"ContainerStarted","Data":"a05cce913a02e031a918af9eaead58894aff39067134ac3ba8add5320b87d278"}
May 25 05:57:11.284146 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.284123    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r8w6d" event={"ID":"24ac1167-5fd9-41e0-a10b-87e22e730e96","Type":"ContainerStarted","Data":"32ca72358c78bc11523ac5850849f4dbfed5f646ad86cd5c782a797cfd066e89"}
May 25 05:57:11.285453 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.285428    2572 generic.go:358] "Generic (PLEG): container finished" podID="0624b917-1ca2-43da-b340-c5fb6e3d3d82" containerID="70617a7e76d0340cbb0a638b6fa96d8cdea6d688da845a5d5493510740bedf6f" exitCode=0
May 25 05:57:11.285544 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.285506    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g5mr" event={"ID":"0624b917-1ca2-43da-b340-c5fb6e3d3d82","Type":"ContainerDied","Data":"70617a7e76d0340cbb0a638b6fa96d8cdea6d688da845a5d5493510740bedf6f"}
May 25 05:57:11.286834 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.286780    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p9qzc" event={"ID":"f38391ef-3d66-4962-b86b-b85a021d2ed3","Type":"ContainerStarted","Data":"9cf0e15b2b0daa67e99b4d0dc339975beef3dde796f80e7961b841d533cfbbc9"}
May 25 05:57:11.289451 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.289430    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" event={"ID":"476dac2d-0fea-4248-a958-02680c3762d8","Type":"ContainerStarted","Data":"a68a6bc145099c72927e4f720ba468efa594c27e4b720c7128cd3a58d0c97705"}
May 25 05:57:11.289547 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.289460    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" event={"ID":"476dac2d-0fea-4248-a958-02680c3762d8","Type":"ContainerStarted","Data":"1d6dae4972cdef08cfb8e28a25e20e3e6d8c772c8c5b74ca910fb9977ae9b750"}
May 25 05:57:11.289547 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.289471    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" event={"ID":"476dac2d-0fea-4248-a958-02680c3762d8","Type":"ContainerStarted","Data":"bab09931a6fc43759e69f422c5e9ac16aa0a6e14f6d5c2f3ba5ee7c5f29a235c"}
May 25 05:57:11.289547 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.289479    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" event={"ID":"476dac2d-0fea-4248-a958-02680c3762d8","Type":"ContainerStarted","Data":"3b2e0eb63848d8230f83ec66f3a2f5ac558b1dca5093ee29a3c486bd90e8576e"}
May 25 05:57:11.289547 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.289488    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" event={"ID":"476dac2d-0fea-4248-a958-02680c3762d8","Type":"ContainerStarted","Data":"4da6ba40d3d2adac7fd55f25fd98c9708ac1fce5b4417a69aad345b366bb3c8a"}
May 25 05:57:11.289547 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.289495    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" event={"ID":"476dac2d-0fea-4248-a958-02680c3762d8","Type":"ContainerStarted","Data":"9538bb14b1665bf25eab4424d0e7dd602345a1038ba63cc0bfc02d9a9a6de6be"}
May 25 05:57:11.290671 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.290641    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gbp5" event={"ID":"718854ed-6ec3-4f1e-9349-6196422a2995","Type":"ContainerStarted","Data":"8dfe340777786f110ce8c39a1fb67a743861b705f71cf9a759ae2c8b5d82d7db"}
May 25 05:57:11.291898 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.291878    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-472vs" event={"ID":"c5ff7734-4e0b-417c-a06f-1a9ea55333c9","Type":"ContainerStarted","Data":"2f037cd1b739b0845b334199a7e1cdaf9b7cb1bce88b2f0e7d8e031fe9ba3092"}
May 25 05:57:11.302825 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.302791    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-159.ec2.internal" podStartSLOduration=20.302780234 podStartE2EDuration="20.302780234s" podCreationTimestamp="2026-05-25 05:56:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 05:56:54.266116336 +0000 UTC m=+4.610734368" watchObservedRunningTime="2026-05-25 05:57:11.302780234 +0000 UTC m=+21.647398263"
May 25 05:57:11.325001 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.324943    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t9pjk" podStartSLOduration=3.640520502 podStartE2EDuration="21.324930791s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:56:52.893511504 +0000 UTC m=+3.238129514" lastFinishedPulling="2026-05-25 05:57:10.577921781 +0000 UTC m=+20.922539803" observedRunningTime="2026-05-25 05:57:11.302899841 +0000 UTC m=+21.647517853" watchObservedRunningTime="2026-05-25 05:57:11.324930791 +0000 UTC m=+21.669548821"
May 25 05:57:11.384328 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.384289    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5gbp5" podStartSLOduration=3.699368587 podStartE2EDuration="21.38427722s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:56:52.892909086 +0000 UTC m=+3.237527097" lastFinishedPulling="2026-05-25 05:57:10.577817713 +0000 UTC m=+20.922435730" observedRunningTime="2026-05-25 05:57:11.325388723 +0000 UTC m=+21.670006752" watchObservedRunningTime="2026-05-25 05:57:11.38427722 +0000 UTC m=+21.728895250"
May 25 05:57:11.407058 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.407025    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p9qzc" podStartSLOduration=8.257877684 podStartE2EDuration="21.407014934s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:56:52.899332413 +0000 UTC m=+3.243950422" lastFinishedPulling="2026-05-25 05:57:06.048469661 +0000 UTC m=+16.393087672" observedRunningTime="2026-05-25 05:57:11.406691661 +0000 UTC m=+21.751309688" watchObservedRunningTime="2026-05-25 05:57:11.407014934 +0000 UTC m=+21.751632964"
May 25 05:57:11.493361 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.493323    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-472vs" podStartSLOduration=4.086504919 podStartE2EDuration="21.493313035s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:56:52.888743753 +0000 UTC m=+3.233361762" lastFinishedPulling="2026-05-25 05:57:10.295551855 +0000 UTC m=+20.640169878" observedRunningTime="2026-05-25 05:57:11.441976093 +0000 UTC m=+21.786594125" watchObservedRunningTime="2026-05-25 05:57:11.493313035 +0000 UTC m=+21.837931065"
May 25 05:57:11.974704 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:11.974656    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 05:57:12.218420 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:12.218339    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:12.218576 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:12.218339    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:12.218576 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:12.218440    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:12.218576 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:12.218517    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:12.233386 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:12.233298    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T05:57:11.974676141Z","UUID":"606851a5-6688-4350-8c84-60fc2f6c7dea","Handler":null,"Name":"","Endpoint":""}
May 25 05:57:12.237068 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:12.237048    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 05:57:12.237202 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:12.237076    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 05:57:12.295279 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:12.295242    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tlmnl" event={"ID":"3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c","Type":"ContainerStarted","Data":"65b87d44c2ff65622b3128e9e3e7b85b87b4b0f324a7485f5b0be27d79375cda"}
May 25 05:57:12.296995 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:12.296970    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx" event={"ID":"366f4627-67e1-4237-bc30-b698c5877dc3","Type":"ContainerStarted","Data":"37f234d57cd84687edd75bf9b1103de73aa12223513e1f64186de2dc24fc32d4"}
May 25 05:57:12.351506 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:12.351455    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-r8w6d" podStartSLOduration=4.625421802 podStartE2EDuration="22.351434135s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:56:52.894346777 +0000 UTC m=+3.238964799" lastFinishedPulling="2026-05-25 05:57:10.620359114 +0000 UTC m=+20.964977132" observedRunningTime="2026-05-25 05:57:11.496342568 +0000 UTC m=+21.840960599" watchObservedRunningTime="2026-05-25 05:57:12.351434135 +0000 UTC m=+22.696052168"
May 25 05:57:13.305154 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:13.305127    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx" event={"ID":"366f4627-67e1-4237-bc30-b698c5877dc3","Type":"ContainerStarted","Data":"702a33feee0da2ad0f92c573710e34d32faea63af06fc516cc0ddca0a3a0ffaf"}
May 25 05:57:13.341347 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:13.341301    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tlmnl" podStartSLOduration=5.675371296 podStartE2EDuration="23.341286985s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:56:52.896153718 +0000 UTC m=+3.240771737" lastFinishedPulling="2026-05-25 05:57:10.562069401 +0000 UTC m=+20.906687426" observedRunningTime="2026-05-25 05:57:12.351761359 +0000 UTC m=+22.696379389" watchObservedRunningTime="2026-05-25 05:57:13.341286985 +0000 UTC m=+23.685905014"
May 25 05:57:14.218025 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:14.217805    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:14.218182 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:14.217846    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:14.218182 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:14.218117    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:14.218275 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:14.218206    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:14.309669 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:14.309641    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" event={"ID":"476dac2d-0fea-4248-a958-02680c3762d8","Type":"ContainerStarted","Data":"4f3b4e309345adfb16f451c35b01115e826299fd36cb3936271f61967fa228a8"}
May 25 05:57:15.922031 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:15.922008    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:57:15.922717 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:15.922490    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:57:15.930190 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:15.930132    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:57:15.930503 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:15.930484    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p9qzc"
May 25 05:57:15.972913 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:15.972876    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2n4lx" podStartSLOduration=5.929617407 podStartE2EDuration="25.972864417s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:56:52.895906885 +0000 UTC m=+3.240524892" lastFinishedPulling="2026-05-25 05:57:12.939153887 +0000 UTC m=+23.283771902" observedRunningTime="2026-05-25 05:57:13.342430578 +0000 UTC m=+23.687048632" watchObservedRunningTime="2026-05-25 05:57:15.972864417 +0000 UTC m=+26.317482466"
May 25 05:57:16.057259 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.057047    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rtffd"]
May 25 05:57:16.071884 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.071854    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.072039 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:16.071922    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtffd" podUID="56a91a44-62d5-43ef-9fcc-1a177da17245"
May 25 05:57:16.170578 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.170550    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/56a91a44-62d5-43ef-9fcc-1a177da17245-dbus\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.170689 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.170583    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/56a91a44-62d5-43ef-9fcc-1a177da17245-kubelet-config\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.170689 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.170655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.217863 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.217838    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:16.217946 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.217846    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:16.217946 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:16.217935    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:16.218063 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:16.218005    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:16.271635 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.271568    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/56a91a44-62d5-43ef-9fcc-1a177da17245-dbus\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.271721 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.271641    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/56a91a44-62d5-43ef-9fcc-1a177da17245-kubelet-config\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.271721 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.271678    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.271828 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.271759    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/56a91a44-62d5-43ef-9fcc-1a177da17245-kubelet-config\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.271828 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.271781    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/56a91a44-62d5-43ef-9fcc-1a177da17245-dbus\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.271828 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:16.271806    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:16.271970 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:16.271863    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret podName:56a91a44-62d5-43ef-9fcc-1a177da17245 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:16.771846247 +0000 UTC m=+27.116464256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret") pod "global-pull-secret-syncer-rtffd" (UID: "56a91a44-62d5-43ef-9fcc-1a177da17245") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:16.314324 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.314279    2572 generic.go:358] "Generic (PLEG): container finished" podID="0624b917-1ca2-43da-b340-c5fb6e3d3d82" containerID="84eff7606fc321e2c9fcd1adf357171f0e3fac75677d12e652eca50154bf2cbc" exitCode=0
May 25 05:57:16.314402 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.314346    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g5mr" event={"ID":"0624b917-1ca2-43da-b340-c5fb6e3d3d82","Type":"ContainerDied","Data":"84eff7606fc321e2c9fcd1adf357171f0e3fac75677d12e652eca50154bf2cbc"}
May 25 05:57:16.317624 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.317604    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" event={"ID":"476dac2d-0fea-4248-a958-02680c3762d8","Type":"ContainerStarted","Data":"04113723b97b7cbab0db3ad7bc5d5ff74600a37931e31218010584c4ea8987ff"}
May 25 05:57:16.317859 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.317840    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:57:16.317925 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.317868    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:57:16.332191 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.332175    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:57:16.388930 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.388893    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb" podStartSLOduration=8.631575674 podStartE2EDuration="26.38888275s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:56:52.897195802 +0000 UTC m=+3.241813822" lastFinishedPulling="2026-05-25 05:57:10.654502875 +0000 UTC m=+20.999120898" observedRunningTime="2026-05-25 05:57:16.388446397 +0000 UTC m=+26.733064429" watchObservedRunningTime="2026-05-25 05:57:16.38888275 +0000 UTC m=+26.733500780"
May 25 05:57:16.775558 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:16.775495    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:16.775685 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:16.775633    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:16.775722 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:16.775688    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret podName:56a91a44-62d5-43ef-9fcc-1a177da17245 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:17.775670123 +0000 UTC m=+28.120288148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret") pod "global-pull-secret-syncer-rtffd" (UID: "56a91a44-62d5-43ef-9fcc-1a177da17245") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:17.217772 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.217705    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:17.218896 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:17.217807    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtffd" podUID="56a91a44-62d5-43ef-9fcc-1a177da17245"
May 25 05:57:17.320439 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.320409    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:57:17.333932 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.333911    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:57:17.778499 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.778472    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lww45"]
May 25 05:57:17.778655 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.778620    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:17.778748 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:17.778725    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:17.782097 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.782053    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rtffd"]
May 25 05:57:17.782192 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.782169    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:17.782280 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:17.782262    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtffd" podUID="56a91a44-62d5-43ef-9fcc-1a177da17245"
May 25 05:57:17.782745 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.782717    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6kqfz"]
May 25 05:57:17.782981 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.782950    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:17.783072 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:17.783010    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:17.783143 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:17.783096    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:17.783192 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:17.783159    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:17.783238 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:17.783228    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret podName:56a91a44-62d5-43ef-9fcc-1a177da17245 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:19.783205828 +0000 UTC m=+30.127823853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret") pod "global-pull-secret-syncer-rtffd" (UID: "56a91a44-62d5-43ef-9fcc-1a177da17245") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:18.323606 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:18.323564    2572 generic.go:358] "Generic (PLEG): container finished" podID="0624b917-1ca2-43da-b340-c5fb6e3d3d82" containerID="d9fc77974cee55fa91c8e8e1f686da9cf00fb6c2af0b9e8d0cdb1817f409144c" exitCode=0
May 25 05:57:18.324016 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:18.323659    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g5mr" event={"ID":"0624b917-1ca2-43da-b340-c5fb6e3d3d82","Type":"ContainerDied","Data":"d9fc77974cee55fa91c8e8e1f686da9cf00fb6c2af0b9e8d0cdb1817f409144c"}
May 25 05:57:19.217733 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:19.217706    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:19.217876 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:19.217716    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:19.217917 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:19.217716    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:19.217917 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:19.217885    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:19.218011 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:19.217797    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtffd" podUID="56a91a44-62d5-43ef-9fcc-1a177da17245"
May 25 05:57:19.218011 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:19.217946    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:19.798418 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:19.798394    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:19.798700 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:19.798490    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:19.798700 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:19.798538    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret podName:56a91a44-62d5-43ef-9fcc-1a177da17245 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:23.798523908 +0000 UTC m=+34.143141931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret") pod "global-pull-secret-syncer-rtffd" (UID: "56a91a44-62d5-43ef-9fcc-1a177da17245") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:20.328371 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:20.328340    2572 generic.go:358] "Generic (PLEG): container finished" podID="0624b917-1ca2-43da-b340-c5fb6e3d3d82" containerID="332587ddd6d9065175ac13c39dc9deb847b1b0e6fb7f3bc2414c1672029dad93" exitCode=0
May 25 05:57:20.328371 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:20.328375    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g5mr" event={"ID":"0624b917-1ca2-43da-b340-c5fb6e3d3d82","Type":"ContainerDied","Data":"332587ddd6d9065175ac13c39dc9deb847b1b0e6fb7f3bc2414c1672029dad93"}
May 25 05:57:21.217942 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:21.217772    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:21.218347 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:21.217784    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:21.218347 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:21.218009    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:21.218347 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:21.217784    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:21.218347 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:21.218102    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtffd" podUID="56a91a44-62d5-43ef-9fcc-1a177da17245"
May 25 05:57:21.218347 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:21.218168    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:23.217742 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.217671    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:23.217742 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.217707    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:23.218373 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.217798    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:23.218373 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.217797    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lww45" podUID="c3a9be39-aa81-4cca-b40e-f9e5f3109621"
May 25 05:57:23.218373 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.217939    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:57:23.218373 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.218011    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rtffd" podUID="56a91a44-62d5-43ef-9fcc-1a177da17245"
May 25 05:57:23.431420 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.431395    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-159.ec2.internal" event="NodeReady"
May 25 05:57:23.431582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.431525    2572 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 05:57:23.469493 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.469422    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cb4567dff-cdxp2"]
May 25 05:57:23.490241 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.490213    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cb4567dff-cdxp2"]
May 25 05:57:23.490241 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.490246    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hhv67"]
May 25 05:57:23.490960 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.490936    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.493948 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.493917    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 25 05:57:23.493948 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.493933    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 25 05:57:23.494144 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.494012    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 25 05:57:23.494144 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.494083    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rkkwr\""
May 25 05:57:23.500812 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.500557    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 25 05:57:23.506943 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.506921    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hhv67"]
May 25 05:57:23.507062 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.507025    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.509538 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.509518    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 05:57:23.509715 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.509688    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjmkj\""
May 25 05:57:23.509833 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.509732    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 05:57:23.580690 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.580662    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cjpxj"]
May 25 05:57:23.608741 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.608718    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cjpxj"]
May 25 05:57:23.608880 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.608839    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:23.611708 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.611686    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 05:57:23.611832 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.611734    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 05:57:23.611832 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.611734    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g6njt\""
May 25 05:57:23.611832 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.611781    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 05:57:23.628313 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628291    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.628313 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628315    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-tmp-dir\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.628475 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628354    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-installation-pull-secrets\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.628475 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628426    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-config-volume\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.628475 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sls6\" (UniqueName: \"kubernetes.io/projected/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-kube-api-access-8sls6\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.628647 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628491    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.628647 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-ca-trust-extracted\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.628647 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-bound-sa-token\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.628647 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628568    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-image-registry-private-configuration\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.628647 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-trusted-ca\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.628896 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628653    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-certificates\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.628896 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.628670    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d57p\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-kube-api-access-9d57p\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.729793 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.729733    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-trusted-ca\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.729898 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.729784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtngn\" (UniqueName: \"kubernetes.io/projected/5abec160-d16c-4c2c-9d6c-6422f7830854-kube-api-access-jtngn\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:23.729898 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.729842    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-certificates\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.729898 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.729875    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9d57p\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-kube-api-access-9d57p\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.730053 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.729933    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.730053 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.729960    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-tmp-dir\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.730053 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730008    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-installation-pull-secrets\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.730185 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730053    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-config-volume\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.730185 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.730071    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:23.730185 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730083    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sls6\" (UniqueName: \"kubernetes.io/projected/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-kube-api-access-8sls6\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.730185 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730117    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.730185 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.730137    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls podName:516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff nodeName:}" failed. No retries permitted until 2026-05-25 05:57:24.230118402 +0000 UTC m=+34.574736430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls") pod "dns-default-hhv67" (UID: "516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff") : secret "dns-default-metrics-tls" not found
May 25 05:57:23.730185 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730164    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-ca-trust-extracted\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.730416 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.730190    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:23.730416 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.730202    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb4567dff-cdxp2: secret "image-registry-tls" not found
May 25 05:57:23.730416 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.730245    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls podName:8f5893ab-0a8b-45e4-9d23-52e3e8d172a1 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:24.230232857 +0000 UTC m=+34.574850880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls") pod "image-registry-cb4567dff-cdxp2" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1") : secret "image-registry-tls" not found
May 25 05:57:23.730416 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730190    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-bound-sa-token\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.730416 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730271    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:23.730416 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730316    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-image-registry-private-configuration\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.730416 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730401    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-tmp-dir\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.731070 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730860    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-trusted-ca\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.731070 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.730921    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-ca-trust-extracted\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.731201 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.731157    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-certificates\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.731268 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.731217    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-config-volume\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.734920 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.734897    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-installation-pull-secrets\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.735007 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.734898    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-image-registry-private-configuration\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.738876 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.738828    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sls6\" (UniqueName: \"kubernetes.io/projected/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-kube-api-access-8sls6\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:23.739225 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.739203    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-bound-sa-token\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.739433 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.739417    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d57p\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-kube-api-access-9d57p\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:23.830785 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.830758    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:23.830901 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.830831    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:23.830901 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.830889    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtngn\" (UniqueName: \"kubernetes.io/projected/5abec160-d16c-4c2c-9d6c-6422f7830854-kube-api-access-jtngn\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:23.831007 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.830906    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:23.831007 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.830979    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:23.831108 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.830982    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret podName:56a91a44-62d5-43ef-9fcc-1a177da17245 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:31.830962997 +0000 UTC m=+42.175581021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret") pod "global-pull-secret-syncer-rtffd" (UID: "56a91a44-62d5-43ef-9fcc-1a177da17245") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:23.831108 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.831046    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert podName:5abec160-d16c-4c2c-9d6c-6422f7830854 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:24.331029843 +0000 UTC m=+34.675647855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert") pod "ingress-canary-cjpxj" (UID: "5abec160-d16c-4c2c-9d6c-6422f7830854") : secret "canary-serving-cert" not found
May 25 05:57:23.839637 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.839620    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtngn\" (UniqueName: \"kubernetes.io/projected/5abec160-d16c-4c2c-9d6c-6422f7830854-kube-api-access-jtngn\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:23.931376 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:23.931353    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:23.931524 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.931505    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:23.931621 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:23.931602    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs podName:ceedf6b0-232e-4dcf-a1d2-694317d0046d nodeName:}" failed. No retries permitted until 2026-05-25 05:57:55.931567711 +0000 UTC m=+66.276185722 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs") pod "network-metrics-daemon-6kqfz" (UID: "ceedf6b0-232e-4dcf-a1d2-694317d0046d") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:24.132657 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:24.132626    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:24.132826 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.132807    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:24.132870 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.132833    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:24.132870 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.132848    2572 projected.go:194] Error preparing data for projected volume kube-api-access-v7k9m for pod openshift-network-diagnostics/network-check-target-lww45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:24.132968 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.132908    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m podName:c3a9be39-aa81-4cca-b40e-f9e5f3109621 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:56.132890682 +0000 UTC m=+66.477508696 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7k9m" (UniqueName: "kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m") pod "network-check-target-lww45" (UID: "c3a9be39-aa81-4cca-b40e-f9e5f3109621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:24.233080 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:24.233053    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:24.233670 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:24.233136    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:24.233670 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.233166    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:24.233670 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.233234    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls podName:516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff nodeName:}" failed. No retries permitted until 2026-05-25 05:57:25.233214388 +0000 UTC m=+35.577832399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls") pod "dns-default-hhv67" (UID: "516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff") : secret "dns-default-metrics-tls" not found
May 25 05:57:24.233670 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.233242    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:24.233670 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.233253    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb4567dff-cdxp2: secret "image-registry-tls" not found
May 25 05:57:24.233670 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.233291    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls podName:8f5893ab-0a8b-45e4-9d23-52e3e8d172a1 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:25.233277443 +0000 UTC m=+35.577895467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls") pod "image-registry-cb4567dff-cdxp2" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1") : secret "image-registry-tls" not found
May 25 05:57:24.333558 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:24.333527    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:24.333730 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.333710    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:24.333808 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:24.333779    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert podName:5abec160-d16c-4c2c-9d6c-6422f7830854 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:25.333764422 +0000 UTC m=+35.678382446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert") pod "ingress-canary-cjpxj" (UID: "5abec160-d16c-4c2c-9d6c-6422f7830854") : secret "canary-serving-cert" not found
May 25 05:57:25.218167 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.218128    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:25.218339 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.218128    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:25.218635 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.218130    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:25.222443 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.222419    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 05:57:25.222443 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.222435    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 05:57:25.222661 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.222481    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kfc7\""
May 25 05:57:25.222661 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.222501    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t5pvm\""
May 25 05:57:25.222816 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.222794    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 05:57:25.222916 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.222891    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 05:57:25.239744 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.239720    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:25.240068 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:25.239815    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:25.240068 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:25.239830    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb4567dff-cdxp2: secret "image-registry-tls" not found
May 25 05:57:25.240068 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.239829    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:25.240068 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:25.239911    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls podName:8f5893ab-0a8b-45e4-9d23-52e3e8d172a1 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:27.239891463 +0000 UTC m=+37.584509478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls") pod "image-registry-cb4567dff-cdxp2" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1") : secret "image-registry-tls" not found
May 25 05:57:25.240068 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:25.239976    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:25.240068 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:25.240039    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls podName:516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff nodeName:}" failed. No retries permitted until 2026-05-25 05:57:27.240021339 +0000 UTC m=+37.584639359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls") pod "dns-default-hhv67" (UID: "516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff") : secret "dns-default-metrics-tls" not found
May 25 05:57:25.341179 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:25.341146    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:25.341387 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:25.341307    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:25.341387 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:25.341370    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert podName:5abec160-d16c-4c2c-9d6c-6422f7830854 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:27.341352079 +0000 UTC m=+37.685970088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert") pod "ingress-canary-cjpxj" (UID: "5abec160-d16c-4c2c-9d6c-6422f7830854") : secret "canary-serving-cert" not found
May 25 05:57:27.255489 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:27.255462    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:27.255954 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:27.255531    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:27.255954 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:27.255630    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:27.255954 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:27.255660    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:27.255954 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:27.255676    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb4567dff-cdxp2: secret "image-registry-tls" not found
May 25 05:57:27.255954 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:27.255687    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls podName:516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff nodeName:}" failed. No retries permitted until 2026-05-25 05:57:31.255669627 +0000 UTC m=+41.600287644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls") pod "dns-default-hhv67" (UID: "516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff") : secret "dns-default-metrics-tls" not found
May 25 05:57:27.255954 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:27.255718    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls podName:8f5893ab-0a8b-45e4-9d23-52e3e8d172a1 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:31.25570435 +0000 UTC m=+41.600322358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls") pod "image-registry-cb4567dff-cdxp2" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1") : secret "image-registry-tls" not found
May 25 05:57:27.343001 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:27.342977    2572 generic.go:358] "Generic (PLEG): container finished" podID="0624b917-1ca2-43da-b340-c5fb6e3d3d82" containerID="d08bcd931d720b074c5dd5f55856a7f0d8ba652d1da0df7c6bdb59e2e25e0a5e" exitCode=0
May 25 05:57:27.343114 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:27.343033    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g5mr" event={"ID":"0624b917-1ca2-43da-b340-c5fb6e3d3d82","Type":"ContainerDied","Data":"d08bcd931d720b074c5dd5f55856a7f0d8ba652d1da0df7c6bdb59e2e25e0a5e"}
May 25 05:57:27.356073 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:27.356054    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:27.356172 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:27.356161    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:27.356211 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:27.356207    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert podName:5abec160-d16c-4c2c-9d6c-6422f7830854 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:31.35619489 +0000 UTC m=+41.700812898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert") pod "ingress-canary-cjpxj" (UID: "5abec160-d16c-4c2c-9d6c-6422f7830854") : secret "canary-serving-cert" not found
May 25 05:57:28.346721 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:28.346686    2572 generic.go:358] "Generic (PLEG): container finished" podID="0624b917-1ca2-43da-b340-c5fb6e3d3d82" containerID="0d00a13b933eb08d8e66f17c6d1d3d4a6239ebc09a9d3545ff14061ac3fcda27" exitCode=0
May 25 05:57:28.347045 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:28.346740    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g5mr" event={"ID":"0624b917-1ca2-43da-b340-c5fb6e3d3d82","Type":"ContainerDied","Data":"0d00a13b933eb08d8e66f17c6d1d3d4a6239ebc09a9d3545ff14061ac3fcda27"}
May 25 05:57:29.351396 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:29.351357    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5g5mr" event={"ID":"0624b917-1ca2-43da-b340-c5fb6e3d3d82","Type":"ContainerStarted","Data":"eca86508a6c92ec5d8b89319f31ba445fc58f1ed58bf4b65ab3dde5f50fc94cd"}
May 25 05:57:29.379444 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:29.379401    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5g5mr" podStartSLOduration=5.531155064 podStartE2EDuration="39.37938882s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:56:52.89006995 +0000 UTC m=+3.234687957" lastFinishedPulling="2026-05-25 05:57:26.738303705 +0000 UTC m=+37.082921713" observedRunningTime="2026-05-25 05:57:29.378134569 +0000 UTC m=+39.722752611" watchObservedRunningTime="2026-05-25 05:57:29.37938882 +0000 UTC m=+39.724006849"
May 25 05:57:31.282580 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:31.282521    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:31.283050 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:31.282657    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:31.283050 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:31.282688    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:31.283050 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:31.282762    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls podName:516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff nodeName:}" failed. No retries permitted until 2026-05-25 05:57:39.282746198 +0000 UTC m=+49.627364225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls") pod "dns-default-hhv67" (UID: "516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff") : secret "dns-default-metrics-tls" not found
May 25 05:57:31.283050 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:31.282795    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:31.283050 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:31.282810    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb4567dff-cdxp2: secret "image-registry-tls" not found
May 25 05:57:31.283050 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:31.282864    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls podName:8f5893ab-0a8b-45e4-9d23-52e3e8d172a1 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:39.282848411 +0000 UTC m=+49.627466425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls") pod "image-registry-cb4567dff-cdxp2" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1") : secret "image-registry-tls" not found
May 25 05:57:31.383666 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:31.383635    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:31.383841 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:31.383789    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:31.383910 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:31.383859    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert podName:5abec160-d16c-4c2c-9d6c-6422f7830854 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:39.383837096 +0000 UTC m=+49.728455137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert") pod "ingress-canary-cjpxj" (UID: "5abec160-d16c-4c2c-9d6c-6422f7830854") : secret "canary-serving-cert" not found
May 25 05:57:31.887645 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:31.887613    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:31.890549 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:31.890528    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56a91a44-62d5-43ef-9fcc-1a177da17245-original-pull-secret\") pod \"global-pull-secret-syncer-rtffd\" (UID: \"56a91a44-62d5-43ef-9fcc-1a177da17245\") " pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:32.136720 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:32.136688    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rtffd"
May 25 05:57:32.282263 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:32.282233    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rtffd"]
May 25 05:57:32.285307 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:57:32.285277    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a91a44_62d5_43ef_9fcc_1a177da17245.slice/crio-25f107c052103777212f074fe6fc37db72f326b3939de90a40517a25cd0833ef WatchSource:0}: Error finding container 25f107c052103777212f074fe6fc37db72f326b3939de90a40517a25cd0833ef: Status 404 returned error can't find the container with id 25f107c052103777212f074fe6fc37db72f326b3939de90a40517a25cd0833ef
May 25 05:57:32.357575 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:32.357540    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rtffd" event={"ID":"56a91a44-62d5-43ef-9fcc-1a177da17245","Type":"ContainerStarted","Data":"25f107c052103777212f074fe6fc37db72f326b3939de90a40517a25cd0833ef"}
May 25 05:57:36.366517 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:36.366441    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rtffd" event={"ID":"56a91a44-62d5-43ef-9fcc-1a177da17245","Type":"ContainerStarted","Data":"5105bc5a8f343501e936321c015df049f54fdb38a93f0c3d80e5dc815b3973ea"}
May 25 05:57:36.397056 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:36.397013    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rtffd" podStartSLOduration=16.62194472 podStartE2EDuration="20.396998854s" podCreationTimestamp="2026-05-25 05:57:16 +0000 UTC" firstStartedPulling="2026-05-25 05:57:32.28740304 +0000 UTC m=+42.632021049" lastFinishedPulling="2026-05-25 05:57:36.062457176 +0000 UTC m=+46.407075183" observedRunningTime="2026-05-25 05:57:36.396822023 +0000 UTC m=+46.741440054" watchObservedRunningTime="2026-05-25 05:57:36.396998854 +0000 UTC m=+46.741616913"
May 25 05:57:39.341297 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:39.341254    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:39.341760 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:39.341329    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:39.341760 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:39.341387    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:39.341760 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:39.341405    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb4567dff-cdxp2: secret "image-registry-tls" not found
May 25 05:57:39.341760 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:39.341410    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:39.341760 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:39.341460    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls podName:516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff nodeName:}" failed. No retries permitted until 2026-05-25 05:57:55.341445588 +0000 UTC m=+65.686063596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls") pod "dns-default-hhv67" (UID: "516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff") : secret "dns-default-metrics-tls" not found
May 25 05:57:39.341760 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:39.341474    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls podName:8f5893ab-0a8b-45e4-9d23-52e3e8d172a1 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:55.341467761 +0000 UTC m=+65.686085815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls") pod "image-registry-cb4567dff-cdxp2" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1") : secret "image-registry-tls" not found
May 25 05:57:39.441848 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:39.441823    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:39.441973 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:39.441921    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:39.441973 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:39.441961    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert podName:5abec160-d16c-4c2c-9d6c-6422f7830854 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:55.441949796 +0000 UTC m=+65.786567809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert") pod "ingress-canary-cjpxj" (UID: "5abec160-d16c-4c2c-9d6c-6422f7830854") : secret "canary-serving-cert" not found
May 25 05:57:49.343038 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:49.343009    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjlbb"
May 25 05:57:50.148689 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.148660    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"]
May 25 05:57:50.194325 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.194298    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"]
May 25 05:57:50.194471 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.194450    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.197156 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.197138    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 25 05:57:50.197291 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.197273    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 25 05:57:50.197340 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.197276    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 25 05:57:50.198220 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.198202    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 25 05:57:50.201719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.201701    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"]
May 25 05:57:50.228721 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.228701    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"]
May 25 05:57:50.236228 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.236121    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.239015 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.238998    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 25 05:57:50.239115 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.238998    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 25 05:57:50.239115 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.239051    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 25 05:57:50.239115 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.239010    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 25 05:57:50.328664 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.328643    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.328758 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.328670    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2xdz\" (UniqueName: \"kubernetes.io/projected/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-kube-api-access-k2xdz\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.328758 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.328686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5-tmp\") pod \"klusterlet-addon-workmgr-554676f6d8-9lx7n\" (UID: \"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.328758 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.328706    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5-klusterlet-config\") pod \"klusterlet-addon-workmgr-554676f6d8-9lx7n\" (UID: \"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.328906 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.328767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-ca\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.328906 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.328886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.329011 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.328957    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cptcz\" (UniqueName: \"kubernetes.io/projected/78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5-kube-api-access-cptcz\") pod \"klusterlet-addon-workmgr-554676f6d8-9lx7n\" (UID: \"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.329011 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.329005    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-hub\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.329086 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.329032    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.430248 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430189    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.430248 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430244    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cptcz\" (UniqueName: \"kubernetes.io/projected/78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5-kube-api-access-cptcz\") pod \"klusterlet-addon-workmgr-554676f6d8-9lx7n\" (UID: \"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.430734 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430285    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-hub\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.430734 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430312    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.430734 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430345    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.430734 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430376    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2xdz\" (UniqueName: \"kubernetes.io/projected/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-kube-api-access-k2xdz\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.430734 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430399    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5-tmp\") pod \"klusterlet-addon-workmgr-554676f6d8-9lx7n\" (UID: \"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.430734 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430435    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5-klusterlet-config\") pod \"klusterlet-addon-workmgr-554676f6d8-9lx7n\" (UID: \"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.430734 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430582    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-ca\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.431071 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430793    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5-tmp\") pod \"klusterlet-addon-workmgr-554676f6d8-9lx7n\" (UID: \"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.431071 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.430855    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.432937 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.432915    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-hub\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.433032 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.432952    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.433032 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.432999    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5-klusterlet-config\") pod \"klusterlet-addon-workmgr-554676f6d8-9lx7n\" (UID: \"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.433141 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.433109    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-ca\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.433194 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.433142    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.438292 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.438265    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cptcz\" (UniqueName: \"kubernetes.io/projected/78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5-kube-api-access-cptcz\") pod \"klusterlet-addon-workmgr-554676f6d8-9lx7n\" (UID: \"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.438582 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.438557    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2xdz\" (UniqueName: \"kubernetes.io/projected/43c6a6d5-d05f-4ee8-8c1d-95f3a1316013-kube-api-access-k2xdz\") pod \"cluster-proxy-proxy-agent-66c688f9f8-wks4n\" (UID: \"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.503547 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.503526    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:50.554575 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.554548    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:57:50.624081 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.624053    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"]
May 25 05:57:50.627095 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:57:50.626888    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d6fa0e_dd28_4067_b5c1_f2d72f7c41f5.slice/crio-3f2b6437fb585b619a6c39aa3eebfd3f8a4bf0e294f8d5b896e16fa49e0dc958 WatchSource:0}: Error finding container 3f2b6437fb585b619a6c39aa3eebfd3f8a4bf0e294f8d5b896e16fa49e0dc958: Status 404 returned error can't find the container with id 3f2b6437fb585b619a6c39aa3eebfd3f8a4bf0e294f8d5b896e16fa49e0dc958
May 25 05:57:50.671066 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:50.671043    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"]
May 25 05:57:50.675012 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:57:50.674989    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43c6a6d5_d05f_4ee8_8c1d_95f3a1316013.slice/crio-fdb97abb882964634829500ec1334375bc4319554a5a46b0709d7e343e11899d WatchSource:0}: Error finding container fdb97abb882964634829500ec1334375bc4319554a5a46b0709d7e343e11899d: Status 404 returned error can't find the container with id fdb97abb882964634829500ec1334375bc4319554a5a46b0709d7e343e11899d
May 25 05:57:51.397043 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:51.397003    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" event={"ID":"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013","Type":"ContainerStarted","Data":"fdb97abb882964634829500ec1334375bc4319554a5a46b0709d7e343e11899d"}
May 25 05:57:51.399090 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:51.399053    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n" event={"ID":"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5","Type":"ContainerStarted","Data":"3f2b6437fb585b619a6c39aa3eebfd3f8a4bf0e294f8d5b896e16fa49e0dc958"}
May 25 05:57:55.372187 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:55.372144    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:57:55.372719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:55.372240    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:57:55.372719 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:55.372311    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:55.372719 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:55.372332    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:55.372719 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:55.372345    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb4567dff-cdxp2: secret "image-registry-tls" not found
May 25 05:57:55.372719 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:55.372394    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls podName:516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff nodeName:}" failed. No retries permitted until 2026-05-25 05:58:27.372372424 +0000 UTC m=+97.716990490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls") pod "dns-default-hhv67" (UID: "516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff") : secret "dns-default-metrics-tls" not found
May 25 05:57:55.372719 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:55.372412    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls podName:8f5893ab-0a8b-45e4-9d23-52e3e8d172a1 nodeName:}" failed. No retries permitted until 2026-05-25 05:58:27.372404499 +0000 UTC m=+97.717022507 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls") pod "image-registry-cb4567dff-cdxp2" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1") : secret "image-registry-tls" not found
May 25 05:57:55.473324 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:55.473294    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:57:55.473492 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:55.473465    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:55.473551 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:55.473539    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert podName:5abec160-d16c-4c2c-9d6c-6422f7830854 nodeName:}" failed. No retries permitted until 2026-05-25 05:58:27.473516956 +0000 UTC m=+97.818134967 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert") pod "ingress-canary-cjpxj" (UID: "5abec160-d16c-4c2c-9d6c-6422f7830854") : secret "canary-serving-cert" not found
May 25 05:57:55.978468 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:55.978440    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:57:55.981052 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:55.981034    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 05:57:55.989510 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:55.989489    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 05:57:55.989629 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:57:55.989542    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs podName:ceedf6b0-232e-4dcf-a1d2-694317d0046d nodeName:}" failed. No retries permitted until 2026-05-25 05:58:59.989525918 +0000 UTC m=+130.334143939 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs") pod "network-metrics-daemon-6kqfz" (UID: "ceedf6b0-232e-4dcf-a1d2-694317d0046d") : secret "metrics-daemon-secret" not found
May 25 05:57:56.179813 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.179749    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:56.182346 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.182331    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 05:57:56.192523 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.192503    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 05:57:56.204619 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.204584    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7k9m\" (UniqueName: \"kubernetes.io/projected/c3a9be39-aa81-4cca-b40e-f9e5f3109621-kube-api-access-v7k9m\") pod \"network-check-target-lww45\" (UID: \"c3a9be39-aa81-4cca-b40e-f9e5f3109621\") " pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:56.410496 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.410471    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" event={"ID":"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013","Type":"ContainerStarted","Data":"1ae4695d39f303c78e9e16ddd393c32dcb40168df39bf4950ebc877897985e90"}
May 25 05:57:56.411659 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.411640    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n" event={"ID":"78d6fa0e-dd28-4067-b5c1-f2d72f7c41f5","Type":"ContainerStarted","Data":"68c0c99864c2ce3c721e0328bc4cfea8c156dcc6d588084ad2bef9ad06fa4521"}
May 25 05:57:56.411870 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.411847    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:56.413293 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.413277    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n"
May 25 05:57:56.429696 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.429645    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-554676f6d8-9lx7n" podStartSLOduration=1.217425426 podStartE2EDuration="6.429630284s" podCreationTimestamp="2026-05-25 05:57:50 +0000 UTC" firstStartedPulling="2026-05-25 05:57:50.629670908 +0000 UTC m=+60.974288929" lastFinishedPulling="2026-05-25 05:57:55.841875773 +0000 UTC m=+66.186493787" observedRunningTime="2026-05-25 05:57:56.429606477 +0000 UTC m=+66.774224502" watchObservedRunningTime="2026-05-25 05:57:56.429630284 +0000 UTC m=+66.774248309"
May 25 05:57:56.432215 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.431986    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t5pvm\""
May 25 05:57:56.440136 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.440119    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:57:56.556739 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:56.556555    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lww45"]
May 25 05:57:56.559259 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:57:56.559227    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a9be39_aa81_4cca_b40e_f9e5f3109621.slice/crio-422b70e041825f1589d32feb7213e41f186edf837f341c02c5f87685d95e6996 WatchSource:0}: Error finding container 422b70e041825f1589d32feb7213e41f186edf837f341c02c5f87685d95e6996: Status 404 returned error can't find the container with id 422b70e041825f1589d32feb7213e41f186edf837f341c02c5f87685d95e6996
May 25 05:57:57.415855 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:57.415818    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lww45" event={"ID":"c3a9be39-aa81-4cca-b40e-f9e5f3109621","Type":"ContainerStarted","Data":"422b70e041825f1589d32feb7213e41f186edf837f341c02c5f87685d95e6996"}
May 25 05:57:58.419698 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:58.419658    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" event={"ID":"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013","Type":"ContainerStarted","Data":"fcda3d13403a5803c9045118837353cd4cecc8976eb042c10efb8c348ac2e998"}
May 25 05:57:58.419698 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:58.419707    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" event={"ID":"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013","Type":"ContainerStarted","Data":"90f56de9297205677c947f630c7bbc5e55ceec72c47c54d84529c32a4b5fa233"}
May 25 05:57:58.438864 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:57:58.438825    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" podStartSLOduration=1.184565536 podStartE2EDuration="8.438811968s" podCreationTimestamp="2026-05-25 05:57:50 +0000 UTC" firstStartedPulling="2026-05-25 05:57:50.67681171 +0000 UTC m=+61.021429718" lastFinishedPulling="2026-05-25 05:57:57.931058128 +0000 UTC m=+68.275676150" observedRunningTime="2026-05-25 05:57:58.437773061 +0000 UTC m=+68.782391092" watchObservedRunningTime="2026-05-25 05:57:58.438811968 +0000 UTC m=+68.783429992"
May 25 05:58:00.425271 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:58:00.425165    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lww45" event={"ID":"c3a9be39-aa81-4cca-b40e-f9e5f3109621","Type":"ContainerStarted","Data":"07de92e09a6ef58f6bab50d53551f9328dad7c60b6e8bce881c502eb8eb8e478"}
May 25 05:58:00.425632 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:58:00.425338    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:58:00.441233 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:58:00.441193    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lww45" podStartSLOduration=67.568396267 podStartE2EDuration="1m10.441181896s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 05:57:56.561390389 +0000 UTC m=+66.906008412" lastFinishedPulling="2026-05-25 05:57:59.434176012 +0000 UTC m=+69.778794041" observedRunningTime="2026-05-25 05:58:00.440801221 +0000 UTC m=+70.785419251" watchObservedRunningTime="2026-05-25 05:58:00.441181896 +0000 UTC m=+70.785799925"
May 25 05:58:27.399980 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:58:27.399950    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:58:27.400269 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:58:27.400009    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:58:27.400269 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:58:27.400090    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:58:27.400269 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:58:27.400104    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:58:27.400269 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:58:27.400107    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb4567dff-cdxp2: secret "image-registry-tls" not found
May 25 05:58:27.400269 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:58:27.400169    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls podName:516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff nodeName:}" failed. No retries permitted until 2026-05-25 05:59:31.400151349 +0000 UTC m=+161.744769558 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls") pod "dns-default-hhv67" (UID: "516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff") : secret "dns-default-metrics-tls" not found
May 25 05:58:27.400269 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:58:27.400188    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls podName:8f5893ab-0a8b-45e4-9d23-52e3e8d172a1 nodeName:}" failed. No retries permitted until 2026-05-25 05:59:31.400178511 +0000 UTC m=+161.744796519 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls") pod "image-registry-cb4567dff-cdxp2" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1") : secret "image-registry-tls" not found
May 25 05:58:27.500819 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:58:27.500789    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:58:27.500926 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:58:27.500894    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:58:27.500964 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:58:27.500948    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert podName:5abec160-d16c-4c2c-9d6c-6422f7830854 nodeName:}" failed. No retries permitted until 2026-05-25 05:59:31.500934063 +0000 UTC m=+161.845552075 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert") pod "ingress-canary-cjpxj" (UID: "5abec160-d16c-4c2c-9d6c-6422f7830854") : secret "canary-serving-cert" not found
May 25 05:58:31.429990 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:58:31.429962    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lww45"
May 25 05:58:49.353175 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:58:49.353147    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-472vs_c5ff7734-4e0b-417c-a06f-1a9ea55333c9/dns-node-resolver/0.log"
May 25 05:58:50.553697 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:58:50.553670    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5gbp5_718854ed-6ec3-4f1e-9349-6196422a2995/node-ca/0.log"
May 25 05:59:00.021776 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:00.021734    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:59:00.022218 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:59:00.021874    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 05:59:00.022218 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:59:00.021937    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs podName:ceedf6b0-232e-4dcf-a1d2-694317d0046d nodeName:}" failed. No retries permitted until 2026-05-25 06:01:02.021919723 +0000 UTC m=+252.366537753 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs") pod "network-metrics-daemon-6kqfz" (UID: "ceedf6b0-232e-4dcf-a1d2-694317d0046d") : secret "metrics-daemon-secret" not found
May 25 05:59:19.737889 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.737857    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kdh8k"]
May 25 05:59:19.740943 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.740926    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.745052 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.745026    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 05:59:19.745937 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.745917    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 05:59:19.746090 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.746075    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 05:59:19.746207 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.746192    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w8pjf\""
May 25 05:59:19.746260 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.746210    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 05:59:19.752203 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.752184    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kdh8k"]
May 25 05:59:19.858172 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.858144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxbjh\" (UniqueName: \"kubernetes.io/projected/f24927a7-b290-45ac-b3f1-00bfdc5e0803-kube-api-access-sxbjh\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.858172 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.858175    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f24927a7-b290-45ac-b3f1-00bfdc5e0803-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.858373 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.858215    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f24927a7-b290-45ac-b3f1-00bfdc5e0803-crio-socket\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.858373 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.858300    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f24927a7-b290-45ac-b3f1-00bfdc5e0803-data-volume\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.858373 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.858340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f24927a7-b290-45ac-b3f1-00bfdc5e0803-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.958623 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.958600    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f24927a7-b290-45ac-b3f1-00bfdc5e0803-crio-socket\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.958719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.958645    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f24927a7-b290-45ac-b3f1-00bfdc5e0803-data-volume\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.958719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.958670    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f24927a7-b290-45ac-b3f1-00bfdc5e0803-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.958719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.958698    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f24927a7-b290-45ac-b3f1-00bfdc5e0803-crio-socket\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.958719 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.958703    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbjh\" (UniqueName: \"kubernetes.io/projected/f24927a7-b290-45ac-b3f1-00bfdc5e0803-kube-api-access-sxbjh\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.958909 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.958737    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f24927a7-b290-45ac-b3f1-00bfdc5e0803-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.959012 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.958996    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f24927a7-b290-45ac-b3f1-00bfdc5e0803-data-volume\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.959204 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.959188    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f24927a7-b290-45ac-b3f1-00bfdc5e0803-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.961025 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.961006    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f24927a7-b290-45ac-b3f1-00bfdc5e0803-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:19.968649 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:19.968630    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxbjh\" (UniqueName: \"kubernetes.io/projected/f24927a7-b290-45ac-b3f1-00bfdc5e0803-kube-api-access-sxbjh\") pod \"insights-runtime-extractor-kdh8k\" (UID: \"f24927a7-b290-45ac-b3f1-00bfdc5e0803\") " pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:20.050573 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:20.050532    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kdh8k"
May 25 05:59:20.169274 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:20.169245    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kdh8k"]
May 25 05:59:20.172868 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:59:20.172842    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24927a7_b290_45ac_b3f1_00bfdc5e0803.slice/crio-d83d881570f8d18a9a36b4ab440e899e8d71d6e476f602a68242106dcd9f2daf WatchSource:0}: Error finding container d83d881570f8d18a9a36b4ab440e899e8d71d6e476f602a68242106dcd9f2daf: Status 404 returned error can't find the container with id d83d881570f8d18a9a36b4ab440e899e8d71d6e476f602a68242106dcd9f2daf
May 25 05:59:20.556204 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:20.556167    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" podUID="43c6a6d5-d05f-4ee8-8c1d-95f3a1316013" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 25 05:59:20.598063 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:20.598035    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kdh8k" event={"ID":"f24927a7-b290-45ac-b3f1-00bfdc5e0803","Type":"ContainerStarted","Data":"951c143e65913a4bc06b96694f37016fc3f28c53ebd1137f22e9ba5f5832dc3c"}
May 25 05:59:20.598187 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:20.598069    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kdh8k" event={"ID":"f24927a7-b290-45ac-b3f1-00bfdc5e0803","Type":"ContainerStarted","Data":"d83d881570f8d18a9a36b4ab440e899e8d71d6e476f602a68242106dcd9f2daf"}
May 25 05:59:21.604480 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:21.604433    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kdh8k" event={"ID":"f24927a7-b290-45ac-b3f1-00bfdc5e0803","Type":"ContainerStarted","Data":"edba094565f3532d8ae1fd28c1db63691b03e2eef0b8e8250f860ea643cd71cd"}
May 25 05:59:22.608603 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:22.608552    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kdh8k" event={"ID":"f24927a7-b290-45ac-b3f1-00bfdc5e0803","Type":"ContainerStarted","Data":"7dc9772b6fbf0825cb6da236bafe9ba7f9bdefc4d031e129967e2c7a5992b79a"}
May 25 05:59:22.627918 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:22.627877    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kdh8k" podStartSLOduration=1.3584307820000001 podStartE2EDuration="3.627865268s" podCreationTimestamp="2026-05-25 05:59:19 +0000 UTC" firstStartedPulling="2026-05-25 05:59:20.22740156 +0000 UTC m=+150.572019568" lastFinishedPulling="2026-05-25 05:59:22.496836032 +0000 UTC m=+152.841454054" observedRunningTime="2026-05-25 05:59:22.626374362 +0000 UTC m=+152.970992417" watchObservedRunningTime="2026-05-25 05:59:22.627865268 +0000 UTC m=+152.972483298"
May 25 05:59:26.505117 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:59:26.505082    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2" podUID="8f5893ab-0a8b-45e4-9d23-52e3e8d172a1"
May 25 05:59:26.517370 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:59:26.517348    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hhv67" podUID="516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff"
May 25 05:59:26.617935 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:59:26.617903    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-cjpxj" podUID="5abec160-d16c-4c2c-9d6c-6422f7830854"
May 25 05:59:26.896181 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:26.896154    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v2vdn"]
May 25 05:59:26.899339 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:26.899324    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:26.901886 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:26.901846    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 05:59:26.902029 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:26.901993    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 05:59:26.902091 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:26.902025    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 05:59:26.902091 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:26.902056    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 05:59:26.902091 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:26.902087    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7krpk\""
May 25 05:59:26.902374 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:26.902356    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 05:59:26.903041 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:26.903028    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 05:59:27.010999 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.010975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-wtmp\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.011123 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.011017    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-tls\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.011123 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.011048    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-textfile\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.011123 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.011083    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.011123 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.011110    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.011287 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.011205    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9f3005a-b8d7-4253-98db-636c911e88ef-metrics-client-ca\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.011287 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.011229    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw7v6\" (UniqueName: \"kubernetes.io/projected/f9f3005a-b8d7-4253-98db-636c911e88ef-kube-api-access-pw7v6\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.011287 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.011247    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9f3005a-b8d7-4253-98db-636c911e88ef-sys\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.011287 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.011269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f9f3005a-b8d7-4253-98db-636c911e88ef-root\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111701 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111681    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9f3005a-b8d7-4253-98db-636c911e88ef-sys\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111801 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111720    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f9f3005a-b8d7-4253-98db-636c911e88ef-root\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111801 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111766    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-wtmp\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111801 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111779    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9f3005a-b8d7-4253-98db-636c911e88ef-sys\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111956 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111800    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-tls\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111956 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111820    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f9f3005a-b8d7-4253-98db-636c911e88ef-root\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111956 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111832    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-textfile\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111956 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111866    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111956 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111897    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.111956 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:59:27.111915    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 25 05:59:27.111956 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111938    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-wtmp\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.112322 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.111969    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9f3005a-b8d7-4253-98db-636c911e88ef-metrics-client-ca\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.112322 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:59:27.111987    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-tls podName:f9f3005a-b8d7-4253-98db-636c911e88ef nodeName:}" failed. No retries permitted until 2026-05-25 05:59:27.611966952 +0000 UTC m=+157.956584965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-tls") pod "node-exporter-v2vdn" (UID: "f9f3005a-b8d7-4253-98db-636c911e88ef") : secret "node-exporter-tls" not found
May 25 05:59:27.112322 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.112017    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pw7v6\" (UniqueName: \"kubernetes.io/projected/f9f3005a-b8d7-4253-98db-636c911e88ef-kube-api-access-pw7v6\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.112322 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.112202    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-textfile\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.112534 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.112487    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.112619 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.112555    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9f3005a-b8d7-4253-98db-636c911e88ef-metrics-client-ca\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.114264 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.114244    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.119797 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.119779    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw7v6\" (UniqueName: \"kubernetes.io/projected/f9f3005a-b8d7-4253-98db-636c911e88ef-kube-api-access-pw7v6\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.614914 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.614832    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-tls\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.617138 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.617114    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9f3005a-b8d7-4253-98db-636c911e88ef-node-exporter-tls\") pod \"node-exporter-v2vdn\" (UID: \"f9f3005a-b8d7-4253-98db-636c911e88ef\") " pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.808085 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:27.808056    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v2vdn"
May 25 05:59:27.815454 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:59:27.815424    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f3005a_b8d7_4253_98db_636c911e88ef.slice/crio-0243fa325afb7e63f95109f9f026832ec5fcb66e544f373c8fd4d7fdeca4bab6 WatchSource:0}: Error finding container 0243fa325afb7e63f95109f9f026832ec5fcb66e544f373c8fd4d7fdeca4bab6: Status 404 returned error can't find the container with id 0243fa325afb7e63f95109f9f026832ec5fcb66e544f373c8fd4d7fdeca4bab6
May 25 05:59:28.242581 ip-10-0-135-159 kubenswrapper[2572]: E0525 05:59:28.242548    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6kqfz" podUID="ceedf6b0-232e-4dcf-a1d2-694317d0046d"
May 25 05:59:28.624004 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:28.623960    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2vdn" event={"ID":"f9f3005a-b8d7-4253-98db-636c911e88ef","Type":"ContainerStarted","Data":"0243fa325afb7e63f95109f9f026832ec5fcb66e544f373c8fd4d7fdeca4bab6"}
May 25 05:59:29.628462 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:29.628428    2572 generic.go:358] "Generic (PLEG): container finished" podID="f9f3005a-b8d7-4253-98db-636c911e88ef" containerID="6030b9e2305410ebed316a8d76b78f7101ff658d0da94d3f5cfddee0f1e8b726" exitCode=0
May 25 05:59:29.628825 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:29.628488    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2vdn" event={"ID":"f9f3005a-b8d7-4253-98db-636c911e88ef","Type":"ContainerDied","Data":"6030b9e2305410ebed316a8d76b78f7101ff658d0da94d3f5cfddee0f1e8b726"}
May 25 05:59:30.556084 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:30.556012    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" podUID="43c6a6d5-d05f-4ee8-8c1d-95f3a1316013" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 25 05:59:30.632196 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:30.632161    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2vdn" event={"ID":"f9f3005a-b8d7-4253-98db-636c911e88ef","Type":"ContainerStarted","Data":"eec09efe1c24708d5188adde1708af3593dab6ef496ca2757aa6fd45b793e274"}
May 25 05:59:30.632514 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:30.632201    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2vdn" event={"ID":"f9f3005a-b8d7-4253-98db-636c911e88ef","Type":"ContainerStarted","Data":"86e6e8a40602bae6b1e6862b5564453d5c8cfa0b42a019dd2330728fae73dced"}
May 25 05:59:30.651099 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:30.651060    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v2vdn" podStartSLOduration=3.574801064 podStartE2EDuration="4.651048339s" podCreationTimestamp="2026-05-25 05:59:26 +0000 UTC" firstStartedPulling="2026-05-25 05:59:27.817203195 +0000 UTC m=+158.161821219" lastFinishedPulling="2026-05-25 05:59:28.893450474 +0000 UTC m=+159.238068494" observedRunningTime="2026-05-25 05:59:30.649335646 +0000 UTC m=+160.993953677" watchObservedRunningTime="2026-05-25 05:59:30.651048339 +0000 UTC m=+160.995666368"
May 25 05:59:31.445738 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:31.445702    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:59:31.445969 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:31.445753    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:59:31.448290 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:31.448272    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"image-registry-cb4567dff-cdxp2\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") " pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:59:31.448337 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:31.448275    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff-metrics-tls\") pod \"dns-default-hhv67\" (UID: \"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff\") " pod="openshift-dns/dns-default-hhv67"
May 25 05:59:31.546628 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:31.546576    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:59:31.548720 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:31.548703    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abec160-d16c-4c2c-9d6c-6422f7830854-cert\") pod \"ingress-canary-cjpxj\" (UID: \"5abec160-d16c-4c2c-9d6c-6422f7830854\") " pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:59:32.109058 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.109022    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"]
May 25 05:59:32.112348 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.112333    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.114962 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.114941    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 25 05:59:32.115091 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.114978    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 25 05:59:32.115091 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.114981    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 25 05:59:32.115091 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.115035    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 25 05:59:32.115265 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.115172    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zqxvl\""
May 25 05:59:32.115265 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.115220    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 25 05:59:32.120539 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.120378    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 25 05:59:32.121910 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.121889    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"]
May 25 05:59:32.150830 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.150795    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-telemeter-client-tls\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.150933 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.150844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-federate-client-tls\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.150982 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.150940    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-serving-certs-ca-bundle\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.150982 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.150967    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-secret-telemeter-client\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.151064 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.150987    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.151064 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.151010    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvn64\" (UniqueName: \"kubernetes.io/projected/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-kube-api-access-nvn64\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.151064 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.151050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-metrics-client-ca\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.151186 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.151120    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.251775 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.251752    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-serving-certs-ca-bundle\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.251875 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.251781    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-secret-telemeter-client\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.251875 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.251802    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.251875 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.251826    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvn64\" (UniqueName: \"kubernetes.io/projected/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-kube-api-access-nvn64\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.251875 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.251855    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-metrics-client-ca\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.252069 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.251906    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.252069 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.251949    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-telemeter-client-tls\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.252069 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.251982    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-federate-client-tls\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.252570 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.252544    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-serving-certs-ca-bundle\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.252570 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.252569    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-metrics-client-ca\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.252834 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.252813    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.254608 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.254564    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-federate-client-tls\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.254692 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.254605    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.254837 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.254821    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-telemeter-client-tls\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.254872 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.254845    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-secret-telemeter-client\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.260848 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.260830    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvn64\" (UniqueName: \"kubernetes.io/projected/9fc42640-1e38-45ce-b6a4-4a38c7e43f37-kube-api-access-nvn64\") pod \"telemeter-client-5b678dcddb-2sgq8\" (UID: \"9fc42640-1e38-45ce-b6a4-4a38c7e43f37\") " pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.422286 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.422204    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"
May 25 05:59:32.559071 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.559041    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b678dcddb-2sgq8"]
May 25 05:59:32.561618 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:59:32.561573    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc42640_1e38_45ce_b6a4_4a38c7e43f37.slice/crio-8ed7d3234d5b55fc5fdb2125412827f1bea4dd9586b28887250f60a3461e261e WatchSource:0}: Error finding container 8ed7d3234d5b55fc5fdb2125412827f1bea4dd9586b28887250f60a3461e261e: Status 404 returned error can't find the container with id 8ed7d3234d5b55fc5fdb2125412827f1bea4dd9586b28887250f60a3461e261e
May 25 05:59:32.638116 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:32.638084    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8" event={"ID":"9fc42640-1e38-45ce-b6a4-4a38c7e43f37","Type":"ContainerStarted","Data":"8ed7d3234d5b55fc5fdb2125412827f1bea4dd9586b28887250f60a3461e261e"}
May 25 05:59:34.644126 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:34.644094    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8" event={"ID":"9fc42640-1e38-45ce-b6a4-4a38c7e43f37","Type":"ContainerStarted","Data":"6ad2ee52dea4f06fa059c1f8b5e42aa9413bf68310b93c1815e3b7f3b07a23d2"}
May 25 05:59:35.647930 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:35.647896    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8" event={"ID":"9fc42640-1e38-45ce-b6a4-4a38c7e43f37","Type":"ContainerStarted","Data":"f8468ea2a19f7a115c1e0defed274f23a90071485d26ae991d529370fa931410"}
May 25 05:59:35.647930 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:35.647934    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8" event={"ID":"9fc42640-1e38-45ce-b6a4-4a38c7e43f37","Type":"ContainerStarted","Data":"d4cb82195c22aa27c74fd499951a81831f4804e165af9d088da68968cbcac353"}
May 25 05:59:35.680522 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:35.680431    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b678dcddb-2sgq8" podStartSLOduration=0.825526708 podStartE2EDuration="3.68041663s" podCreationTimestamp="2026-05-25 05:59:32 +0000 UTC" firstStartedPulling="2026-05-25 05:59:32.563344134 +0000 UTC m=+162.907962142" lastFinishedPulling="2026-05-25 05:59:35.418234044 +0000 UTC m=+165.762852064" observedRunningTime="2026-05-25 05:59:35.680045207 +0000 UTC m=+166.024663228" watchObservedRunningTime="2026-05-25 05:59:35.68041663 +0000 UTC m=+166.025034660"
May 25 05:59:39.217822 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:39.217784    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:59:39.220796 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:39.220779    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rkkwr\""
May 25 05:59:39.229033 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:39.229011    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:59:39.344755 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:39.344731    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cb4567dff-cdxp2"]
May 25 05:59:39.347728 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:59:39.347703    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5893ab_0a8b_45e4_9d23_52e3e8d172a1.slice/crio-fba13607cd8da0feb9a9a8a0040bbdaa70dcc886b2d4751748e3712689ecdb6d WatchSource:0}: Error finding container fba13607cd8da0feb9a9a8a0040bbdaa70dcc886b2d4751748e3712689ecdb6d: Status 404 returned error can't find the container with id fba13607cd8da0feb9a9a8a0040bbdaa70dcc886b2d4751748e3712689ecdb6d
May 25 05:59:39.659132 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:39.659097    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2" event={"ID":"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1","Type":"ContainerStarted","Data":"abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429"}
May 25 05:59:39.659298 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:39.659136    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2" event={"ID":"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1","Type":"ContainerStarted","Data":"fba13607cd8da0feb9a9a8a0040bbdaa70dcc886b2d4751748e3712689ecdb6d"}
May 25 05:59:39.659298 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:39.659219    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 05:59:39.686245 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:39.686196    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2" podStartSLOduration=169.686185201 podStartE2EDuration="2m49.686185201s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 05:59:39.68432333 +0000 UTC m=+170.028941361" watchObservedRunningTime="2026-05-25 05:59:39.686185201 +0000 UTC m=+170.030803231"
May 25 05:59:40.555601 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:40.555564    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" podUID="43c6a6d5-d05f-4ee8-8c1d-95f3a1316013" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 25 05:59:40.556034 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:40.555650    2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n"
May 25 05:59:40.556250 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:40.556217    2572 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"fcda3d13403a5803c9045118837353cd4cecc8976eb042c10efb8c348ac2e998"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 25 05:59:40.556338 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:40.556290    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" podUID="43c6a6d5-d05f-4ee8-8c1d-95f3a1316013" containerName="service-proxy" containerID="cri-o://fcda3d13403a5803c9045118837353cd4cecc8976eb042c10efb8c348ac2e998" gracePeriod=30
May 25 05:59:41.218185 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.218156    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hhv67"
May 25 05:59:41.218326 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.218156    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:59:41.218326 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.218156    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 05:59:41.220963 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.220949    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g6njt\""
May 25 05:59:41.222040 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.222028    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjmkj\""
May 25 05:59:41.228987 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.228974    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hhv67"
May 25 05:59:41.229112 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.229099    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cjpxj"
May 25 05:59:41.353920 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.353892    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hhv67"]
May 25 05:59:41.357100 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:59:41.357076    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516ed32d_ebc9_494d_a2b0_8ea9f3ae44ff.slice/crio-1aa9fa78062f84962b965b6970967b2f63311a1a7b8ea693f21fc1a132c09bfb WatchSource:0}: Error finding container 1aa9fa78062f84962b965b6970967b2f63311a1a7b8ea693f21fc1a132c09bfb: Status 404 returned error can't find the container with id 1aa9fa78062f84962b965b6970967b2f63311a1a7b8ea693f21fc1a132c09bfb
May 25 05:59:41.373206 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.373184    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cjpxj"]
May 25 05:59:41.375558 ip-10-0-135-159 kubenswrapper[2572]: W0525 05:59:41.375539    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abec160_d16c_4c2c_9d6c_6422f7830854.slice/crio-2a3f1ee3651e81292ce996c7ae621bd00304564d5edc9c61d36511f466ff3e7b WatchSource:0}: Error finding container 2a3f1ee3651e81292ce996c7ae621bd00304564d5edc9c61d36511f466ff3e7b: Status 404 returned error can't find the container with id 2a3f1ee3651e81292ce996c7ae621bd00304564d5edc9c61d36511f466ff3e7b
May 25 05:59:41.669337 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.669301    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hhv67" event={"ID":"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff","Type":"ContainerStarted","Data":"1aa9fa78062f84962b965b6970967b2f63311a1a7b8ea693f21fc1a132c09bfb"}
May 25 05:59:41.670428 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.670404    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cjpxj" event={"ID":"5abec160-d16c-4c2c-9d6c-6422f7830854","Type":"ContainerStarted","Data":"2a3f1ee3651e81292ce996c7ae621bd00304564d5edc9c61d36511f466ff3e7b"}
May 25 05:59:41.672319 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.672298    2572 generic.go:358] "Generic (PLEG): container finished" podID="43c6a6d5-d05f-4ee8-8c1d-95f3a1316013" containerID="fcda3d13403a5803c9045118837353cd4cecc8976eb042c10efb8c348ac2e998" exitCode=2
May 25 05:59:41.672393 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.672330    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" event={"ID":"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013","Type":"ContainerDied","Data":"fcda3d13403a5803c9045118837353cd4cecc8976eb042c10efb8c348ac2e998"}
May 25 05:59:41.672393 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:41.672346    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c688f9f8-wks4n" event={"ID":"43c6a6d5-d05f-4ee8-8c1d-95f3a1316013","Type":"ContainerStarted","Data":"d99b6badd67059ac610230e23a3966ec8e7c6c623ea0abbd31d48983e2ebae1e"}
May 25 05:59:42.205422 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:42.205386    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cb4567dff-cdxp2"]
May 25 05:59:43.680009 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:43.679977    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hhv67" event={"ID":"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff","Type":"ContainerStarted","Data":"1734754b7458b26a78772598f4eb4d70c49320e7cad737a215f2cd084301c821"}
May 25 05:59:43.680009 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:43.680012    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hhv67" event={"ID":"516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff","Type":"ContainerStarted","Data":"a102b4374f357f30456632c088edd6cf58b6a3c8f13e7a03bd46ab6b3ef85973"}
May 25 05:59:43.680484 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:43.680071    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hhv67"
May 25 05:59:43.681308 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:43.681288    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cjpxj" event={"ID":"5abec160-d16c-4c2c-9d6c-6422f7830854","Type":"ContainerStarted","Data":"759a012a78e4b38bd7cfeee8a8fd274207f98f07327e3fff3e52a40495bff5ad"}
May 25 05:59:43.699661 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:43.699621    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hhv67" podStartSLOduration=138.853008902 podStartE2EDuration="2m20.699608668s" podCreationTimestamp="2026-05-25 05:57:23 +0000 UTC" firstStartedPulling="2026-05-25 05:59:41.358805654 +0000 UTC m=+171.703423663" lastFinishedPulling="2026-05-25 05:59:43.205405413 +0000 UTC m=+173.550023429" observedRunningTime="2026-05-25 05:59:43.698461327 +0000 UTC m=+174.043079361" watchObservedRunningTime="2026-05-25 05:59:43.699608668 +0000 UTC m=+174.044226731"
May 25 05:59:43.723411 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:43.723375    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cjpxj" podStartSLOduration=138.891505078 podStartE2EDuration="2m20.723363691s" podCreationTimestamp="2026-05-25 05:57:23 +0000 UTC" firstStartedPulling="2026-05-25 05:59:41.377194861 +0000 UTC m=+171.721812874" lastFinishedPulling="2026-05-25 05:59:43.209053479 +0000 UTC m=+173.553671487" observedRunningTime="2026-05-25 05:59:43.722437846 +0000 UTC m=+174.067055879" watchObservedRunningTime="2026-05-25 05:59:43.723363691 +0000 UTC m=+174.067981720"
May 25 05:59:53.686762 ip-10-0-135-159 kubenswrapper[2572]: I0525 05:59:53.686732    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hhv67"
May 25 06:00:02.211006 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:02.210977    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 06:00:07.229734 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.229683    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2" podUID="8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" containerName="registry" containerID="cri-o://abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429" gracePeriod=30
May 25 06:00:07.462373 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.462353    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 06:00:07.600716 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.600693    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") pod \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") "
May 25 06:00:07.600866 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.600728    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d57p\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-kube-api-access-9d57p\") pod \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") "
May 25 06:00:07.600866 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.600749    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-trusted-ca\") pod \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") "
May 25 06:00:07.600866 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.600765    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-installation-pull-secrets\") pod \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") "
May 25 06:00:07.601027 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.600854    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-ca-trust-extracted\") pod \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") "
May 25 06:00:07.601027 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.600919    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-image-registry-private-configuration\") pod \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") "
May 25 06:00:07.601027 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.600958    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-bound-sa-token\") pod \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") "
May 25 06:00:07.601165 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.601053    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-certificates\") pod \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\" (UID: \"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1\") "
May 25 06:00:07.601250 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.601209    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:00:07.601691 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.601652    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:00:07.603184 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.603131    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:00:07.603403 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.603376    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-kube-api-access-9d57p" (OuterVolumeSpecName: "kube-api-access-9d57p") pod "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1"). InnerVolumeSpecName "kube-api-access-9d57p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:00:07.603403 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.603384    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:00:07.603531 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.603453    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:00:07.603653 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.603631    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:00:07.609544 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.609521    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" (UID: "8f5893ab-0a8b-45e4-9d23-52e3e8d172a1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:00:07.702316 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.702293    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-certificates\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:00:07.702316 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.702317    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-registry-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:00:07.702426 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.702327    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d57p\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-kube-api-access-9d57p\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:00:07.702426 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.702335    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-trusted-ca\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:00:07.702426 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.702344    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-installation-pull-secrets\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:00:07.702426 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.702352    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-ca-trust-extracted\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:00:07.702426 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.702362    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-image-registry-private-configuration\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:00:07.702426 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.702372    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1-bound-sa-token\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:00:07.738245 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.738219    2572 generic.go:358] "Generic (PLEG): container finished" podID="8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" containerID="abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429" exitCode=0
May 25 06:00:07.738339 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.738285    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2"
May 25 06:00:07.738401 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.738286    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2" event={"ID":"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1","Type":"ContainerDied","Data":"abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429"}
May 25 06:00:07.738401 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.738390    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb4567dff-cdxp2" event={"ID":"8f5893ab-0a8b-45e4-9d23-52e3e8d172a1","Type":"ContainerDied","Data":"fba13607cd8da0feb9a9a8a0040bbdaa70dcc886b2d4751748e3712689ecdb6d"}
May 25 06:00:07.738494 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.738405    2572 scope.go:117] "RemoveContainer" containerID="abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429"
May 25 06:00:07.747886 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.747868    2572 scope.go:117] "RemoveContainer" containerID="abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429"
May 25 06:00:07.748208 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:00:07.748130    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429\": container with ID starting with abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429 not found: ID does not exist" containerID="abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429"
May 25 06:00:07.748208 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.748163    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429"} err="failed to get container status \"abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429\": rpc error: code = NotFound desc = could not find container \"abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429\": container with ID starting with abb0722fb605e5bfa0af971f314bfa95b37e636dc97233d649b46fd70532a429 not found: ID does not exist"
May 25 06:00:07.763213 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.763184    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cb4567dff-cdxp2"]
May 25 06:00:07.766099 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:07.766080    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cb4567dff-cdxp2"]
May 25 06:00:08.221606 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:00:08.221564    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" path="/var/lib/kubelet/pods/8f5893ab-0a8b-45e4-9d23-52e3e8d172a1/volumes"
May 25 06:01:02.075741 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:02.075668    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 06:01:02.077851 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:02.077832    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceedf6b0-232e-4dcf-a1d2-694317d0046d-metrics-certs\") pod \"network-metrics-daemon-6kqfz\" (UID: \"ceedf6b0-232e-4dcf-a1d2-694317d0046d\") " pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 06:01:02.226840 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:02.226815    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kfc7\""
May 25 06:01:02.229903 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:02.229886    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6kqfz"
May 25 06:01:02.347040 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:02.346972    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6kqfz"]
May 25 06:01:02.350147 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:01:02.350112    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceedf6b0_232e_4dcf_a1d2_694317d0046d.slice/crio-71419ddcaac0168e8c3386deed36fb5d218e26ee72573a092e192f5ae9b94526 WatchSource:0}: Error finding container 71419ddcaac0168e8c3386deed36fb5d218e26ee72573a092e192f5ae9b94526: Status 404 returned error can't find the container with id 71419ddcaac0168e8c3386deed36fb5d218e26ee72573a092e192f5ae9b94526
May 25 06:01:02.883687 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:02.883654    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6kqfz" event={"ID":"ceedf6b0-232e-4dcf-a1d2-694317d0046d","Type":"ContainerStarted","Data":"71419ddcaac0168e8c3386deed36fb5d218e26ee72573a092e192f5ae9b94526"}
May 25 06:01:03.888362 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:03.888329    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6kqfz" event={"ID":"ceedf6b0-232e-4dcf-a1d2-694317d0046d","Type":"ContainerStarted","Data":"c269f979673673d3369c03c7e1429765fd92028f5af1a7e49b52ea6d8736f96d"}
May 25 06:01:03.888731 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:03.888367    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6kqfz" event={"ID":"ceedf6b0-232e-4dcf-a1d2-694317d0046d","Type":"ContainerStarted","Data":"684657ffac12b0e52211e4b25a3c2753b807a67a1f7091a9787237ec0e4be453"}
May 25 06:01:03.905108 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:03.905066    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6kqfz" podStartSLOduration=252.825408264 podStartE2EDuration="4m13.905053194s" podCreationTimestamp="2026-05-25 05:56:50 +0000 UTC" firstStartedPulling="2026-05-25 06:01:02.351821332 +0000 UTC m=+252.696439340" lastFinishedPulling="2026-05-25 06:01:03.431466258 +0000 UTC m=+253.776084270" observedRunningTime="2026-05-25 06:01:03.90422238 +0000 UTC m=+254.248840410" watchObservedRunningTime="2026-05-25 06:01:03.905053194 +0000 UTC m=+254.249671231"
May 25 06:01:50.174138 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:01:50.174112    2572 kubelet.go:1628] "Image garbage collection succeeded"
May 25 06:03:09.529031 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.528998    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"]
May 25 06:03:09.529491 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.529249    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" containerName="registry"
May 25 06:03:09.529491 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.529261    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" containerName="registry"
May 25 06:03:09.529491 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.529308    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f5893ab-0a8b-45e4-9d23-52e3e8d172a1" containerName="registry"
May 25 06:03:09.531826 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.531811    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"
May 25 06:03:09.534659 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.534631    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 25 06:03:09.534782 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.534708    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 25 06:03:09.535890 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.535871    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-84hlk\""
May 25 06:03:09.540134 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.540115    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"]
May 25 06:03:09.593102 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.593082    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc42l\" (UniqueName: \"kubernetes.io/projected/13b8a610-4b35-405a-8394-6977f3d78e0f-kube-api-access-xc42l\") pod \"feast-operator-controller-manager-65f788cfc7-nsts6\" (UID: \"13b8a610-4b35-405a-8394-6977f3d78e0f\") " pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"
May 25 06:03:09.693506 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.693480    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xc42l\" (UniqueName: \"kubernetes.io/projected/13b8a610-4b35-405a-8394-6977f3d78e0f-kube-api-access-xc42l\") pod \"feast-operator-controller-manager-65f788cfc7-nsts6\" (UID: \"13b8a610-4b35-405a-8394-6977f3d78e0f\") " pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"
May 25 06:03:09.702348 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.702326    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc42l\" (UniqueName: \"kubernetes.io/projected/13b8a610-4b35-405a-8394-6977f3d78e0f-kube-api-access-xc42l\") pod \"feast-operator-controller-manager-65f788cfc7-nsts6\" (UID: \"13b8a610-4b35-405a-8394-6977f3d78e0f\") " pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"
May 25 06:03:09.841083 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.841057    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"
May 25 06:03:09.955328 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.955215    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"]
May 25 06:03:09.957465 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:03:09.957432    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b8a610_4b35_405a_8394_6977f3d78e0f.slice/crio-f4d60aaaf149ea6f9b2d8d33336ac955bf5359fadc26996032230682f10f7cd5 WatchSource:0}: Error finding container f4d60aaaf149ea6f9b2d8d33336ac955bf5359fadc26996032230682f10f7cd5: Status 404 returned error can't find the container with id f4d60aaaf149ea6f9b2d8d33336ac955bf5359fadc26996032230682f10f7cd5
May 25 06:03:09.959112 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:09.959098    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 06:03:10.201694 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:10.201616    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6" event={"ID":"13b8a610-4b35-405a-8394-6977f3d78e0f","Type":"ContainerStarted","Data":"f4d60aaaf149ea6f9b2d8d33336ac955bf5359fadc26996032230682f10f7cd5"}
May 25 06:03:13.213793 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:13.213713    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6" event={"ID":"13b8a610-4b35-405a-8394-6977f3d78e0f","Type":"ContainerStarted","Data":"0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6"}
May 25 06:03:13.214115 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:13.213839    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"
May 25 06:03:13.229606 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:13.229546    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6" podStartSLOduration=1.32544513 podStartE2EDuration="4.229535197s" podCreationTimestamp="2026-05-25 06:03:09 +0000 UTC" firstStartedPulling="2026-05-25 06:03:09.959231932 +0000 UTC m=+380.303849943" lastFinishedPulling="2026-05-25 06:03:12.863321999 +0000 UTC m=+383.207940010" observedRunningTime="2026-05-25 06:03:13.228355091 +0000 UTC m=+383.572973121" watchObservedRunningTime="2026-05-25 06:03:13.229535197 +0000 UTC m=+383.574153227"
May 25 06:03:24.221009 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:03:24.220975    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"
May 25 06:09:12.671309 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.671270    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-g2958"]
May 25 06:09:12.674171 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.674155    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-g2958"
May 25 06:09:12.676632 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.676609    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 25 06:09:12.676745 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.676676    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 25 06:09:12.677645 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.677627    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-jkn4f\""
May 25 06:09:12.681856 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.681835    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-g2958"]
May 25 06:09:12.790822 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.790800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjs5l\" (UniqueName: \"kubernetes.io/projected/e0f8577e-51dc-4fd0-a22f-5e71706db2b8-kube-api-access-gjs5l\") pod \"redis-854544c579-g2958\" (UID: \"e0f8577e-51dc-4fd0-a22f-5e71706db2b8\") " pod="test-ns-feast/redis-854544c579-g2958"
May 25 06:09:12.891371 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.891347    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjs5l\" (UniqueName: \"kubernetes.io/projected/e0f8577e-51dc-4fd0-a22f-5e71706db2b8-kube-api-access-gjs5l\") pod \"redis-854544c579-g2958\" (UID: \"e0f8577e-51dc-4fd0-a22f-5e71706db2b8\") " pod="test-ns-feast/redis-854544c579-g2958"
May 25 06:09:12.899011 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.898993    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjs5l\" (UniqueName: \"kubernetes.io/projected/e0f8577e-51dc-4fd0-a22f-5e71706db2b8-kube-api-access-gjs5l\") pod \"redis-854544c579-g2958\" (UID: \"e0f8577e-51dc-4fd0-a22f-5e71706db2b8\") " pod="test-ns-feast/redis-854544c579-g2958"
May 25 06:09:12.983313 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:12.983254    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-g2958"
May 25 06:09:13.097960 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:13.097938    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-g2958"]
May 25 06:09:13.100224 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:09:13.100198    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0f8577e_51dc_4fd0_a22f_5e71706db2b8.slice/crio-451ccd624eba6b6d3704674fd355f4bc6ab247af88b4dbd20c2dbed68789002b WatchSource:0}: Error finding container 451ccd624eba6b6d3704674fd355f4bc6ab247af88b4dbd20c2dbed68789002b: Status 404 returned error can't find the container with id 451ccd624eba6b6d3704674fd355f4bc6ab247af88b4dbd20c2dbed68789002b
May 25 06:09:13.101908 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:13.101891    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 06:09:13.106254 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:13.106231    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-g2958" event={"ID":"e0f8577e-51dc-4fd0-a22f-5e71706db2b8","Type":"ContainerStarted","Data":"451ccd624eba6b6d3704674fd355f4bc6ab247af88b4dbd20c2dbed68789002b"}
May 25 06:09:15.113129 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:15.113096    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-g2958" event={"ID":"e0f8577e-51dc-4fd0-a22f-5e71706db2b8","Type":"ContainerStarted","Data":"941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394"}
May 25 06:09:15.126906 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:15.126867    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-g2958" podStartSLOduration=1.638171595 podStartE2EDuration="3.12685357s" podCreationTimestamp="2026-05-25 06:09:12 +0000 UTC" firstStartedPulling="2026-05-25 06:09:13.102040637 +0000 UTC m=+743.446658644" lastFinishedPulling="2026-05-25 06:09:14.590722612 +0000 UTC m=+744.935340619" observedRunningTime="2026-05-25 06:09:15.125926201 +0000 UTC m=+745.470544232" watchObservedRunningTime="2026-05-25 06:09:15.12685357 +0000 UTC m=+745.471471593"
May 25 06:09:46.134271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.134237    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-v8qqn"]
May 25 06:09:46.137273 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.137257    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-v8qqn"
May 25 06:09:46.139707 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.139679    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 25 06:09:46.139822 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.139739    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-5vnkn\""
May 25 06:09:46.143233 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.143207    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-v8qqn"]
May 25 06:09:46.207031 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.207006    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txf2m\" (UniqueName: \"kubernetes.io/projected/489cd255-128a-4028-a9de-412f3c2e5289-kube-api-access-txf2m\") pod \"feast-test-apply-v8qqn\" (UID: \"489cd255-128a-4028-a9de-412f3c2e5289\") " pod="test-ns-feast/feast-test-apply-v8qqn"
May 25 06:09:46.308123 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.308102    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txf2m\" (UniqueName: \"kubernetes.io/projected/489cd255-128a-4028-a9de-412f3c2e5289-kube-api-access-txf2m\") pod \"feast-test-apply-v8qqn\" (UID: \"489cd255-128a-4028-a9de-412f3c2e5289\") " pod="test-ns-feast/feast-test-apply-v8qqn"
May 25 06:09:46.315989 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.315966    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txf2m\" (UniqueName: \"kubernetes.io/projected/489cd255-128a-4028-a9de-412f3c2e5289-kube-api-access-txf2m\") pod \"feast-test-apply-v8qqn\" (UID: \"489cd255-128a-4028-a9de-412f3c2e5289\") " pod="test-ns-feast/feast-test-apply-v8qqn"
May 25 06:09:46.446950 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.446890    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-v8qqn"
May 25 06:09:46.559810 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:46.559783    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-v8qqn"]
May 25 06:09:46.562871 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:09:46.562838    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod489cd255_128a_4028_a9de_412f3c2e5289.slice/crio-87cd8d55779349f5bee7ce0e16cb5281d72f40a6d1f8ae3c1c4560464bd299d4 WatchSource:0}: Error finding container 87cd8d55779349f5bee7ce0e16cb5281d72f40a6d1f8ae3c1c4560464bd299d4: Status 404 returned error can't find the container with id 87cd8d55779349f5bee7ce0e16cb5281d72f40a6d1f8ae3c1c4560464bd299d4
May 25 06:09:47.194527 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:47.194492    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-v8qqn" event={"ID":"489cd255-128a-4028-a9de-412f3c2e5289","Type":"ContainerStarted","Data":"87cd8d55779349f5bee7ce0e16cb5281d72f40a6d1f8ae3c1c4560464bd299d4"}
May 25 06:09:51.418960 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:51.418935    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 25 06:09:52.208916 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:52.208881    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-v8qqn" event={"ID":"489cd255-128a-4028-a9de-412f3c2e5289","Type":"ContainerStarted","Data":"2f264d2565d5879929bab9294281e9dd30290f6cb3cee1690484b849caf30516"}
May 25 06:09:58.223572 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:58.223544    2572 generic.go:358] "Generic (PLEG): container finished" podID="489cd255-128a-4028-a9de-412f3c2e5289" containerID="2f264d2565d5879929bab9294281e9dd30290f6cb3cee1690484b849caf30516" exitCode=0
May 25 06:09:58.223939 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:58.223621    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-v8qqn" event={"ID":"489cd255-128a-4028-a9de-412f3c2e5289","Type":"ContainerDied","Data":"2f264d2565d5879929bab9294281e9dd30290f6cb3cee1690484b849caf30516"}
May 25 06:09:59.232181 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:59.232144    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-v8qqn" event={"ID":"489cd255-128a-4028-a9de-412f3c2e5289","Type":"ContainerStarted","Data":"d359f332faccc792e9ffad64aed905cff227397a1169f34b91047dcbbf18aee8"}
May 25 06:09:59.249168 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:09:59.249126    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-v8qqn" podStartSLOduration=8.39974567 podStartE2EDuration="13.249114208s" podCreationTimestamp="2026-05-25 06:09:46 +0000 UTC" firstStartedPulling="2026-05-25 06:09:46.56458364 +0000 UTC m=+776.909201665" lastFinishedPulling="2026-05-25 06:09:51.413952176 +0000 UTC m=+781.758570203" observedRunningTime="2026-05-25 06:09:59.247764839 +0000 UTC m=+789.592382869" watchObservedRunningTime="2026-05-25 06:09:59.249114208 +0000 UTC m=+789.593732237"
May 25 06:10:07.251373 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:07.251308    2572 generic.go:358] "Generic (PLEG): container finished" podID="489cd255-128a-4028-a9de-412f3c2e5289" containerID="d359f332faccc792e9ffad64aed905cff227397a1169f34b91047dcbbf18aee8" exitCode=0
May 25 06:10:07.251373 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:07.251365    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-v8qqn" event={"ID":"489cd255-128a-4028-a9de-412f3c2e5289","Type":"ContainerDied","Data":"d359f332faccc792e9ffad64aed905cff227397a1169f34b91047dcbbf18aee8"}
May 25 06:10:08.372379 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:08.372359    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-v8qqn"
May 25 06:10:08.455494 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:08.455469    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txf2m\" (UniqueName: \"kubernetes.io/projected/489cd255-128a-4028-a9de-412f3c2e5289-kube-api-access-txf2m\") pod \"489cd255-128a-4028-a9de-412f3c2e5289\" (UID: \"489cd255-128a-4028-a9de-412f3c2e5289\") "
May 25 06:10:08.457485 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:08.457464    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/489cd255-128a-4028-a9de-412f3c2e5289-kube-api-access-txf2m" (OuterVolumeSpecName: "kube-api-access-txf2m") pod "489cd255-128a-4028-a9de-412f3c2e5289" (UID: "489cd255-128a-4028-a9de-412f3c2e5289"). InnerVolumeSpecName "kube-api-access-txf2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:10:08.555924 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:08.555896    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txf2m\" (UniqueName: \"kubernetes.io/projected/489cd255-128a-4028-a9de-412f3c2e5289-kube-api-access-txf2m\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:10:09.257478 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:09.257448    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-v8qqn" event={"ID":"489cd255-128a-4028-a9de-412f3c2e5289","Type":"ContainerDied","Data":"87cd8d55779349f5bee7ce0e16cb5281d72f40a6d1f8ae3c1c4560464bd299d4"}
May 25 06:10:09.257478 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:09.257473    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-v8qqn"
May 25 06:10:09.257678 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:09.257479    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87cd8d55779349f5bee7ce0e16cb5281d72f40a6d1f8ae3c1c4560464bd299d4"
May 25 06:10:09.429855 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:09.429830    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-v8qqn_489cd255-128a-4028-a9de-412f3c2e5289/feast-0/0.log"
May 25 06:10:09.435459 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:09.435438    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-v8qqn_489cd255-128a-4028-a9de-412f3c2e5289/feast-1/0.log"
May 25 06:10:43.942858 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:43.942826    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-v8qqn"]
May 25 06:10:43.950486 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:43.950458    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-v8qqn"]
May 25 06:10:43.964902 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:43.964882    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-g2958"]
May 25 06:10:43.965106 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:43.965059    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-g2958" podUID="e0f8577e-51dc-4fd0-a22f-5e71706db2b8" containerName="redis" containerID="cri-o://941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394" gracePeriod=30
May 25 06:10:44.199190 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.199139    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-g2958"
May 25 06:10:44.221943 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.221918    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="489cd255-128a-4028-a9de-412f3c2e5289" path="/var/lib/kubelet/pods/489cd255-128a-4028-a9de-412f3c2e5289/volumes"
May 25 06:10:44.281239 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.281209    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjs5l\" (UniqueName: \"kubernetes.io/projected/e0f8577e-51dc-4fd0-a22f-5e71706db2b8-kube-api-access-gjs5l\") pod \"e0f8577e-51dc-4fd0-a22f-5e71706db2b8\" (UID: \"e0f8577e-51dc-4fd0-a22f-5e71706db2b8\") "
May 25 06:10:44.283146 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.283123    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f8577e-51dc-4fd0-a22f-5e71706db2b8-kube-api-access-gjs5l" (OuterVolumeSpecName: "kube-api-access-gjs5l") pod "e0f8577e-51dc-4fd0-a22f-5e71706db2b8" (UID: "e0f8577e-51dc-4fd0-a22f-5e71706db2b8"). InnerVolumeSpecName "kube-api-access-gjs5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:10:44.347081 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.347053    2572 generic.go:358] "Generic (PLEG): container finished" podID="e0f8577e-51dc-4fd0-a22f-5e71706db2b8" containerID="941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394" exitCode=0
May 25 06:10:44.347162 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.347100    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-g2958"
May 25 06:10:44.347162 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.347137    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-g2958" event={"ID":"e0f8577e-51dc-4fd0-a22f-5e71706db2b8","Type":"ContainerDied","Data":"941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394"}
May 25 06:10:44.347238 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.347178    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-g2958" event={"ID":"e0f8577e-51dc-4fd0-a22f-5e71706db2b8","Type":"ContainerDied","Data":"451ccd624eba6b6d3704674fd355f4bc6ab247af88b4dbd20c2dbed68789002b"}
May 25 06:10:44.347238 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.347195    2572 scope.go:117] "RemoveContainer" containerID="941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394"
May 25 06:10:44.355335 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.355318    2572 scope.go:117] "RemoveContainer" containerID="941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394"
May 25 06:10:44.355558 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:10:44.355539    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394\": container with ID starting with 941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394 not found: ID does not exist" containerID="941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394"
May 25 06:10:44.355641 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.355564    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394"} err="failed to get container status \"941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394\": rpc error: code = NotFound desc = could not find container \"941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394\": container with ID starting with 941abab0f6986da4c5e2e1ea3a6b0902f53af5bd11770895e8011a0d36ffc394 not found: ID does not exist"
May 25 06:10:44.366038 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.366017    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-g2958"]
May 25 06:10:44.369629 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.369611    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-g2958"]
May 25 06:10:44.382016 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:44.381997    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjs5l\" (UniqueName: \"kubernetes.io/projected/e0f8577e-51dc-4fd0-a22f-5e71706db2b8-kube-api-access-gjs5l\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:10:46.221884 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:10:46.221850    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0f8577e-51dc-4fd0-a22f-5e71706db2b8" path="/var/lib/kubelet/pods/e0f8577e-51dc-4fd0-a22f-5e71706db2b8/volumes"
May 25 06:14:56.117227 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.117152    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"]
May 25 06:14:56.117827 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.117381    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6" podUID="13b8a610-4b35-405a-8394-6977f3d78e0f" containerName="manager" containerID="cri-o://0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6" gracePeriod=10
May 25 06:14:56.379941 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.379920    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"
May 25 06:14:56.428438 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.428411    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc42l\" (UniqueName: \"kubernetes.io/projected/13b8a610-4b35-405a-8394-6977f3d78e0f-kube-api-access-xc42l\") pod \"13b8a610-4b35-405a-8394-6977f3d78e0f\" (UID: \"13b8a610-4b35-405a-8394-6977f3d78e0f\") "
May 25 06:14:56.430385 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.430357    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b8a610-4b35-405a-8394-6977f3d78e0f-kube-api-access-xc42l" (OuterVolumeSpecName: "kube-api-access-xc42l") pod "13b8a610-4b35-405a-8394-6977f3d78e0f" (UID: "13b8a610-4b35-405a-8394-6977f3d78e0f"). InnerVolumeSpecName "kube-api-access-xc42l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:14:56.529481 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.529444    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc42l\" (UniqueName: \"kubernetes.io/projected/13b8a610-4b35-405a-8394-6977f3d78e0f-kube-api-access-xc42l\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:14:56.982262 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.982230    2572 generic.go:358] "Generic (PLEG): container finished" podID="13b8a610-4b35-405a-8394-6977f3d78e0f" containerID="0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6" exitCode=0
May 25 06:14:56.982425 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.982301    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"
May 25 06:14:56.982425 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.982309    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6" event={"ID":"13b8a610-4b35-405a-8394-6977f3d78e0f","Type":"ContainerDied","Data":"0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6"}
May 25 06:14:56.982425 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.982348    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6" event={"ID":"13b8a610-4b35-405a-8394-6977f3d78e0f","Type":"ContainerDied","Data":"f4d60aaaf149ea6f9b2d8d33336ac955bf5359fadc26996032230682f10f7cd5"}
May 25 06:14:56.982425 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.982364    2572 scope.go:117] "RemoveContainer" containerID="0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6"
May 25 06:14:56.989996 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.989978    2572 scope.go:117] "RemoveContainer" containerID="0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6"
May 25 06:14:56.990275 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:14:56.990248    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6\": container with ID starting with 0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6 not found: ID does not exist" containerID="0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6"
May 25 06:14:56.990415 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:56.990284    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6"} err="failed to get container status \"0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6\": rpc error: code = NotFound desc = could not find container \"0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6\": container with ID starting with 0a4219aeaec39c0da77e4d848518e78bdc18147ad18cda54bb160ccb7fb05ba6 not found: ID does not exist"
May 25 06:14:57.001677 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:57.001656    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"]
May 25 06:14:57.005149 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:57.005127    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-65f788cfc7-nsts6"]
May 25 06:14:58.221466 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:14:58.221434    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13b8a610-4b35-405a-8394-6977f3d78e0f" path="/var/lib/kubelet/pods/13b8a610-4b35-405a-8394-6977f3d78e0f/volumes"
May 25 06:15:07.081492 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081460    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"]
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081709    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b8a610-4b35-405a-8394-6977f3d78e0f" containerName="manager"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081723    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b8a610-4b35-405a-8394-6977f3d78e0f" containerName="manager"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081736    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f8577e-51dc-4fd0-a22f-5e71706db2b8" containerName="redis"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081742    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f8577e-51dc-4fd0-a22f-5e71706db2b8" containerName="redis"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081751    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="489cd255-128a-4028-a9de-412f3c2e5289" containerName="feast-1"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081758    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="489cd255-128a-4028-a9de-412f3c2e5289" containerName="feast-1"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081766    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="489cd255-128a-4028-a9de-412f3c2e5289" containerName="feast-0"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081771    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="489cd255-128a-4028-a9de-412f3c2e5289" containerName="feast-0"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081821    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0f8577e-51dc-4fd0-a22f-5e71706db2b8" containerName="redis"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081829    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="489cd255-128a-4028-a9de-412f3c2e5289" containerName="feast-1"
May 25 06:15:07.081883 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.081835    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="13b8a610-4b35-405a-8394-6977f3d78e0f" containerName="manager"
May 25 06:15:07.084568 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.084548    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"
May 25 06:15:07.088273 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.088256    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 25 06:15:07.088489 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.088472    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 25 06:15:07.088614 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.088472    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-qv9gd\""
May 25 06:15:07.096646 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.096625    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"]
May 25 06:15:07.195963 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.195937    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcp8\" (UniqueName: \"kubernetes.io/projected/2f8747a1-77ed-4a96-9a59-330e98984132-kube-api-access-mkcp8\") pod \"feast-operator-controller-manager-cf99db75-hfwqr\" (UID: \"2f8747a1-77ed-4a96-9a59-330e98984132\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"
May 25 06:15:07.296908 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.296885    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcp8\" (UniqueName: \"kubernetes.io/projected/2f8747a1-77ed-4a96-9a59-330e98984132-kube-api-access-mkcp8\") pod \"feast-operator-controller-manager-cf99db75-hfwqr\" (UID: \"2f8747a1-77ed-4a96-9a59-330e98984132\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"
May 25 06:15:07.306797 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.306773    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcp8\" (UniqueName: \"kubernetes.io/projected/2f8747a1-77ed-4a96-9a59-330e98984132-kube-api-access-mkcp8\") pod \"feast-operator-controller-manager-cf99db75-hfwqr\" (UID: \"2f8747a1-77ed-4a96-9a59-330e98984132\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"
May 25 06:15:07.394762 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.394705    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"
May 25 06:15:07.509935 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.509911    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"]
May 25 06:15:07.512231 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:15:07.512200    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8747a1_77ed_4a96_9a59_330e98984132.slice/crio-51072b69771d271c43bcdd9fd9dcfef7e0f9e031c27ea95fa1559675edb03ebf WatchSource:0}: Error finding container 51072b69771d271c43bcdd9fd9dcfef7e0f9e031c27ea95fa1559675edb03ebf: Status 404 returned error can't find the container with id 51072b69771d271c43bcdd9fd9dcfef7e0f9e031c27ea95fa1559675edb03ebf
May 25 06:15:07.514042 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:07.514024    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 06:15:08.012307 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:08.012270    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr" event={"ID":"2f8747a1-77ed-4a96-9a59-330e98984132","Type":"ContainerStarted","Data":"51072b69771d271c43bcdd9fd9dcfef7e0f9e031c27ea95fa1559675edb03ebf"}
May 25 06:15:10.017756 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:10.017722    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr" event={"ID":"2f8747a1-77ed-4a96-9a59-330e98984132","Type":"ContainerStarted","Data":"cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0"}
May 25 06:15:10.018106 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:10.017904    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"
May 25 06:15:10.036563 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:10.036514    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr" podStartSLOduration=1.071003774 podStartE2EDuration="3.036502286s" podCreationTimestamp="2026-05-25 06:15:07 +0000 UTC" firstStartedPulling="2026-05-25 06:15:07.514201523 +0000 UTC m=+1097.858819545" lastFinishedPulling="2026-05-25 06:15:09.479700041 +0000 UTC m=+1099.824318057" observedRunningTime="2026-05-25 06:15:10.034707488 +0000 UTC m=+1100.379325518" watchObservedRunningTime="2026-05-25 06:15:10.036502286 +0000 UTC m=+1100.381120315"
May 25 06:15:21.021955 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.021925    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"
May 25 06:15:21.877226 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.877193    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"]
May 25 06:15:21.881752 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.881733    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:21.884332 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.884298    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 25 06:15:21.884451 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.884378    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 25 06:15:21.884451 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.884422    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 25 06:15:21.884544 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.884535    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 25 06:15:21.884610 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.884581    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-wjmwr\""
May 25 06:15:21.884724 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.884706    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 25 06:15:21.885395 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.885382    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 25 06:15:21.890361 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.890342    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"]
May 25 06:15:21.993934 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.993890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:21.994120 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.993947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f1319f8-ee61-4b0c-9cb7-0c6862308712-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:21.994120 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.993998    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:21.994120 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.994025    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:21.994120 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.994050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zth2\" (UniqueName: \"kubernetes.io/projected/2f1319f8-ee61-4b0c-9cb7-0c6862308712-kube-api-access-4zth2\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:21.994120 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:21.994076    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.094920 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.094892    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.095348 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.094931    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f1319f8-ee61-4b0c-9cb7-0c6862308712-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.095348 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.094967    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.095348 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.094996    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.095348 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.095023    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zth2\" (UniqueName: \"kubernetes.io/projected/2f1319f8-ee61-4b0c-9cb7-0c6862308712-kube-api-access-4zth2\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.095348 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:15:22.095130    2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 25 06:15:22.095348 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:15:22.095196    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-offline-tls podName:2f1319f8-ee61-4b0c-9cb7-0c6862308712 nodeName:}" failed. No retries permitted until 2026-05-25 06:15:22.5951734 +0000 UTC m=+1112.939791409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-w6j5t" (UID: "2f1319f8-ee61-4b0c-9cb7-0c6862308712") : secret "feast-simple-feast-setup-offline-tls" not found
May 25 06:15:22.095348 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.095231    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.095724 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.095440    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f1319f8-ee61-4b0c-9cb7-0c6862308712-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.097407 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.097383    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.097497 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.097414    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.097497 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.097481    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.103804 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.103782    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zth2\" (UniqueName: \"kubernetes.io/projected/2f1319f8-ee61-4b0c-9cb7-0c6862308712-kube-api-access-4zth2\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.599122 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.599088    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.601405 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.601380    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-w6j5t\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.791344 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.791318    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:22.912815 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:22.912791    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"]
May 25 06:15:22.913650 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:15:22.913623    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f1319f8_ee61_4b0c_9cb7_0c6862308712.slice/crio-7534af647f4e52f9f9e29513978917188435deaecb1fe70b7de4b8f98e394de8 WatchSource:0}: Error finding container 7534af647f4e52f9f9e29513978917188435deaecb1fe70b7de4b8f98e394de8: Status 404 returned error can't find the container with id 7534af647f4e52f9f9e29513978917188435deaecb1fe70b7de4b8f98e394de8
May 25 06:15:23.051808 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:23.051781    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerStarted","Data":"7534af647f4e52f9f9e29513978917188435deaecb1fe70b7de4b8f98e394de8"}
May 25 06:15:38.098193 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:38.098149    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerStarted","Data":"813de0b0ea3666ffbf4ea4fad0e1a9fd4900a5c62f65a43ed8bcc25882780754"}
May 25 06:15:42.108645 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:42.108609    2572 generic.go:358] "Generic (PLEG): container finished" podID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerID="813de0b0ea3666ffbf4ea4fad0e1a9fd4900a5c62f65a43ed8bcc25882780754" exitCode=0
May 25 06:15:42.108956 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:42.108617    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerDied","Data":"813de0b0ea3666ffbf4ea4fad0e1a9fd4900a5c62f65a43ed8bcc25882780754"}
May 25 06:15:43.112616 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:43.112566    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerStarted","Data":"ed06c1c8ca6c00b0edf1af3c41e70738aadf3c310e4bc18d218a23363ea75b0e"}
May 25 06:15:48.126330 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:48.126297    2572 generic.go:358] "Generic (PLEG): container finished" podID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerID="ed06c1c8ca6c00b0edf1af3c41e70738aadf3c310e4bc18d218a23363ea75b0e" exitCode=0
May 25 06:15:48.126764 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:48.126375    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerDied","Data":"ed06c1c8ca6c00b0edf1af3c41e70738aadf3c310e4bc18d218a23363ea75b0e"}
May 25 06:15:49.133023 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.132980    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerStarted","Data":"2e29b3a78b3336a1d2e7a06ec63182bd4b59b5a7fda890b2bd6addaf0c2e8b86"}
May 25 06:15:49.133023 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.133029    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerStarted","Data":"f3519f3b48641cf147d3cddfc8ee047e8c849bcc2ae30a19ee7fe037467f0c31"}
May 25 06:15:49.133551 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.133044    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerStarted","Data":"057c3a87647c52fd82bcd37232e2102406ca639c3e7591d52e52c74f6f944ccc"}
May 25 06:15:49.133551 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.133060    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerStarted","Data":"2f684d3f1e4204641ca646cc5d028403032101f95cf284e5db2dfcda6287e663"}
May 25 06:15:49.157646 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.157561    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podStartSLOduration=13.442229865 podStartE2EDuration="28.157541664s" podCreationTimestamp="2026-05-25 06:15:21 +0000 UTC" firstStartedPulling="2026-05-25 06:15:22.915398281 +0000 UTC m=+1113.260016289" lastFinishedPulling="2026-05-25 06:15:37.63071008 +0000 UTC m=+1127.975328088" observedRunningTime="2026-05-25 06:15:49.155573007 +0000 UTC m=+1139.500191064" watchObservedRunningTime="2026-05-25 06:15:49.157541664 +0000 UTC m=+1139.502159695"
May 25 06:15:49.791625 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.791529    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:49.791625 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.791580    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:49.791625 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.791614    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:49.792075 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.792047    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:49.793541 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.793425    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 25 06:15:49.793541 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.793447    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 25 06:15:49.793541 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.793428    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 25 06:15:49.793541 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:49.793468    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused"
May 25 06:15:52.791556 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:52.791514    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:52.792130 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:52.792093    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:52.792130 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:52.792121    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:52.792130 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:52.792135    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:52.792368 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:52.791952    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused"
May 25 06:15:52.792368 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:52.791759    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 25 06:15:52.792368 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:52.791758    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 25 06:15:52.792368 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:52.791889    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 25 06:15:55.792888 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:55.792859    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:55.793327 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:55.793100    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:55.793327 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:55.793314    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:55.793610 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:55.793573    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:55.793683 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:55.793654    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:55.797567 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:55.797550    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:56.157180 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:56.157104    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:15:57.157950 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:15:57.157924    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:16:50.235304 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:50.235280    2572 scope.go:117] "RemoveContainer" containerID="2f264d2565d5879929bab9294281e9dd30290f6cb3cee1690484b849caf30516"
May 25 06:16:50.241775 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:50.241755    2572 scope.go:117] "RemoveContainer" containerID="d359f332faccc792e9ffad64aed905cff227397a1169f34b91047dcbbf18aee8"
May 25 06:16:59.136784 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.136757    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"]
May 25 06:16:59.137334 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.137076    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="registry" containerID="cri-o://2f684d3f1e4204641ca646cc5d028403032101f95cf284e5db2dfcda6287e663" gracePeriod=30
May 25 06:16:59.137334 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.137139    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="online" containerID="cri-o://057c3a87647c52fd82bcd37232e2102406ca639c3e7591d52e52c74f6f944ccc" gracePeriod=30
May 25 06:16:59.137334 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.137155    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="offline" containerID="cri-o://f3519f3b48641cf147d3cddfc8ee047e8c849bcc2ae30a19ee7fe037467f0c31" gracePeriod=30
May 25 06:16:59.137334 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.137123    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="ui" containerID="cri-o://2e29b3a78b3336a1d2e7a06ec63182bd4b59b5a7fda890b2bd6addaf0c2e8b86" gracePeriod=30
May 25 06:16:59.492116 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.492025    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"]
May 25 06:16:59.496908 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.496880    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.499458 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.499438    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-fqf4l\""
May 25 06:16:59.505966 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.505109    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"]
May 25 06:16:59.598371 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.598337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d44a6a20-b604-4bf5-906e-501d2e8adb32-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.598371 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.598386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.598560 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.598405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.598560 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.598512    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chvdg\" (UniqueName: \"kubernetes.io/projected/d44a6a20-b604-4bf5-906e-501d2e8adb32-kube-api-access-chvdg\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.598666 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.598567    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.598666 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.598623    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.699084 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.699052    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d44a6a20-b604-4bf5-906e-501d2e8adb32-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.699267 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.699098    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.699267 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.699120    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.699267 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.699157    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chvdg\" (UniqueName: \"kubernetes.io/projected/d44a6a20-b604-4bf5-906e-501d2e8adb32-kube-api-access-chvdg\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.699267 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.699189    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.699267 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.699218    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.699519 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.699482    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d44a6a20-b604-4bf5-906e-501d2e8adb32-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.702347 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.702319    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.702457 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.702319    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.702457 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.702380    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.702457 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.702416    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.706666 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.706642    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chvdg\" (UniqueName: \"kubernetes.io/projected/d44a6a20-b604-4bf5-906e-501d2e8adb32-kube-api-access-chvdg\") pod \"feast-simple-feast-setup-664fcfcc58-vgmsz\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.808302 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.808277    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:16:59.931199 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:16:59.931167    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"]
May 25 06:16:59.934000 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:16:59.933975    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd44a6a20_b604_4bf5_906e_501d2e8adb32.slice/crio-94adae0b3ca4fc9be007327add064d789368a1b309363e19c8113c4467793d43 WatchSource:0}: Error finding container 94adae0b3ca4fc9be007327add064d789368a1b309363e19c8113c4467793d43: Status 404 returned error can't find the container with id 94adae0b3ca4fc9be007327add064d789368a1b309363e19c8113c4467793d43
May 25 06:17:00.313996 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:00.313964    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerStarted","Data":"8edfced14a106a50a8f89c9d64107e6c1c21a08fea0c07451c2e600301940bec"}
May 25 06:17:00.313996 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:00.314001    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerStarted","Data":"94adae0b3ca4fc9be007327add064d789368a1b309363e19c8113c4467793d43"}
May 25 06:17:00.316557 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:00.316535    2572 generic.go:358] "Generic (PLEG): container finished" podID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerID="2e29b3a78b3336a1d2e7a06ec63182bd4b59b5a7fda890b2bd6addaf0c2e8b86" exitCode=0
May 25 06:17:00.316557 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:00.316554    2572 generic.go:358] "Generic (PLEG): container finished" podID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerID="057c3a87647c52fd82bcd37232e2102406ca639c3e7591d52e52c74f6f944ccc" exitCode=0
May 25 06:17:00.316715 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:00.316585    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerDied","Data":"2e29b3a78b3336a1d2e7a06ec63182bd4b59b5a7fda890b2bd6addaf0c2e8b86"}
May 25 06:17:00.316715 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:00.316621    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerDied","Data":"057c3a87647c52fd82bcd37232e2102406ca639c3e7591d52e52c74f6f944ccc"}
May 25 06:17:05.331927 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:05.331888    2572 generic.go:358] "Generic (PLEG): container finished" podID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerID="8edfced14a106a50a8f89c9d64107e6c1c21a08fea0c07451c2e600301940bec" exitCode=0
May 25 06:17:05.332371 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:05.331959    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerDied","Data":"8edfced14a106a50a8f89c9d64107e6c1c21a08fea0c07451c2e600301940bec"}
May 25 06:17:05.793534 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:05.793491    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 25 06:17:06.155061 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:06.154970    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 25 06:17:06.339194 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:06.339154    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerStarted","Data":"f7b7670b01f677f41068f092d829851b4c36462bbf87bb61a7e6c50a5b994067"}
May 25 06:17:11.353658 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:11.353624    2572 generic.go:358] "Generic (PLEG): container finished" podID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerID="f7b7670b01f677f41068f092d829851b4c36462bbf87bb61a7e6c50a5b994067" exitCode=0
May 25 06:17:11.354000 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:11.353677    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerDied","Data":"f7b7670b01f677f41068f092d829851b4c36462bbf87bb61a7e6c50a5b994067"}
May 25 06:17:12.360825 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:12.360770    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerStarted","Data":"b0be7efc794f6fb96c5128a90dc5fb2bf4a2a36ca4ad96866a37eb4cf0aa592d"}
May 25 06:17:12.360825 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:12.360830    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerStarted","Data":"74853aa3d9c15daaf1c1122ec2b6d06d50e6a05c835d79813052892322518d81"}
May 25 06:17:12.361477 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:12.360845    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerStarted","Data":"13977c764a2e38d2143ea0ffce1c6ad916a1f17d6f6075feaa4fa070a48aa16f"}
May 25 06:17:12.361477 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:12.360858    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerStarted","Data":"8fcaa2f4057ae429956ef57b7f79eb7cef6e021d2691e7bf0c92d568ceaaa5ad"}
May 25 06:17:12.384102 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:12.384044    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podStartSLOduration=13.384023505 podStartE2EDuration="13.384023505s" podCreationTimestamp="2026-05-25 06:16:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:17:12.383006603 +0000 UTC m=+1222.727624655" watchObservedRunningTime="2026-05-25 06:17:12.384023505 +0000 UTC m=+1222.728641538"
May 25 06:17:14.808541 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:14.808505    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:14.809028 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:14.808555    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:14.809028 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:14.808569    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:14.809028 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:14.808625    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:14.810459 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:14.810418    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.18:6571: connect: connection refused"
May 25 06:17:14.810459 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:14.810437    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.18:8816: connect: connection refused"
May 25 06:17:14.810686 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:14.810429    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 25 06:17:14.810686 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:14.810486    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 25 06:17:15.794407 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:15.794361    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 25 06:17:16.154922 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:16.154813    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 25 06:17:17.810043 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:17.810004    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:17.810642 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:17.810610    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:17.810800 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:17.810787    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:17.810855 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:17.810809    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:17.810922 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:17.810901    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:17.814794 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:17.814774    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:18.380633 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:18.380606    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:18.380810 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:18.380644    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:18.380810 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:18.380658    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:18.381023 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:18.380996    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:18.381103 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:18.381090    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:18.383352 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:18.383334    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:17:25.793768 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:25.793725    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused"
May 25 06:17:25.794169 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:25.793852    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:17:26.155027 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:26.154948    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 25 06:17:26.155159 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:26.155053    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:17:29.409621 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.409520    2572 generic.go:358] "Generic (PLEG): container finished" podID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerID="f3519f3b48641cf147d3cddfc8ee047e8c849bcc2ae30a19ee7fe037467f0c31" exitCode=137
May 25 06:17:29.409621 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.409549    2572 generic.go:358] "Generic (PLEG): container finished" podID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerID="2f684d3f1e4204641ca646cc5d028403032101f95cf284e5db2dfcda6287e663" exitCode=137
May 25 06:17:29.409621 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.409576    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerDied","Data":"f3519f3b48641cf147d3cddfc8ee047e8c849bcc2ae30a19ee7fe037467f0c31"}
May 25 06:17:29.410013 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.409631    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerDied","Data":"2f684d3f1e4204641ca646cc5d028403032101f95cf284e5db2dfcda6287e663"}
May 25 06:17:29.781485 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.781464    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:17:29.927845 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.927823    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-ui-tls\") pod \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") "
May 25 06:17:29.927960 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.927851    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-offline-tls\") pod \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") "
May 25 06:17:29.927960 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.927874    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f1319f8-ee61-4b0c-9cb7-0c6862308712-feast-data\") pod \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") "
May 25 06:17:29.927960 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.927945    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-online-tls\") pod \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") "
May 25 06:17:29.928105 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.927990    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zth2\" (UniqueName: \"kubernetes.io/projected/2f1319f8-ee61-4b0c-9cb7-0c6862308712-kube-api-access-4zth2\") pod \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") "
May 25 06:17:29.928105 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.928017    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-registry-tls\") pod \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\" (UID: \"2f1319f8-ee61-4b0c-9cb7-0c6862308712\") "
May 25 06:17:29.928422 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.928387    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f1319f8-ee61-4b0c-9cb7-0c6862308712-feast-data" (OuterVolumeSpecName: "feast-data") pod "2f1319f8-ee61-4b0c-9cb7-0c6862308712" (UID: "2f1319f8-ee61-4b0c-9cb7-0c6862308712"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:17:29.930153 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.930120    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2f1319f8-ee61-4b0c-9cb7-0c6862308712" (UID: "2f1319f8-ee61-4b0c-9cb7-0c6862308712"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:17:29.930246 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.930168    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-online-tls" (OuterVolumeSpecName: "online-tls") pod "2f1319f8-ee61-4b0c-9cb7-0c6862308712" (UID: "2f1319f8-ee61-4b0c-9cb7-0c6862308712"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:17:29.930246 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.930213    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2f1319f8-ee61-4b0c-9cb7-0c6862308712" (UID: "2f1319f8-ee61-4b0c-9cb7-0c6862308712"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:17:29.930474 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.930452    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f1319f8-ee61-4b0c-9cb7-0c6862308712-kube-api-access-4zth2" (OuterVolumeSpecName: "kube-api-access-4zth2") pod "2f1319f8-ee61-4b0c-9cb7-0c6862308712" (UID: "2f1319f8-ee61-4b0c-9cb7-0c6862308712"). InnerVolumeSpecName "kube-api-access-4zth2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:17:29.930509 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:29.930453    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2f1319f8-ee61-4b0c-9cb7-0c6862308712" (UID: "2f1319f8-ee61-4b0c-9cb7-0c6862308712"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:17:30.028872 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.028810    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-online-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:17:30.028872 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.028840    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zth2\" (UniqueName: \"kubernetes.io/projected/2f1319f8-ee61-4b0c-9cb7-0c6862308712-kube-api-access-4zth2\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:17:30.028872 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.028850    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-registry-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:17:30.028872 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.028860    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-ui-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:17:30.028872 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.028868    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f1319f8-ee61-4b0c-9cb7-0c6862308712-offline-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:17:30.028872 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.028876    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f1319f8-ee61-4b0c-9cb7-0c6862308712-feast-data\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:17:30.414557 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.414533    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"
May 25 06:17:30.414902 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.414530    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t" event={"ID":"2f1319f8-ee61-4b0c-9cb7-0c6862308712","Type":"ContainerDied","Data":"7534af647f4e52f9f9e29513978917188435deaecb1fe70b7de4b8f98e394de8"}
May 25 06:17:30.414902 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.414640    2572 scope.go:117] "RemoveContainer" containerID="2e29b3a78b3336a1d2e7a06ec63182bd4b59b5a7fda890b2bd6addaf0c2e8b86"
May 25 06:17:30.425424 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.425382    2572 scope.go:117] "RemoveContainer" containerID="f3519f3b48641cf147d3cddfc8ee047e8c849bcc2ae30a19ee7fe037467f0c31"
May 25 06:17:30.433636 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.433607    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"]
May 25 06:17:30.435127 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.435094    2572 scope.go:117] "RemoveContainer" containerID="057c3a87647c52fd82bcd37232e2102406ca639c3e7591d52e52c74f6f944ccc"
May 25 06:17:30.437215 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.437194    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-w6j5t"]
May 25 06:17:30.442125 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.442112    2572 scope.go:117] "RemoveContainer" containerID="2f684d3f1e4204641ca646cc5d028403032101f95cf284e5db2dfcda6287e663"
May 25 06:17:30.448140 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.448121    2572 scope.go:117] "RemoveContainer" containerID="ed06c1c8ca6c00b0edf1af3c41e70738aadf3c310e4bc18d218a23363ea75b0e"
May 25 06:17:30.454209 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:30.454190    2572 scope.go:117] "RemoveContainer" containerID="813de0b0ea3666ffbf4ea4fad0e1a9fd4900a5c62f65a43ed8bcc25882780754"
May 25 06:17:32.221807 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:17:32.221776    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" path="/var/lib/kubelet/pods/2f1319f8-ee61-4b0c-9cb7-0c6862308712/volumes"
May 25 06:18:21.241258 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241222    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"]
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241469    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="online"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241479    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="online"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241494    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="feast-init"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241499    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="feast-init"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241507    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="feast-apply"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241513    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="feast-apply"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241524    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="registry"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241529    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="registry"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241536    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="offline"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241541    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="offline"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241549    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="ui"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241554    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="ui"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241606    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="offline"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241618    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="online"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241626    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="registry"
May 25 06:18:21.241693 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.241632    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f1319f8-ee61-4b0c-9cb7-0c6862308712" containerName="ui"
May 25 06:18:21.244784 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.244768    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.248225 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.248205    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 25 06:18:21.249568 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.249550    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 25 06:18:21.249700 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.249613    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-nn7tg\""
May 25 06:18:21.249700 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.249641    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 25 06:18:21.249700 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.249653    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 25 06:18:21.255092 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.255074    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 25 06:18:21.255926 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.255912    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 25 06:18:21.262985 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.262961    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"]
May 25 06:18:21.350971 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.350950    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d172b4c-a4e9-447f-89e7-d8e01d05a080-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.351081 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.350985    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.351081 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.351016    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.351160 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.351123    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk765\" (UniqueName: \"kubernetes.io/projected/3d172b4c-a4e9-447f-89e7-d8e01d05a080-kube-api-access-pk765\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.351210 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.351159    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d172b4c-a4e9-447f-89e7-d8e01d05a080-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.351265 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.351246    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.451798 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.451770    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.451999 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.451822    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pk765\" (UniqueName: \"kubernetes.io/projected/3d172b4c-a4e9-447f-89e7-d8e01d05a080-kube-api-access-pk765\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.451999 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.451853    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d172b4c-a4e9-447f-89e7-d8e01d05a080-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.451999 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.451898    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.451999 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.451942    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d172b4c-a4e9-447f-89e7-d8e01d05a080-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.451999 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.451968    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.452298 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.452275    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d172b4c-a4e9-447f-89e7-d8e01d05a080-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.452648 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.452627    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d172b4c-a4e9-447f-89e7-d8e01d05a080-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.454166 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.454140    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.454241 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.454182    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.454279 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.454243    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.459471 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.459450    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk765\" (UniqueName: \"kubernetes.io/projected/3d172b4c-a4e9-447f-89e7-d8e01d05a080-kube-api-access-pk765\") pod \"feast-simple-feast-remote-setup-5cff94746b-6ttwr\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.553159 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.553139    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:21.673377 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:21.673352    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"]
May 25 06:18:21.675751 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:18:21.675724    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d172b4c_a4e9_447f_89e7_d8e01d05a080.slice/crio-f3e08c0de8e313f1289373adf049a947f1bb651fb0e57b077fdbc2bde2f4c67b WatchSource:0}: Error finding container f3e08c0de8e313f1289373adf049a947f1bb651fb0e57b077fdbc2bde2f4c67b: Status 404 returned error can't find the container with id f3e08c0de8e313f1289373adf049a947f1bb651fb0e57b077fdbc2bde2f4c67b
May 25 06:18:22.544348 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:22.544314    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerStarted","Data":"23332c4ed52186bde98b0cc674f8bf880864bea8c6ab335881f5abde14f01f0c"}
May 25 06:18:22.544348 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:22.544351    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerStarted","Data":"f3e08c0de8e313f1289373adf049a947f1bb651fb0e57b077fdbc2bde2f4c67b"}
May 25 06:18:26.558507 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:26.558477    2572 generic.go:358] "Generic (PLEG): container finished" podID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerID="23332c4ed52186bde98b0cc674f8bf880864bea8c6ab335881f5abde14f01f0c" exitCode=0
May 25 06:18:26.558865 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:26.558524    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerDied","Data":"23332c4ed52186bde98b0cc674f8bf880864bea8c6ab335881f5abde14f01f0c"}
May 25 06:18:27.562417 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:27.562383    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerStarted","Data":"1dd1d81bfd5ca69dc315edd44de83df874332e77341d43d53f70013d4bb916b3"}
May 25 06:18:32.577575 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:32.577533    2572 generic.go:358] "Generic (PLEG): container finished" podID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerID="1dd1d81bfd5ca69dc315edd44de83df874332e77341d43d53f70013d4bb916b3" exitCode=0
May 25 06:18:32.577983 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:32.577600    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerDied","Data":"1dd1d81bfd5ca69dc315edd44de83df874332e77341d43d53f70013d4bb916b3"}
May 25 06:18:33.583211 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:33.583172    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerStarted","Data":"52de0d36bb47c297ade38a15e871b3951256354e918ebabe96926cbde01ac146"}
May 25 06:18:33.583606 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:33.583222    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerStarted","Data":"969872deac2f231f75391e1b6c56105f488dad079154878550814f5e3dcf3e9a"}
May 25 06:18:33.583606 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:33.583237    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerStarted","Data":"e630d06e1d6bb91b313709dc557821652ea36c7bd620f26e2e187d36578ca832"}
May 25 06:18:33.605847 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:33.605798    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podStartSLOduration=12.6057821 podStartE2EDuration="12.6057821s" podCreationTimestamp="2026-05-25 06:18:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:18:33.604558504 +0000 UTC m=+1303.949176536" watchObservedRunningTime="2026-05-25 06:18:33.6057821 +0000 UTC m=+1303.950400166"
May 25 06:18:36.554015 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:36.553932    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:36.554015 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:36.553990    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:36.554015 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:36.554006    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:36.555662 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:36.555624    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.19:8816: connect: connection refused"
May 25 06:18:36.555800 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:36.555673    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 25 06:18:36.555800 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:36.555672    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 25 06:18:39.554576 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:39.554546    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:39.555013 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:39.554934    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:39.555013 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:39.554968    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:39.555013 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:39.554983    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:39.555371 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:39.555351    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:39.555468 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:39.555393    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:39.558723 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:39.558708    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:39.601791 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:39.601767    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:18:39.604385 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:18:39.604366    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:19:42.507720 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:42.507690    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"]
May 25 06:19:42.508169 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:42.508029    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="online" containerID="cri-o://e630d06e1d6bb91b313709dc557821652ea36c7bd620f26e2e187d36578ca832" gracePeriod=30
May 25 06:19:42.508169 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:42.508071    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="ui" containerID="cri-o://52de0d36bb47c297ade38a15e871b3951256354e918ebabe96926cbde01ac146" gracePeriod=30
May 25 06:19:42.508169 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:42.508079    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="offline" containerID="cri-o://969872deac2f231f75391e1b6c56105f488dad079154878550814f5e3dcf3e9a" gracePeriod=30
May 25 06:19:42.620150 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:42.620119    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"]
May 25 06:19:42.620792 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:42.620506    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="registry" containerID="cri-o://8fcaa2f4057ae429956ef57b7f79eb7cef6e021d2691e7bf0c92d568ceaaa5ad" gracePeriod=30
May 25 06:19:42.620939 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:42.620919    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="ui" containerID="cri-o://b0be7efc794f6fb96c5128a90dc5fb2bf4a2a36ca4ad96866a37eb4cf0aa592d" gracePeriod=30
May 25 06:19:42.621018 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:42.620935    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="offline" containerID="cri-o://74853aa3d9c15daaf1c1122ec2b6d06d50e6a05c835d79813052892322518d81" gracePeriod=30
May 25 06:19:42.621018 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:42.620955    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="online" containerID="cri-o://13977c764a2e38d2143ea0ffce1c6ad916a1f17d6f6075feaa4fa070a48aa16f" gracePeriod=30
May 25 06:19:43.768966 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:43.768937    2572 generic.go:358] "Generic (PLEG): container finished" podID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerID="52de0d36bb47c297ade38a15e871b3951256354e918ebabe96926cbde01ac146" exitCode=0
May 25 06:19:43.768966 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:43.768964    2572 generic.go:358] "Generic (PLEG): container finished" podID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerID="e630d06e1d6bb91b313709dc557821652ea36c7bd620f26e2e187d36578ca832" exitCode=0
May 25 06:19:43.769394 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:43.769008    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerDied","Data":"52de0d36bb47c297ade38a15e871b3951256354e918ebabe96926cbde01ac146"}
May 25 06:19:43.769394 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:43.769043    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerDied","Data":"e630d06e1d6bb91b313709dc557821652ea36c7bd620f26e2e187d36578ca832"}
May 25 06:19:43.771491 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:43.771472    2572 generic.go:358] "Generic (PLEG): container finished" podID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerID="b0be7efc794f6fb96c5128a90dc5fb2bf4a2a36ca4ad96866a37eb4cf0aa592d" exitCode=0
May 25 06:19:43.771491 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:43.771489    2572 generic.go:358] "Generic (PLEG): container finished" podID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerID="13977c764a2e38d2143ea0ffce1c6ad916a1f17d6f6075feaa4fa070a48aa16f" exitCode=0
May 25 06:19:43.771663 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:43.771520    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerDied","Data":"b0be7efc794f6fb96c5128a90dc5fb2bf4a2a36ca4ad96866a37eb4cf0aa592d"}
May 25 06:19:43.771663 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:43.771544    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerDied","Data":"13977c764a2e38d2143ea0ffce1c6ad916a1f17d6f6075feaa4fa070a48aa16f"}
May 25 06:19:48.381484 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:48.381448    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 25 06:19:48.381484 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:48.381474    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 25 06:19:49.555638 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:49.555571    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 25 06:19:49.602754 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:49.602721    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 25 06:19:58.381196 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:58.381155    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 25 06:19:58.381678 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:58.381202    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 25 06:19:59.556110 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:59.556066    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 25 06:19:59.602262 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:19:59.602221    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 25 06:20:08.381036 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:08.380987    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
May 25 06:20:08.381036 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:08.381017    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 25 06:20:08.381461 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:08.381098    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:20:08.381461 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:08.381141    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:20:09.555999 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:09.555950    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
May 25 06:20:09.556381 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:09.556116    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:20:09.602017 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:09.601990    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 25 06:20:09.602139 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:09.602081    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:20:12.849828 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:12.849797    2572 generic.go:358] "Generic (PLEG): container finished" podID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerID="74853aa3d9c15daaf1c1122ec2b6d06d50e6a05c835d79813052892322518d81" exitCode=137
May 25 06:20:12.849828 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:12.849823    2572 generic.go:358] "Generic (PLEG): container finished" podID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerID="8fcaa2f4057ae429956ef57b7f79eb7cef6e021d2691e7bf0c92d568ceaaa5ad" exitCode=137
May 25 06:20:12.850233 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:12.849870    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerDied","Data":"74853aa3d9c15daaf1c1122ec2b6d06d50e6a05c835d79813052892322518d81"}
May 25 06:20:12.850233 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:12.849902    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerDied","Data":"8fcaa2f4057ae429956ef57b7f79eb7cef6e021d2691e7bf0c92d568ceaaa5ad"}
May 25 06:20:12.851940 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:12.851921    2572 generic.go:358] "Generic (PLEG): container finished" podID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerID="969872deac2f231f75391e1b6c56105f488dad079154878550814f5e3dcf3e9a" exitCode=137
May 25 06:20:12.852045 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:12.851994    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerDied","Data":"969872deac2f231f75391e1b6c56105f488dad079154878550814f5e3dcf3e9a"}
May 25 06:20:13.159007 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.158982    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:20:13.260916 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.260893    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:20:13.298927 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.298906    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d172b4c-a4e9-447f-89e7-d8e01d05a080-feast-data\") pod \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") "
May 25 06:20:13.299059 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.298950    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-offline-tls\") pod \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") "
May 25 06:20:13.299059 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.298978    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk765\" (UniqueName: \"kubernetes.io/projected/3d172b4c-a4e9-447f-89e7-d8e01d05a080-kube-api-access-pk765\") pod \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") "
May 25 06:20:13.299059 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.299005    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-ui-tls\") pod \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") "
May 25 06:20:13.299211 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.299059    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-online-tls\") pod \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") "
May 25 06:20:13.299431 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.299397    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d172b4c-a4e9-447f-89e7-d8e01d05a080-registry-tls\") pod \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\" (UID: \"3d172b4c-a4e9-447f-89e7-d8e01d05a080\") "
May 25 06:20:13.299553 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.299461    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d172b4c-a4e9-447f-89e7-d8e01d05a080-feast-data" (OuterVolumeSpecName: "feast-data") pod "3d172b4c-a4e9-447f-89e7-d8e01d05a080" (UID: "3d172b4c-a4e9-447f-89e7-d8e01d05a080"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:20:13.299652 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.299637    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d172b4c-a4e9-447f-89e7-d8e01d05a080-feast-data\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.300055 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.300028    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d172b4c-a4e9-447f-89e7-d8e01d05a080-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3d172b4c-a4e9-447f-89e7-d8e01d05a080" (UID: "3d172b4c-a4e9-447f-89e7-d8e01d05a080"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:20:13.301295 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.301272    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3d172b4c-a4e9-447f-89e7-d8e01d05a080" (UID: "3d172b4c-a4e9-447f-89e7-d8e01d05a080"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:20:13.301419 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.301402    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3d172b4c-a4e9-447f-89e7-d8e01d05a080" (UID: "3d172b4c-a4e9-447f-89e7-d8e01d05a080"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:20:13.301483 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.301464    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d172b4c-a4e9-447f-89e7-d8e01d05a080-kube-api-access-pk765" (OuterVolumeSpecName: "kube-api-access-pk765") pod "3d172b4c-a4e9-447f-89e7-d8e01d05a080" (UID: "3d172b4c-a4e9-447f-89e7-d8e01d05a080"). InnerVolumeSpecName "kube-api-access-pk765". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:20:13.301840 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.301822    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-online-tls" (OuterVolumeSpecName: "online-tls") pod "3d172b4c-a4e9-447f-89e7-d8e01d05a080" (UID: "3d172b4c-a4e9-447f-89e7-d8e01d05a080"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:20:13.400174 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400120    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-online-tls\") pod \"d44a6a20-b604-4bf5-906e-501d2e8adb32\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") "
May 25 06:20:13.400174 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400146    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-registry-tls\") pod \"d44a6a20-b604-4bf5-906e-501d2e8adb32\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") "
May 25 06:20:13.400174 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400172    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d44a6a20-b604-4bf5-906e-501d2e8adb32-feast-data\") pod \"d44a6a20-b604-4bf5-906e-501d2e8adb32\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") "
May 25 06:20:13.400385 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400195    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-ui-tls\") pod \"d44a6a20-b604-4bf5-906e-501d2e8adb32\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") "
May 25 06:20:13.400385 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400265    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chvdg\" (UniqueName: \"kubernetes.io/projected/d44a6a20-b604-4bf5-906e-501d2e8adb32-kube-api-access-chvdg\") pod \"d44a6a20-b604-4bf5-906e-501d2e8adb32\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") "
May 25 06:20:13.400385 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400310    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-offline-tls\") pod \"d44a6a20-b604-4bf5-906e-501d2e8adb32\" (UID: \"d44a6a20-b604-4bf5-906e-501d2e8adb32\") "
May 25 06:20:13.400541 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400494    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk765\" (UniqueName: \"kubernetes.io/projected/3d172b4c-a4e9-447f-89e7-d8e01d05a080-kube-api-access-pk765\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.400541 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400516    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-ui-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.400541 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400534    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-online-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.400721 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400549    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d172b4c-a4e9-447f-89e7-d8e01d05a080-registry-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.400721 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400562    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d172b4c-a4e9-447f-89e7-d8e01d05a080-offline-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.400721 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.400700    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d44a6a20-b604-4bf5-906e-501d2e8adb32-feast-data" (OuterVolumeSpecName: "feast-data") pod "d44a6a20-b604-4bf5-906e-501d2e8adb32" (UID: "d44a6a20-b604-4bf5-906e-501d2e8adb32"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:20:13.402079 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.402050    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d44a6a20-b604-4bf5-906e-501d2e8adb32" (UID: "d44a6a20-b604-4bf5-906e-501d2e8adb32"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:20:13.402211 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.402110    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d44a6a20-b604-4bf5-906e-501d2e8adb32" (UID: "d44a6a20-b604-4bf5-906e-501d2e8adb32"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:20:13.402257 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.402238    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d44a6a20-b604-4bf5-906e-501d2e8adb32" (UID: "d44a6a20-b604-4bf5-906e-501d2e8adb32"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:20:13.402484 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.402465    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-online-tls" (OuterVolumeSpecName: "online-tls") pod "d44a6a20-b604-4bf5-906e-501d2e8adb32" (UID: "d44a6a20-b604-4bf5-906e-501d2e8adb32"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:20:13.402540 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.402476    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d44a6a20-b604-4bf5-906e-501d2e8adb32-kube-api-access-chvdg" (OuterVolumeSpecName: "kube-api-access-chvdg") pod "d44a6a20-b604-4bf5-906e-501d2e8adb32" (UID: "d44a6a20-b604-4bf5-906e-501d2e8adb32"). InnerVolumeSpecName "kube-api-access-chvdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:20:13.500856 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.500831    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-ui-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.500959 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.500858    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chvdg\" (UniqueName: \"kubernetes.io/projected/d44a6a20-b604-4bf5-906e-501d2e8adb32-kube-api-access-chvdg\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.500959 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.500873    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-offline-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.500959 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.500885    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-online-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.500959 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.500898    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d44a6a20-b604-4bf5-906e-501d2e8adb32-registry-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.500959 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.500909    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d44a6a20-b604-4bf5-906e-501d2e8adb32-feast-data\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:13.856736 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.856699    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz" event={"ID":"d44a6a20-b604-4bf5-906e-501d2e8adb32","Type":"ContainerDied","Data":"94adae0b3ca4fc9be007327add064d789368a1b309363e19c8113c4467793d43"}
May 25 06:20:13.857130 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.856736    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"
May 25 06:20:13.857130 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.856752    2572 scope.go:117] "RemoveContainer" containerID="b0be7efc794f6fb96c5128a90dc5fb2bf4a2a36ca4ad96866a37eb4cf0aa592d"
May 25 06:20:13.858889 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.858868    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr" event={"ID":"3d172b4c-a4e9-447f-89e7-d8e01d05a080","Type":"ContainerDied","Data":"f3e08c0de8e313f1289373adf049a947f1bb651fb0e57b077fdbc2bde2f4c67b"}
May 25 06:20:13.858985 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.858943    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"
May 25 06:20:13.864810 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.864790    2572 scope.go:117] "RemoveContainer" containerID="74853aa3d9c15daaf1c1122ec2b6d06d50e6a05c835d79813052892322518d81"
May 25 06:20:13.871824 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.871809    2572 scope.go:117] "RemoveContainer" containerID="13977c764a2e38d2143ea0ffce1c6ad916a1f17d6f6075feaa4fa070a48aa16f"
May 25 06:20:13.878494 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.878478    2572 scope.go:117] "RemoveContainer" containerID="8fcaa2f4057ae429956ef57b7f79eb7cef6e021d2691e7bf0c92d568ceaaa5ad"
May 25 06:20:13.884756 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.884741    2572 scope.go:117] "RemoveContainer" containerID="f7b7670b01f677f41068f092d829851b4c36462bbf87bb61a7e6c50a5b994067"
May 25 06:20:13.890721 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.890703    2572 scope.go:117] "RemoveContainer" containerID="8edfced14a106a50a8f89c9d64107e6c1c21a08fea0c07451c2e600301940bec"
May 25 06:20:13.895181 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.895161    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"]
May 25 06:20:13.897754 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.897740    2572 scope.go:117] "RemoveContainer" containerID="52de0d36bb47c297ade38a15e871b3951256354e918ebabe96926cbde01ac146"
May 25 06:20:13.901274 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.901251    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-vgmsz"]
May 25 06:20:13.904618 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.904584    2572 scope.go:117] "RemoveContainer" containerID="969872deac2f231f75391e1b6c56105f488dad079154878550814f5e3dcf3e9a"
May 25 06:20:13.910478 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.910464    2572 scope.go:117] "RemoveContainer" containerID="e630d06e1d6bb91b313709dc557821652ea36c7bd620f26e2e187d36578ca832"
May 25 06:20:13.916381 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.916364    2572 scope.go:117] "RemoveContainer" containerID="1dd1d81bfd5ca69dc315edd44de83df874332e77341d43d53f70013d4bb916b3"
May 25 06:20:13.922207 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.922192    2572 scope.go:117] "RemoveContainer" containerID="23332c4ed52186bde98b0cc674f8bf880864bea8c6ab335881f5abde14f01f0c"
May 25 06:20:13.926165 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.926146    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"]
May 25 06:20:13.932576 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:13.932558    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-6ttwr"]
May 25 06:20:14.221992 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:14.221922    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" path="/var/lib/kubelet/pods/3d172b4c-a4e9-447f-89e7-d8e01d05a080/volumes"
May 25 06:20:14.222440 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:14.222427    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" path="/var/lib/kubelet/pods/d44a6a20-b604-4bf5-906e-501d2e8adb32/volumes"
May 25 06:20:33.238563 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.238492    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"]
May 25 06:20:33.239068 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.238704    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr" podUID="2f8747a1-77ed-4a96-9a59-330e98984132" containerName="manager" containerID="cri-o://cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0" gracePeriod=10
May 25 06:20:33.475172 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.475150    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"
May 25 06:20:33.631468 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.631443    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkcp8\" (UniqueName: \"kubernetes.io/projected/2f8747a1-77ed-4a96-9a59-330e98984132-kube-api-access-mkcp8\") pod \"2f8747a1-77ed-4a96-9a59-330e98984132\" (UID: \"2f8747a1-77ed-4a96-9a59-330e98984132\") "
May 25 06:20:33.633455 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.633433    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8747a1-77ed-4a96-9a59-330e98984132-kube-api-access-mkcp8" (OuterVolumeSpecName: "kube-api-access-mkcp8") pod "2f8747a1-77ed-4a96-9a59-330e98984132" (UID: "2f8747a1-77ed-4a96-9a59-330e98984132"). InnerVolumeSpecName "kube-api-access-mkcp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:20:33.732346 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.732322    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkcp8\" (UniqueName: \"kubernetes.io/projected/2f8747a1-77ed-4a96-9a59-330e98984132-kube-api-access-mkcp8\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:20:33.912669 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.912582    2572 generic.go:358] "Generic (PLEG): container finished" podID="2f8747a1-77ed-4a96-9a59-330e98984132" containerID="cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0" exitCode=0
May 25 06:20:33.912669 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.912637    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr" event={"ID":"2f8747a1-77ed-4a96-9a59-330e98984132","Type":"ContainerDied","Data":"cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0"}
May 25 06:20:33.912669 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.912658    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr" event={"ID":"2f8747a1-77ed-4a96-9a59-330e98984132","Type":"ContainerDied","Data":"51072b69771d271c43bcdd9fd9dcfef7e0f9e031c27ea95fa1559675edb03ebf"}
May 25 06:20:33.912878 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.912670    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"
May 25 06:20:33.912878 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.912677    2572 scope.go:117] "RemoveContainer" containerID="cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0"
May 25 06:20:33.920307 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.920263    2572 scope.go:117] "RemoveContainer" containerID="cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0"
May 25 06:20:33.920642 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:20:33.920623    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0\": container with ID starting with cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0 not found: ID does not exist" containerID="cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0"
May 25 06:20:33.920720 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.920649    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0"} err="failed to get container status \"cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0\": rpc error: code = NotFound desc = could not find container \"cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0\": container with ID starting with cfa05ed6fb29e37cc5e4b6743abd99e0b08f286c11571fd68e3a8139d5b62bd0 not found: ID does not exist"
May 25 06:20:33.943890 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.943866    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"]
May 25 06:20:33.958470 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:33.958453    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-hfwqr"]
May 25 06:20:34.225673 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:34.225583    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f8747a1-77ed-4a96-9a59-330e98984132" path="/var/lib/kubelet/pods/2f8747a1-77ed-4a96-9a59-330e98984132/volumes"
May 25 06:20:39.253551 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253518    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"]
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253755    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="online"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253765    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="online"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253773    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="feast-init"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253779    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="feast-init"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253787    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="offline"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253792    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="offline"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253800    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="feast-apply"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253805    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="feast-apply"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253812    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="feast-apply"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253817    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="feast-apply"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253822    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="offline"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253827    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="offline"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253835    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="feast-init"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253840    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="feast-init"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253847    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="ui"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253853    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="ui"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253862    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="ui"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253867    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="ui"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253873    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="online"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253877    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="online"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253885    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f8747a1-77ed-4a96-9a59-330e98984132" containerName="manager"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253890    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8747a1-77ed-4a96-9a59-330e98984132" containerName="manager"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253898    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="registry"
May 25 06:20:39.253912 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253902    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="registry"
May 25 06:20:39.254611 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253934    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="ui"
May 25 06:20:39.254611 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253941    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f8747a1-77ed-4a96-9a59-330e98984132" containerName="manager"
May 25 06:20:39.254611 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253947    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="online"
May 25 06:20:39.254611 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253952    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="offline"
May 25 06:20:39.254611 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253960    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="offline"
May 25 06:20:39.254611 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253966    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="ui"
May 25 06:20:39.254611 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253971    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="d44a6a20-b604-4bf5-906e-501d2e8adb32" containerName="registry"
May 25 06:20:39.254611 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.253976    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d172b4c-a4e9-447f-89e7-d8e01d05a080" containerName="online"
May 25 06:20:39.256668 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.256651    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"
May 25 06:20:39.263962 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.263943    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-qv9gd\""
May 25 06:20:39.264070 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.263943    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 25 06:20:39.264070 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.263944    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 25 06:20:39.282748 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.282722    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"]
May 25 06:20:39.366262 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.366232    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n67wp\" (UniqueName: \"kubernetes.io/projected/9eea778d-a67a-4ea8-a8ce-3c02540d243c-kube-api-access-n67wp\") pod \"feast-operator-controller-manager-cf99db75-2bb99\" (UID: \"9eea778d-a67a-4ea8-a8ce-3c02540d243c\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"
May 25 06:20:39.466620 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.466577    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n67wp\" (UniqueName: \"kubernetes.io/projected/9eea778d-a67a-4ea8-a8ce-3c02540d243c-kube-api-access-n67wp\") pod \"feast-operator-controller-manager-cf99db75-2bb99\" (UID: \"9eea778d-a67a-4ea8-a8ce-3c02540d243c\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"
May 25 06:20:39.488394 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.488373    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n67wp\" (UniqueName: \"kubernetes.io/projected/9eea778d-a67a-4ea8-a8ce-3c02540d243c-kube-api-access-n67wp\") pod \"feast-operator-controller-manager-cf99db75-2bb99\" (UID: \"9eea778d-a67a-4ea8-a8ce-3c02540d243c\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"
May 25 06:20:39.565487 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.565466    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"
May 25 06:20:39.699319 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.699290    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"]
May 25 06:20:39.700531 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:20:39.700490    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eea778d_a67a_4ea8_a8ce_3c02540d243c.slice/crio-6ae13cf30a4c0cc7648f8fef7c2a7f7784a00ae2833c6b8e254baa1eac604fa9 WatchSource:0}: Error finding container 6ae13cf30a4c0cc7648f8fef7c2a7f7784a00ae2833c6b8e254baa1eac604fa9: Status 404 returned error can't find the container with id 6ae13cf30a4c0cc7648f8fef7c2a7f7784a00ae2833c6b8e254baa1eac604fa9
May 25 06:20:39.702187 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.702173    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 06:20:39.929027 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.928950    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99" event={"ID":"9eea778d-a67a-4ea8-a8ce-3c02540d243c","Type":"ContainerStarted","Data":"29e20d5b06ab3c0c9477b05d67f31855edb7c742d7a5ef30812cbf37581c72dd"}
May 25 06:20:39.929027 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.928983    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99" event={"ID":"9eea778d-a67a-4ea8-a8ce-3c02540d243c","Type":"ContainerStarted","Data":"6ae13cf30a4c0cc7648f8fef7c2a7f7784a00ae2833c6b8e254baa1eac604fa9"}
May 25 06:20:39.929192 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.929067    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"
May 25 06:20:39.969863 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:39.969814    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99" podStartSLOduration=0.969797438 podStartE2EDuration="969.797438ms" podCreationTimestamp="2026-05-25 06:20:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:20:39.967419035 +0000 UTC m=+1430.312037066" watchObservedRunningTime="2026-05-25 06:20:39.969797438 +0000 UTC m=+1430.314415468"
May 25 06:20:50.933397 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:50.933362    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2bb99"
May 25 06:20:56.827823 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.827792    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"]
May 25 06:20:56.832918 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.832893    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:56.839767 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.839747    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 25 06:20:56.839870 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.839750    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 25 06:20:56.840017 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.839991    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 25 06:20:56.840061 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.840025    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 25 06:20:56.840277 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.840261    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 25 06:20:56.847021 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.847006    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 25 06:20:56.847249 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.847236    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jhxmx\""
May 25 06:20:56.872440 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.872421    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"]
May 25 06:20:56.986552 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.986525    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:56.986704 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.986555    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/865fd051-c2a3-46b3-adaa-37248406a1bb-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:56.986704 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.986580    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:56.986704 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.986660    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:56.986704 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.986686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:56.986838 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:56.986767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz78d\" (UniqueName: \"kubernetes.io/projected/865fd051-c2a3-46b3-adaa-37248406a1bb-kube-api-access-nz78d\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.087138 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.087086    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nz78d\" (UniqueName: \"kubernetes.io/projected/865fd051-c2a3-46b3-adaa-37248406a1bb-kube-api-access-nz78d\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.087138 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.087115    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.087138 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.087133    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/865fd051-c2a3-46b3-adaa-37248406a1bb-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.087343 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.087155    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.087343 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.087179    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.087343 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.087193    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.087343 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:20:57.087243    2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 25 06:20:57.087343 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:20:57.087271    2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 25 06:20:57.087343 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:20:57.087322    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-online-tls podName:865fd051-c2a3-46b3-adaa-37248406a1bb nodeName:}" failed. No retries permitted until 2026-05-25 06:20:57.587305636 +0000 UTC m=+1447.931923643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-online-tls") pod "feast-simple-feast-setup-664fcfcc58-z685z" (UID: "865fd051-c2a3-46b3-adaa-37248406a1bb") : secret "feast-simple-feast-setup-online-tls" not found
May 25 06:20:57.087343 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:20:57.087337    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-ui-tls podName:865fd051-c2a3-46b3-adaa-37248406a1bb nodeName:}" failed. No retries permitted until 2026-05-25 06:20:57.587330452 +0000 UTC m=+1447.931948460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-z685z" (UID: "865fd051-c2a3-46b3-adaa-37248406a1bb") : secret "feast-simple-feast-setup-ui-tls" not found
May 25 06:20:57.087704 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.087627    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/865fd051-c2a3-46b3-adaa-37248406a1bb-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.089838 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.089812    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.089943 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.089812    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.104108 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.104089    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz78d\" (UniqueName: \"kubernetes.io/projected/865fd051-c2a3-46b3-adaa-37248406a1bb-kube-api-access-nz78d\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.590271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.590242    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.590430 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.590290    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.592788 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.592763    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.592871 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.592763    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z685z\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.741811 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.741788    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:20:57.881997 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.881969    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"]
May 25 06:20:57.884353 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:20:57.884325    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod865fd051_c2a3_46b3_adaa_37248406a1bb.slice/crio-9cbd96126cd7dc534762ec4669fbe6dbd27d726b3f7e2a34954dd28224800055 WatchSource:0}: Error finding container 9cbd96126cd7dc534762ec4669fbe6dbd27d726b3f7e2a34954dd28224800055: Status 404 returned error can't find the container with id 9cbd96126cd7dc534762ec4669fbe6dbd27d726b3f7e2a34954dd28224800055
May 25 06:20:57.976400 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.976367    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerStarted","Data":"31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb"}
May 25 06:20:57.976510 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:20:57.976406    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerStarted","Data":"9cbd96126cd7dc534762ec4669fbe6dbd27d726b3f7e2a34954dd28224800055"}
May 25 06:21:02.989397 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:02.989364    2572 generic.go:358] "Generic (PLEG): container finished" podID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerID="31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb" exitCode=0
May 25 06:21:02.989774 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:02.989439    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerDied","Data":"31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb"}
May 25 06:21:03.994166 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:03.994129    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerStarted","Data":"d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d"}
May 25 06:21:09.011479 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:09.011447    2572 generic.go:358] "Generic (PLEG): container finished" podID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerID="d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d" exitCode=0
May 25 06:21:09.011886 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:09.011521    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerDied","Data":"d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d"}
May 25 06:21:10.018735 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:10.018693    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerStarted","Data":"08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0"}
May 25 06:21:10.019225 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:10.018744    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerStarted","Data":"b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647"}
May 25 06:21:10.019225 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:10.018759    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerStarted","Data":"5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688"}
May 25 06:21:10.019225 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:10.018772    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerStarted","Data":"ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a"}
May 25 06:21:10.089764 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:10.089683    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podStartSLOduration=14.08966381 podStartE2EDuration="14.08966381s" podCreationTimestamp="2026-05-25 06:20:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:21:10.087821966 +0000 UTC m=+1460.432439999" watchObservedRunningTime="2026-05-25 06:21:10.08966381 +0000 UTC m=+1460.434281845"
May 25 06:21:12.742890 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:12.742850    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:12.742890 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:12.742896    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:12.743438 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:12.742912    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:12.743438 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:12.742925    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:12.745007 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:12.744969    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 25 06:21:12.745007 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:12.744986    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused"
May 25 06:21:12.745209 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:12.745073    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 25 06:21:12.745315 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:12.744998    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused"
May 25 06:21:15.743723 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.743688    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:15.744123 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.743874    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:15.744123 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.744037    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:15.744431 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.744401    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:15.744563 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.744437    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:15.744563 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.744452    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:15.744709 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.744583    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:15.744709 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.744654    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:15.744918 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.744902    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:15.748415 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:15.748401    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:16.036712 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:16.036637    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:21:16.039532 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:21:16.039511    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:22:17.383007 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.382913    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"]
May 25 06:22:17.383554 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.383413    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="registry" containerID="cri-o://ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a" gracePeriod=30
May 25 06:22:17.383554 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.383460    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="offline" containerID="cri-o://b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647" gracePeriod=30
May 25 06:22:17.383554 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.383464    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="ui" containerID="cri-o://08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0" gracePeriod=30
May 25 06:22:17.383554 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.383460    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="online" containerID="cri-o://5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688" gracePeriod=30
May 25 06:22:17.772522 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.772428    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"]
May 25 06:22:17.776032 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.776009    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.778542 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.778519    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-zfnxm\""
May 25 06:22:17.786732 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.786705    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"]
May 25 06:22:17.838306 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.838281    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxcts\" (UniqueName: \"kubernetes.io/projected/1b9cb46b-52dc-4501-ae03-e8ba5921891f-kube-api-access-kxcts\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.838451 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.838319    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b9cb46b-52dc-4501-ae03-e8ba5921891f-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.838451 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.838357    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.838451 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.838389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.838626 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.838464    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.838626 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.838516    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.939787 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.939752    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.939958 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.939805    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.939958 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:17.939898    2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 25 06:22:17.939958 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:17.939907    2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 25 06:22:17.939958 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.939921    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.940131 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:17.939964    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-online-tls podName:1b9cb46b-52dc-4501-ae03-e8ba5921891f nodeName:}" failed. No retries permitted until 2026-05-25 06:22:18.439945295 +0000 UTC m=+1528.784563309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-online-tls") pod "feast-simple-feast-setup-664fcfcc58-pglr8" (UID: "1b9cb46b-52dc-4501-ae03-e8ba5921891f") : secret "feast-simple-feast-setup-online-tls" not found
May 25 06:22:17.940131 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:17.940030    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-registry-tls podName:1b9cb46b-52dc-4501-ae03-e8ba5921891f nodeName:}" failed. No retries permitted until 2026-05-25 06:22:18.439996817 +0000 UTC m=+1528.784614841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-pglr8" (UID: "1b9cb46b-52dc-4501-ae03-e8ba5921891f") : secret "feast-simple-feast-setup-registry-tls" not found
May 25 06:22:17.940131 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.940118    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxcts\" (UniqueName: \"kubernetes.io/projected/1b9cb46b-52dc-4501-ae03-e8ba5921891f-kube-api-access-kxcts\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.940271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.940160    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b9cb46b-52dc-4501-ae03-e8ba5921891f-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.940271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.940209    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.940524 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.940499    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b9cb46b-52dc-4501-ae03-e8ba5921891f-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.942336 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.942315    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.942501 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.942481    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:17.951665 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:17.951638    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxcts\" (UniqueName: \"kubernetes.io/projected/1b9cb46b-52dc-4501-ae03-e8ba5921891f-kube-api-access-kxcts\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:18.195116 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.195085    2572 generic.go:358] "Generic (PLEG): container finished" podID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerID="08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0" exitCode=0
May 25 06:22:18.195116 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.195107    2572 generic.go:358] "Generic (PLEG): container finished" podID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerID="5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688" exitCode=0
May 25 06:22:18.195339 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.195157    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerDied","Data":"08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0"}
May 25 06:22:18.195339 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.195196    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerDied","Data":"5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688"}
May 25 06:22:18.445421 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.445347    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:18.445421 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.445394    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:18.447793 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.447773    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:18.447905 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.447805    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-pglr8\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:18.685686 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.685660    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:18.809795 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:18.809771    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"]
May 25 06:22:18.811214 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:22:18.811185    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b9cb46b_52dc_4501_ae03_e8ba5921891f.slice/crio-f0efebd68046d8371301b46b7a4cfc7f47f2e89db2ffce3b7b0e5bbce11756a6 WatchSource:0}: Error finding container f0efebd68046d8371301b46b7a4cfc7f47f2e89db2ffce3b7b0e5bbce11756a6: Status 404 returned error can't find the container with id f0efebd68046d8371301b46b7a4cfc7f47f2e89db2ffce3b7b0e5bbce11756a6
May 25 06:22:19.199183 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:19.199137    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerStarted","Data":"da57d7be9689621dfad2f56e41b807fca6db692c93767a956654a593edafdb99"}
May 25 06:22:19.199183 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:19.199185    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerStarted","Data":"f0efebd68046d8371301b46b7a4cfc7f47f2e89db2ffce3b7b0e5bbce11756a6"}
May 25 06:22:24.214202 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:24.214166    2572 generic.go:358] "Generic (PLEG): container finished" podID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerID="da57d7be9689621dfad2f56e41b807fca6db692c93767a956654a593edafdb99" exitCode=0
May 25 06:22:24.214610 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:24.214215    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerDied","Data":"da57d7be9689621dfad2f56e41b807fca6db692c93767a956654a593edafdb99"}
May 25 06:22:25.217832 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:25.217794    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerStarted","Data":"d777f47b89e3741c6a68d756e4d2bc237bafdef2116e8d8adc845461557cb105"}
May 25 06:22:25.745377 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:25.745330    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 25 06:22:26.037182 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:26.037094    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 25 06:22:30.231042 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:30.231011    2572 generic.go:358] "Generic (PLEG): container finished" podID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerID="d777f47b89e3741c6a68d756e4d2bc237bafdef2116e8d8adc845461557cb105" exitCode=0
May 25 06:22:30.231399 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:30.231055    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerDied","Data":"d777f47b89e3741c6a68d756e4d2bc237bafdef2116e8d8adc845461557cb105"}
May 25 06:22:31.237499 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:31.237458    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerStarted","Data":"06ee6e3516525d7af444fdf5a4fda56df233e15fa1374a436f90ad8e89f14c0d"}
May 25 06:22:31.238003 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:31.237510    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerStarted","Data":"c8d20e44b98ff7998fdefda8d46ca09a4bd1e033b954abf7a71994293da54122"}
May 25 06:22:31.238003 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:31.237525    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerStarted","Data":"b5559ff89e33900bbf12faa3e7cc29ea79f77d591c2c4a561ac9fdcdbdd4236c"}
May 25 06:22:31.238003 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:31.237539    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerStarted","Data":"2a6c2ecbadeeb40ffeced923504d2ab4b7f979ef982a01e7ed26a21978fd72b2"}
May 25 06:22:31.264360 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:31.264304    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podStartSLOduration=14.264283647 podStartE2EDuration="14.264283647s" podCreationTimestamp="2026-05-25 06:22:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:22:31.262665046 +0000 UTC m=+1541.607283077" watchObservedRunningTime="2026-05-25 06:22:31.264283647 +0000 UTC m=+1541.608901679"
May 25 06:22:33.686725 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:33.686656    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:33.687316 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:33.687297    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:33.687425 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:33.687416    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:33.687783 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:33.687771    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:33.688907 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:33.688873    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 25 06:22:33.688998 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:33.688901    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
May 25 06:22:33.688998 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:33.688984    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
May 25 06:22:33.689109 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:33.689043    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 25 06:22:35.744893 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:35.744849    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 25 06:22:36.037276 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.037191    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 25 06:22:36.686791 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.686760    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:36.686983 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.686968    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:36.687146 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.687130    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:36.687515 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.687486    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:36.687653 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.687525    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:36.687653 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.687539    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:36.687832 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.687811    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:36.687931 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.687857    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:36.688015 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.688003    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:36.691413 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:36.691397    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:37.256052 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:37.256029    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:37.258814 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:37.258795    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:22:45.745379 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:45.745333    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 25 06:22:45.746032 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:45.745458    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:22:46.037177 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:46.037096    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 25 06:22:46.037330 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:46.037199    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:22:48.021832 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.021804    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:22:48.086082 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.086054    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-online-tls\") pod \"865fd051-c2a3-46b3-adaa-37248406a1bb\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") "
May 25 06:22:48.086198 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.086086    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/865fd051-c2a3-46b3-adaa-37248406a1bb-feast-data\") pod \"865fd051-c2a3-46b3-adaa-37248406a1bb\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") "
May 25 06:22:48.086198 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.086109    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-ui-tls\") pod \"865fd051-c2a3-46b3-adaa-37248406a1bb\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") "
May 25 06:22:48.086198 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.086146    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-offline-tls\") pod \"865fd051-c2a3-46b3-adaa-37248406a1bb\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") "
May 25 06:22:48.086198 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.086177    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-registry-tls\") pod \"865fd051-c2a3-46b3-adaa-37248406a1bb\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") "
May 25 06:22:48.086406 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.086212    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz78d\" (UniqueName: \"kubernetes.io/projected/865fd051-c2a3-46b3-adaa-37248406a1bb-kube-api-access-nz78d\") pod \"865fd051-c2a3-46b3-adaa-37248406a1bb\" (UID: \"865fd051-c2a3-46b3-adaa-37248406a1bb\") "
May 25 06:22:48.086552 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.086523    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865fd051-c2a3-46b3-adaa-37248406a1bb-feast-data" (OuterVolumeSpecName: "feast-data") pod "865fd051-c2a3-46b3-adaa-37248406a1bb" (UID: "865fd051-c2a3-46b3-adaa-37248406a1bb"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:22:48.088345 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.088321    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "865fd051-c2a3-46b3-adaa-37248406a1bb" (UID: "865fd051-c2a3-46b3-adaa-37248406a1bb"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:22:48.088345 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.088337    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-online-tls" (OuterVolumeSpecName: "online-tls") pod "865fd051-c2a3-46b3-adaa-37248406a1bb" (UID: "865fd051-c2a3-46b3-adaa-37248406a1bb"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:22:48.088470 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.088338    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865fd051-c2a3-46b3-adaa-37248406a1bb-kube-api-access-nz78d" (OuterVolumeSpecName: "kube-api-access-nz78d") pod "865fd051-c2a3-46b3-adaa-37248406a1bb" (UID: "865fd051-c2a3-46b3-adaa-37248406a1bb"). InnerVolumeSpecName "kube-api-access-nz78d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:22:48.088602 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.088572    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "865fd051-c2a3-46b3-adaa-37248406a1bb" (UID: "865fd051-c2a3-46b3-adaa-37248406a1bb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:22:48.088672 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.088616    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "865fd051-c2a3-46b3-adaa-37248406a1bb" (UID: "865fd051-c2a3-46b3-adaa-37248406a1bb"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:22:48.187380 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.187323    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-online-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:22:48.187380 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.187346    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/865fd051-c2a3-46b3-adaa-37248406a1bb-feast-data\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:22:48.187380 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.187360    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-ui-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:22:48.187380 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.187373    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-offline-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:22:48.187649 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.187385    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/865fd051-c2a3-46b3-adaa-37248406a1bb-registry-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:22:48.187649 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.187398    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz78d\" (UniqueName: \"kubernetes.io/projected/865fd051-c2a3-46b3-adaa-37248406a1bb-kube-api-access-nz78d\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:22:48.282715 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.282690    2572 generic.go:358] "Generic (PLEG): container finished" podID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerID="b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647" exitCode=137
May 25 06:22:48.282715 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.282715    2572 generic.go:358] "Generic (PLEG): container finished" podID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerID="ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a" exitCode=137
May 25 06:22:48.282888 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.282741    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerDied","Data":"b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647"}
May 25 06:22:48.282888 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.282750    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"
May 25 06:22:48.282888 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.282774    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerDied","Data":"ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a"}
May 25 06:22:48.282888 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.282790    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z" event={"ID":"865fd051-c2a3-46b3-adaa-37248406a1bb","Type":"ContainerDied","Data":"9cbd96126cd7dc534762ec4669fbe6dbd27d726b3f7e2a34954dd28224800055"}
May 25 06:22:48.282888 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.282809    2572 scope.go:117] "RemoveContainer" containerID="08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0"
May 25 06:22:48.290531 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.290515    2572 scope.go:117] "RemoveContainer" containerID="b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647"
May 25 06:22:48.297206 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.297186    2572 scope.go:117] "RemoveContainer" containerID="5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688"
May 25 06:22:48.303447 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.303419    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"]
May 25 06:22:48.305016 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.304998    2572 scope.go:117] "RemoveContainer" containerID="ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a"
May 25 06:22:48.307674 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.307652    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z685z"]
May 25 06:22:48.311646 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.311613    2572 scope.go:117] "RemoveContainer" containerID="d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d"
May 25 06:22:48.317849 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.317834    2572 scope.go:117] "RemoveContainer" containerID="31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb"
May 25 06:22:48.323977 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.323963    2572 scope.go:117] "RemoveContainer" containerID="08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0"
May 25 06:22:48.324193 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:48.324173    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0\": container with ID starting with 08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0 not found: ID does not exist" containerID="08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0"
May 25 06:22:48.324247 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324198    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0"} err="failed to get container status \"08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0\": rpc error: code = NotFound desc = could not find container \"08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0\": container with ID starting with 08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0 not found: ID does not exist"
May 25 06:22:48.324247 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324215    2572 scope.go:117] "RemoveContainer" containerID="b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647"
May 25 06:22:48.324401 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:48.324386    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647\": container with ID starting with b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647 not found: ID does not exist" containerID="b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647"
May 25 06:22:48.324442 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324403    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647"} err="failed to get container status \"b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647\": rpc error: code = NotFound desc = could not find container \"b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647\": container with ID starting with b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647 not found: ID does not exist"
May 25 06:22:48.324442 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324415    2572 scope.go:117] "RemoveContainer" containerID="5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688"
May 25 06:22:48.324582 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:48.324568    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688\": container with ID starting with 5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688 not found: ID does not exist" containerID="5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688"
May 25 06:22:48.324641 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324582    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688"} err="failed to get container status \"5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688\": rpc error: code = NotFound desc = could not find container \"5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688\": container with ID starting with 5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688 not found: ID does not exist"
May 25 06:22:48.324641 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324614    2572 scope.go:117] "RemoveContainer" containerID="ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a"
May 25 06:22:48.324782 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:48.324769    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a\": container with ID starting with ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a not found: ID does not exist" containerID="ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a"
May 25 06:22:48.324819 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324783    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a"} err="failed to get container status \"ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a\": rpc error: code = NotFound desc = could not find container \"ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a\": container with ID starting with ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a not found: ID does not exist"
May 25 06:22:48.324819 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324795    2572 scope.go:117] "RemoveContainer" containerID="d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d"
May 25 06:22:48.324979 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:48.324965    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d\": container with ID starting with d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d not found: ID does not exist" containerID="d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d"
May 25 06:22:48.325022 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324980    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d"} err="failed to get container status \"d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d\": rpc error: code = NotFound desc = could not find container \"d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d\": container with ID starting with d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d not found: ID does not exist"
May 25 06:22:48.325022 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.324991    2572 scope.go:117] "RemoveContainer" containerID="31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb"
May 25 06:22:48.325162 ip-10-0-135-159 kubenswrapper[2572]: E0525 06:22:48.325145    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb\": container with ID starting with 31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb not found: ID does not exist" containerID="31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb"
May 25 06:22:48.325197 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.325168    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb"} err="failed to get container status \"31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb\": rpc error: code = NotFound desc = could not find container \"31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb\": container with ID starting with 31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb not found: ID does not exist"
May 25 06:22:48.325197 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.325190    2572 scope.go:117] "RemoveContainer" containerID="08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0"
May 25 06:22:48.325423 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.325405    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0"} err="failed to get container status \"08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0\": rpc error: code = NotFound desc = could not find container \"08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0\": container with ID starting with 08ef8e944b28573308ca6bddeebb897996392308f766d302a6d6fef226b803e0 not found: ID does not exist"
May 25 06:22:48.325467 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.325424    2572 scope.go:117] "RemoveContainer" containerID="b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647"
May 25 06:22:48.325674 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.325640    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647"} err="failed to get container status \"b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647\": rpc error: code = NotFound desc = could not find container \"b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647\": container with ID starting with b689483c6bd8e54a7beaf53d9185b07ae3ca6f7c05459f31b7a1034269342647 not found: ID does not exist"
May 25 06:22:48.325674 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.325661    2572 scope.go:117] "RemoveContainer" containerID="5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688"
May 25 06:22:48.325889 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.325874    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688"} err="failed to get container status \"5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688\": rpc error: code = NotFound desc = could not find container \"5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688\": container with ID starting with 5074f0b4302394639efe7c0671cbfee9b327fc9adf72e8880653ba262b70d688 not found: ID does not exist"
May 25 06:22:48.325932 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.325889    2572 scope.go:117] "RemoveContainer" containerID="ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a"
May 25 06:22:48.326070 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.326051    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a"} err="failed to get container status \"ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a\": rpc error: code = NotFound desc = could not find container \"ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a\": container with ID starting with ff8de9ffa054d9cc885238572f1a01f8ac57e11f9328f656b04ebba6711a339a not found: ID does not exist"
May 25 06:22:48.326114 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.326070    2572 scope.go:117] "RemoveContainer" containerID="d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d"
May 25 06:22:48.326260 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.326242    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d"} err="failed to get container status \"d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d\": rpc error: code = NotFound desc = could not find container \"d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d\": container with ID starting with d11b6b4b5f64aaa8089096dfcb3b5f5f439a7fdc6eaae8742fc86581cc2bfb2d not found: ID does not exist"
May 25 06:22:48.326300 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.326262    2572 scope.go:117] "RemoveContainer" containerID="31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb"
May 25 06:22:48.326464 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:48.326441    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb"} err="failed to get container status \"31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb\": rpc error: code = NotFound desc = could not find container \"31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb\": container with ID starting with 31475ddf8e15976bd8cf81a6762f14be0c809d4a548144b76fe01e52813e1ffb not found: ID does not exist"
May 25 06:22:50.221836 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:22:50.221799    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" path="/var/lib/kubelet/pods/865fd051-c2a3-46b3-adaa-37248406a1bb/volumes"
May 25 06:23:39.114464 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114377    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"]
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114744    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="offline"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114760    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="offline"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114769    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="feast-apply"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114778    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="feast-apply"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114791    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="feast-init"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114800    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="feast-init"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114809    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="ui"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114816    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="ui"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114826    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="registry"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114835    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="registry"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114849    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="online"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114857    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="online"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114917    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="registry"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114928    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="online"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114937    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="ui"
May 25 06:23:39.116881 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.114947    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="865fd051-c2a3-46b3-adaa-37248406a1bb" containerName="offline"
May 25 06:23:39.118166 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.118151    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.120980 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.120961    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 25 06:23:39.121091 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.121004    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 25 06:23:39.121091 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.121065    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 25 06:23:39.121271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.121255    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 25 06:23:39.121350 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.121255    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 25 06:23:39.121350 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.121259    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 25 06:23:39.122135 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.122121    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-g4twd\""
May 25 06:23:39.132674 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.132651    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"]
May 25 06:23:39.214411 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.214386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.214516 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.214422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.214516 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.214456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.214617 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.214510    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.214617 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.214575    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s8rg\" (UniqueName: \"kubernetes.io/projected/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-kube-api-access-2s8rg\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.214686 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.214637    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.315156 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.315130    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.315266 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.315167    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.315266 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.315186    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.315266 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.315209    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.315266 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.315235    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s8rg\" (UniqueName: \"kubernetes.io/projected/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-kube-api-access-2s8rg\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.315436 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.315276    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.315604 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.315570    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.315925 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.315901    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.317638 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.317613    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.317727 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.317662    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.317847 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.317826    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.322911 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.322890    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s8rg\" (UniqueName: \"kubernetes.io/projected/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-kube-api-access-2s8rg\") pod \"feast-simple-feast-remote-setup-5cff94746b-gqjv2\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.427286 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.427221    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:39.548533 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:39.548499    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"]
May 25 06:23:39.550895 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:23:39.550861    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod092a2e9a_29a4_48a2_92ba_8cb1f025ca51.slice/crio-fa55f837c43813c69f23149c0db1ff052c971bab823f2ef0b2cff2bf585ae88f WatchSource:0}: Error finding container fa55f837c43813c69f23149c0db1ff052c971bab823f2ef0b2cff2bf585ae88f: Status 404 returned error can't find the container with id fa55f837c43813c69f23149c0db1ff052c971bab823f2ef0b2cff2bf585ae88f
May 25 06:23:40.408767 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:40.408736    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerStarted","Data":"f894552d97e4b9caea9330daae31a4a2fd7f4c28a6d781afca10efc1cf413124"}
May 25 06:23:40.408767 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:40.408773    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerStarted","Data":"fa55f837c43813c69f23149c0db1ff052c971bab823f2ef0b2cff2bf585ae88f"}
May 25 06:23:44.419358 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:44.419326    2572 generic.go:358] "Generic (PLEG): container finished" podID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerID="f894552d97e4b9caea9330daae31a4a2fd7f4c28a6d781afca10efc1cf413124" exitCode=0
May 25 06:23:44.419723 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:44.419402    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerDied","Data":"f894552d97e4b9caea9330daae31a4a2fd7f4c28a6d781afca10efc1cf413124"}
May 25 06:23:45.423308 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:45.423267    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerStarted","Data":"78d58649f08cceb8e431b84f39836c4dde4612f8016e66f7d74f35073cc4b5cf"}
May 25 06:23:50.441033 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:50.441001    2572 generic.go:358] "Generic (PLEG): container finished" podID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerID="78d58649f08cceb8e431b84f39836c4dde4612f8016e66f7d74f35073cc4b5cf" exitCode=0
May 25 06:23:50.441351 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:50.441075    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerDied","Data":"78d58649f08cceb8e431b84f39836c4dde4612f8016e66f7d74f35073cc4b5cf"}
May 25 06:23:51.447120 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:51.447082    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerStarted","Data":"296790a29e8f6fdfa109065f5dd6cfdc652a445ef006218220d7e5496db39f7b"}
May 25 06:23:51.447514 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:51.447134    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerStarted","Data":"bddadaac271f66a390bd45e8c9e6e5090d87af9e8a01052e1436d42a15b84f89"}
May 25 06:23:51.447514 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:51.447155    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerStarted","Data":"43b46a8b80cb713cf7f181e4c3b43acaaa9d8dff4ec4bb5b941f8c43015765c2"}
May 25 06:23:51.481702 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:51.481649    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podStartSLOduration=12.48163124 podStartE2EDuration="12.48163124s" podCreationTimestamp="2026-05-25 06:23:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:23:51.479219955 +0000 UTC m=+1621.823837987" watchObservedRunningTime="2026-05-25 06:23:51.48163124 +0000 UTC m=+1621.826249271"
May 25 06:23:54.427401 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:54.427355    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:54.427865 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:54.427419    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:54.427865 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:54.427435    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:54.429159 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:54.429124    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 25 06:23:54.429274 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:54.429151    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
May 25 06:23:54.429274 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:54.429167    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 25 06:23:57.428859 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:57.428825    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:57.429307 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:57.429032    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:57.429510 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:57.429451    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:57.429510 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:57.429484    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:57.429757 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:57.429737    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:57.429822 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:57.429785    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:57.433096 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:57.433077    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:57.464558 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:57.464531    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:23:57.467097 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:23:57.467082    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:25:00.124045 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.123962    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"]
May 25 06:25:00.124516 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.124262    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="online" containerID="cri-o://43b46a8b80cb713cf7f181e4c3b43acaaa9d8dff4ec4bb5b941f8c43015765c2" gracePeriod=30
May 25 06:25:00.124516 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.124306    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="offline" containerID="cri-o://bddadaac271f66a390bd45e8c9e6e5090d87af9e8a01052e1436d42a15b84f89" gracePeriod=30
May 25 06:25:00.124516 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.124306    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="ui" containerID="cri-o://296790a29e8f6fdfa109065f5dd6cfdc652a445ef006218220d7e5496db39f7b" gracePeriod=30
May 25 06:25:00.269539 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.269507    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"]
May 25 06:25:00.269917 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.269861    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="registry" containerID="cri-o://2a6c2ecbadeeb40ffeced923504d2ab4b7f979ef982a01e7ed26a21978fd72b2" gracePeriod=30
May 25 06:25:00.269917 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.269897    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="ui" containerID="cri-o://06ee6e3516525d7af444fdf5a4fda56df233e15fa1374a436f90ad8e89f14c0d" gracePeriod=30
May 25 06:25:00.270043 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.269939    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="online" containerID="cri-o://b5559ff89e33900bbf12faa3e7cc29ea79f77d591c2c4a561ac9fdcdbdd4236c" gracePeriod=30
May 25 06:25:00.270043 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.269909    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="offline" containerID="cri-o://c8d20e44b98ff7998fdefda8d46ca09a4bd1e033b954abf7a71994293da54122" gracePeriod=30
May 25 06:25:00.631293 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.631258    2572 generic.go:358] "Generic (PLEG): container finished" podID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerID="296790a29e8f6fdfa109065f5dd6cfdc652a445ef006218220d7e5496db39f7b" exitCode=0
May 25 06:25:00.631470 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:00.631334    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerDied","Data":"296790a29e8f6fdfa109065f5dd6cfdc652a445ef006218220d7e5496db39f7b"}
May 25 06:25:01.635865 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:01.635830    2572 generic.go:358] "Generic (PLEG): container finished" podID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerID="43b46a8b80cb713cf7f181e4c3b43acaaa9d8dff4ec4bb5b941f8c43015765c2" exitCode=0
May 25 06:25:01.636283 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:01.635898    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerDied","Data":"43b46a8b80cb713cf7f181e4c3b43acaaa9d8dff4ec4bb5b941f8c43015765c2"}
May 25 06:25:01.638013 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:01.637993    2572 generic.go:358] "Generic (PLEG): container finished" podID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerID="06ee6e3516525d7af444fdf5a4fda56df233e15fa1374a436f90ad8e89f14c0d" exitCode=0
May 25 06:25:01.638013 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:01.638010    2572 generic.go:358] "Generic (PLEG): container finished" podID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerID="b5559ff89e33900bbf12faa3e7cc29ea79f77d591c2c4a561ac9fdcdbdd4236c" exitCode=0
May 25 06:25:01.638142 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:01.638041    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerDied","Data":"06ee6e3516525d7af444fdf5a4fda56df233e15fa1374a436f90ad8e89f14c0d"}
May 25 06:25:01.638142 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:01.638062    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerDied","Data":"b5559ff89e33900bbf12faa3e7cc29ea79f77d591c2c4a561ac9fdcdbdd4236c"}
May 25 06:25:06.688116 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:06.688067    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 25 06:25:07.257077 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:07.257030    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 25 06:25:07.429816 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:07.429777    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 25 06:25:07.464648 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:07.464616    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 25 06:25:16.688065 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:16.688022    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 25 06:25:17.256681 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:17.256645    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 25 06:25:17.430192 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:17.430149    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 25 06:25:17.464728 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:17.464701    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 25 06:25:26.687763 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:26.687720    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 25 06:25:26.688216 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:26.687857    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:25:27.256799 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:27.256762    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 25 06:25:27.257085 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:27.256873    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:25:27.429703 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:27.429671    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
May 25 06:25:27.429849 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:27.429786    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:25:27.464954 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:27.464922    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
May 25 06:25:27.465067 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:27.465007    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:25:30.723451 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.723421    2572 generic.go:358] "Generic (PLEG): container finished" podID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerID="bddadaac271f66a390bd45e8c9e6e5090d87af9e8a01052e1436d42a15b84f89" exitCode=137
May 25 06:25:30.723863 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.723494    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerDied","Data":"bddadaac271f66a390bd45e8c9e6e5090d87af9e8a01052e1436d42a15b84f89"}
May 25 06:25:30.726098 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.726080    2572 generic.go:358] "Generic (PLEG): container finished" podID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerID="c8d20e44b98ff7998fdefda8d46ca09a4bd1e033b954abf7a71994293da54122" exitCode=137
May 25 06:25:30.726098 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.726095    2572 generic.go:358] "Generic (PLEG): container finished" podID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerID="2a6c2ecbadeeb40ffeced923504d2ab4b7f979ef982a01e7ed26a21978fd72b2" exitCode=137
May 25 06:25:30.726234 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.726131    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerDied","Data":"c8d20e44b98ff7998fdefda8d46ca09a4bd1e033b954abf7a71994293da54122"}
May 25 06:25:30.726234 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.726150    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerDied","Data":"2a6c2ecbadeeb40ffeced923504d2ab4b7f979ef982a01e7ed26a21978fd72b2"}
May 25 06:25:30.754885 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.754866    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:25:30.868121 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.868086    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s8rg\" (UniqueName: \"kubernetes.io/projected/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-kube-api-access-2s8rg\") pod \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") "
May 25 06:25:30.868283 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.868144    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-ui-tls\") pod \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") "
May 25 06:25:30.868283 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.868172    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-offline-tls\") pod \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") "
May 25 06:25:30.868283 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.868210    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-registry-tls\") pod \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") "
May 25 06:25:30.868283 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.868261    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-online-tls\") pod \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") "
May 25 06:25:30.868283 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.868282    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-feast-data\") pod \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\" (UID: \"092a2e9a-29a4-48a2-92ba-8cb1f025ca51\") "
May 25 06:25:30.868716 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.868671    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "092a2e9a-29a4-48a2-92ba-8cb1f025ca51" (UID: "092a2e9a-29a4-48a2-92ba-8cb1f025ca51"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:25:30.868887 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.868861    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-feast-data" (OuterVolumeSpecName: "feast-data") pod "092a2e9a-29a4-48a2-92ba-8cb1f025ca51" (UID: "092a2e9a-29a4-48a2-92ba-8cb1f025ca51"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:25:30.870489 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.870458    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-online-tls" (OuterVolumeSpecName: "online-tls") pod "092a2e9a-29a4-48a2-92ba-8cb1f025ca51" (UID: "092a2e9a-29a4-48a2-92ba-8cb1f025ca51"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:25:30.870489 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.870473    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "092a2e9a-29a4-48a2-92ba-8cb1f025ca51" (UID: "092a2e9a-29a4-48a2-92ba-8cb1f025ca51"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:25:30.870665 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.870582    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-kube-api-access-2s8rg" (OuterVolumeSpecName: "kube-api-access-2s8rg") pod "092a2e9a-29a4-48a2-92ba-8cb1f025ca51" (UID: "092a2e9a-29a4-48a2-92ba-8cb1f025ca51"). InnerVolumeSpecName "kube-api-access-2s8rg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:25:30.870665 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.870613    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "092a2e9a-29a4-48a2-92ba-8cb1f025ca51" (UID: "092a2e9a-29a4-48a2-92ba-8cb1f025ca51"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:25:30.905960 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.905941    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:25:30.969121 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969092    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-registry-tls\") pod \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") "
May 25 06:25:30.969271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969132    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b9cb46b-52dc-4501-ae03-e8ba5921891f-feast-data\") pod \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") "
May 25 06:25:30.969271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969147    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-ui-tls\") pod \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") "
May 25 06:25:30.969271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969165    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-offline-tls\") pod \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") "
May 25 06:25:30.969271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969186    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxcts\" (UniqueName: \"kubernetes.io/projected/1b9cb46b-52dc-4501-ae03-e8ba5921891f-kube-api-access-kxcts\") pod \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") "
May 25 06:25:30.969271 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969231    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-online-tls\") pod \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\" (UID: \"1b9cb46b-52dc-4501-ae03-e8ba5921891f\") "
May 25 06:25:30.969613 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969352    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-online-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:30.969613 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969367    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-feast-data\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:30.969613 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969382    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s8rg\" (UniqueName: \"kubernetes.io/projected/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-kube-api-access-2s8rg\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:30.969613 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969400    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-ui-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:30.969613 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969413    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-offline-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:30.969613 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969428    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/092a2e9a-29a4-48a2-92ba-8cb1f025ca51-registry-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:30.969877 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.969649    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b9cb46b-52dc-4501-ae03-e8ba5921891f-feast-data" (OuterVolumeSpecName: "feast-data") pod "1b9cb46b-52dc-4501-ae03-e8ba5921891f" (UID: "1b9cb46b-52dc-4501-ae03-e8ba5921891f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:25:30.971190 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.971167    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b9cb46b-52dc-4501-ae03-e8ba5921891f-kube-api-access-kxcts" (OuterVolumeSpecName: "kube-api-access-kxcts") pod "1b9cb46b-52dc-4501-ae03-e8ba5921891f" (UID: "1b9cb46b-52dc-4501-ae03-e8ba5921891f"). InnerVolumeSpecName "kube-api-access-kxcts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:25:30.971775 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.971752    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1b9cb46b-52dc-4501-ae03-e8ba5921891f" (UID: "1b9cb46b-52dc-4501-ae03-e8ba5921891f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:25:30.971775 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.971763    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1b9cb46b-52dc-4501-ae03-e8ba5921891f" (UID: "1b9cb46b-52dc-4501-ae03-e8ba5921891f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:25:30.971862 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.971783    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1b9cb46b-52dc-4501-ae03-e8ba5921891f" (UID: "1b9cb46b-52dc-4501-ae03-e8ba5921891f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:25:30.971862 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:30.971796    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-online-tls" (OuterVolumeSpecName: "online-tls") pod "1b9cb46b-52dc-4501-ae03-e8ba5921891f" (UID: "1b9cb46b-52dc-4501-ae03-e8ba5921891f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:25:31.069929 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.069883    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-registry-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:31.069929 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.069925    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1b9cb46b-52dc-4501-ae03-e8ba5921891f-feast-data\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:31.069929 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.069938    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-ui-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:31.070131 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.069949    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-offline-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:31.070131 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.069961    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxcts\" (UniqueName: \"kubernetes.io/projected/1b9cb46b-52dc-4501-ae03-e8ba5921891f-kube-api-access-kxcts\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:31.070131 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.069973    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1b9cb46b-52dc-4501-ae03-e8ba5921891f-online-tls\") on node \"ip-10-0-135-159.ec2.internal\" DevicePath \"\""
May 25 06:25:31.730927 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.730887    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8" event={"ID":"1b9cb46b-52dc-4501-ae03-e8ba5921891f","Type":"ContainerDied","Data":"f0efebd68046d8371301b46b7a4cfc7f47f2e89db2ffce3b7b0e5bbce11756a6"}
May 25 06:25:31.730927 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.730921    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"
May 25 06:25:31.731449 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.730941    2572 scope.go:117] "RemoveContainer" containerID="06ee6e3516525d7af444fdf5a4fda56df233e15fa1374a436f90ad8e89f14c0d"
May 25 06:25:31.733214 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.733192    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2" event={"ID":"092a2e9a-29a4-48a2-92ba-8cb1f025ca51","Type":"ContainerDied","Data":"fa55f837c43813c69f23149c0db1ff052c971bab823f2ef0b2cff2bf585ae88f"}
May 25 06:25:31.733333 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.733243    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"
May 25 06:25:31.739462 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.739439    2572 scope.go:117] "RemoveContainer" containerID="c8d20e44b98ff7998fdefda8d46ca09a4bd1e033b954abf7a71994293da54122"
May 25 06:25:31.747276 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.747259    2572 scope.go:117] "RemoveContainer" containerID="b5559ff89e33900bbf12faa3e7cc29ea79f77d591c2c4a561ac9fdcdbdd4236c"
May 25 06:25:31.753495 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.753480    2572 scope.go:117] "RemoveContainer" containerID="2a6c2ecbadeeb40ffeced923504d2ab4b7f979ef982a01e7ed26a21978fd72b2"
May 25 06:25:31.757951 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.757931    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"]
May 25 06:25:31.760769 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.760751    2572 scope.go:117] "RemoveContainer" containerID="d777f47b89e3741c6a68d756e4d2bc237bafdef2116e8d8adc845461557cb105"
May 25 06:25:31.761419 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.761401    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-gqjv2"]
May 25 06:25:31.767616 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.767600    2572 scope.go:117] "RemoveContainer" containerID="da57d7be9689621dfad2f56e41b807fca6db692c93767a956654a593edafdb99"
May 25 06:25:31.772860 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.772841    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"]
May 25 06:25:31.774080 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.774064    2572 scope.go:117] "RemoveContainer" containerID="296790a29e8f6fdfa109065f5dd6cfdc652a445ef006218220d7e5496db39f7b"
May 25 06:25:31.777979 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.777961    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-pglr8"]
May 25 06:25:31.780802 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.780788    2572 scope.go:117] "RemoveContainer" containerID="bddadaac271f66a390bd45e8c9e6e5090d87af9e8a01052e1436d42a15b84f89"
May 25 06:25:31.787039 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.787025    2572 scope.go:117] "RemoveContainer" containerID="43b46a8b80cb713cf7f181e4c3b43acaaa9d8dff4ec4bb5b941f8c43015765c2"
May 25 06:25:31.793091 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.793074    2572 scope.go:117] "RemoveContainer" containerID="78d58649f08cceb8e431b84f39836c4dde4612f8016e66f7d74f35073cc4b5cf"
May 25 06:25:31.798954 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:31.798939    2572 scope.go:117] "RemoveContainer" containerID="f894552d97e4b9caea9330daae31a4a2fd7f4c28a6d781afca10efc1cf413124"
May 25 06:25:32.222036 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:32.222001    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" path="/var/lib/kubelet/pods/092a2e9a-29a4-48a2-92ba-8cb1f025ca51/volumes"
May 25 06:25:32.222519 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:25:32.222506    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" path="/var/lib/kubelet/pods/1b9cb46b-52dc-4501-ae03-e8ba5921891f/volumes"
May 25 06:26:07.797445 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797410    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rpb87/must-gather-vtlvk"]
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797666    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="feast-init"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797678    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="feast-init"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797686    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="online"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797691    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="online"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797698    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="registry"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797704    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="registry"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797710    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="offline"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797716    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="offline"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797724    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="offline"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797729    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="offline"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797738    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="ui"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797742    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="ui"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797750    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="feast-init"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797755    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="feast-init"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797761    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="feast-apply"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797765    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="feast-apply"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797772    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="feast-apply"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797777    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="feast-apply"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797784    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="online"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797789    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="online"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797794    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="ui"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797799    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="ui"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797837    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="ui"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797846    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="online"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797852    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="registry"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797857    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="online"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797863    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="ui"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797869    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="092a2e9a-29a4-48a2-92ba-8cb1f025ca51" containerName="offline"
May 25 06:26:07.797930 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.797874    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b9cb46b-52dc-4501-ae03-e8ba5921891f" containerName="offline"
May 25 06:26:07.801976 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.801961    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb87/must-gather-vtlvk"
May 25 06:26:07.804519 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.804496    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpb87\"/\"openshift-service-ca.crt\""
May 25 06:26:07.804645 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.804622    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpb87\"/\"kube-root-ca.crt\""
May 25 06:26:07.805624 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.805604    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rpb87\"/\"default-dockercfg-p2tf5\""
May 25 06:26:07.806964 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.806943    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpb87/must-gather-vtlvk"]
May 25 06:26:07.907021 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.906993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b554c6ce-3bd8-44cf-80a4-ee819d15086c-must-gather-output\") pod \"must-gather-vtlvk\" (UID: \"b554c6ce-3bd8-44cf-80a4-ee819d15086c\") " pod="openshift-must-gather-rpb87/must-gather-vtlvk"
May 25 06:26:07.907130 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:07.907036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpcmz\" (UniqueName: \"kubernetes.io/projected/b554c6ce-3bd8-44cf-80a4-ee819d15086c-kube-api-access-cpcmz\") pod \"must-gather-vtlvk\" (UID: \"b554c6ce-3bd8-44cf-80a4-ee819d15086c\") " pod="openshift-must-gather-rpb87/must-gather-vtlvk"
May 25 06:26:08.008188 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:08.008163    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b554c6ce-3bd8-44cf-80a4-ee819d15086c-must-gather-output\") pod \"must-gather-vtlvk\" (UID: \"b554c6ce-3bd8-44cf-80a4-ee819d15086c\") " pod="openshift-must-gather-rpb87/must-gather-vtlvk"
May 25 06:26:08.008282 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:08.008205    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpcmz\" (UniqueName: \"kubernetes.io/projected/b554c6ce-3bd8-44cf-80a4-ee819d15086c-kube-api-access-cpcmz\") pod \"must-gather-vtlvk\" (UID: \"b554c6ce-3bd8-44cf-80a4-ee819d15086c\") " pod="openshift-must-gather-rpb87/must-gather-vtlvk"
May 25 06:26:08.008507 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:08.008488    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b554c6ce-3bd8-44cf-80a4-ee819d15086c-must-gather-output\") pod \"must-gather-vtlvk\" (UID: \"b554c6ce-3bd8-44cf-80a4-ee819d15086c\") " pod="openshift-must-gather-rpb87/must-gather-vtlvk"
May 25 06:26:08.016820 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:08.016801    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpcmz\" (UniqueName: \"kubernetes.io/projected/b554c6ce-3bd8-44cf-80a4-ee819d15086c-kube-api-access-cpcmz\") pod \"must-gather-vtlvk\" (UID: \"b554c6ce-3bd8-44cf-80a4-ee819d15086c\") " pod="openshift-must-gather-rpb87/must-gather-vtlvk"
May 25 06:26:08.111839 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:08.111790    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb87/must-gather-vtlvk"
May 25 06:26:08.232069 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:08.232045    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpb87/must-gather-vtlvk"]
May 25 06:26:08.233988 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:26:08.233964    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb554c6ce_3bd8_44cf_80a4_ee819d15086c.slice/crio-dad2025a1031c5376b96c9983612145e4447688faf724f0c77889b96d09997be WatchSource:0}: Error finding container dad2025a1031c5376b96c9983612145e4447688faf724f0c77889b96d09997be: Status 404 returned error can't find the container with id dad2025a1031c5376b96c9983612145e4447688faf724f0c77889b96d09997be
May 25 06:26:08.235602 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:08.235573    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 06:26:08.824983 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:08.824952    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb87/must-gather-vtlvk" event={"ID":"b554c6ce-3bd8-44cf-80a4-ee819d15086c","Type":"ContainerStarted","Data":"dad2025a1031c5376b96c9983612145e4447688faf724f0c77889b96d09997be"}
May 25 06:26:09.830274 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:09.830239    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb87/must-gather-vtlvk" event={"ID":"b554c6ce-3bd8-44cf-80a4-ee819d15086c","Type":"ContainerStarted","Data":"4acb868878cc3b8c96e3b1ef5e9f8df77a7bc577d4f7634397bd58f364012f6f"}
May 25 06:26:09.830837 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:09.830813    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb87/must-gather-vtlvk" event={"ID":"b554c6ce-3bd8-44cf-80a4-ee819d15086c","Type":"ContainerStarted","Data":"728af96dc28860979f21f5bc5cf69444ae264c3399a2d337a756a1d8f498b16f"}
May 25 06:26:09.850002 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:09.848970    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-rpb87/must-gather-vtlvk" podStartSLOduration=2.028378119 podStartE2EDuration="2.848952495s" podCreationTimestamp="2026-05-25 06:26:07 +0000 UTC" firstStartedPulling="2026-05-25 06:26:08.235732139 +0000 UTC m=+1758.580350146" lastFinishedPulling="2026-05-25 06:26:09.056306509 +0000 UTC m=+1759.400924522" observedRunningTime="2026-05-25 06:26:09.847427903 +0000 UTC m=+1760.192045934" watchObservedRunningTime="2026-05-25 06:26:09.848952495 +0000 UTC m=+1760.193570526"
May 25 06:26:10.368726 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:10.368692    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rtffd_56a91a44-62d5-43ef-9fcc-1a177da17245/global-pull-secret-syncer/0.log"
May 25 06:26:10.439906 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:10.439877    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p9qzc_f38391ef-3d66-4962-b86b-b85a021d2ed3/konnectivity-agent/0.log"
May 25 06:26:10.512923 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:10.512895    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-159.ec2.internal_186505e9c23065d31621bf141c3d9d6b/haproxy/0.log"
May 25 06:26:14.173147 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:14.173117    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2vdn_f9f3005a-b8d7-4253-98db-636c911e88ef/node-exporter/0.log"
May 25 06:26:14.190252 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:14.190225    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2vdn_f9f3005a-b8d7-4253-98db-636c911e88ef/kube-rbac-proxy/0.log"
May 25 06:26:14.209189 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:14.209166    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2vdn_f9f3005a-b8d7-4253-98db-636c911e88ef/init-textfile/0.log"
May 25 06:26:14.518787 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:14.518701    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b678dcddb-2sgq8_9fc42640-1e38-45ce-b6a4-4a38c7e43f37/telemeter-client/0.log"
May 25 06:26:14.541101 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:14.541068    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b678dcddb-2sgq8_9fc42640-1e38-45ce-b6a4-4a38c7e43f37/reload/0.log"
May 25 06:26:14.560837 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:14.560809    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b678dcddb-2sgq8_9fc42640-1e38-45ce-b6a4-4a38c7e43f37/kube-rbac-proxy/0.log"
May 25 06:26:16.651710 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.651662    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"]
May 25 06:26:16.656801 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.656773    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.663412 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.663383    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"]
May 25 06:26:16.781346 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.781308    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-podres\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.781503 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.781392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-sys\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.781503 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.781423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-lib-modules\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.781503 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.781459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-proc\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.781700 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.781522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwb6m\" (UniqueName: \"kubernetes.io/projected/8d693f24-49b8-4dff-9578-66021fb488a2-kube-api-access-gwb6m\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.882690 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.882643    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-podres\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.882887 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.882711    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-sys\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.882887 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.882732    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-lib-modules\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.882887 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.882758    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-proc\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.882887 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.882791    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwb6m\" (UniqueName: \"kubernetes.io/projected/8d693f24-49b8-4dff-9578-66021fb488a2-kube-api-access-gwb6m\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.882887 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.882833    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-podres\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.882887 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.882861    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-proc\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.882887 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.882833    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-sys\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.883139 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.882895    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d693f24-49b8-4dff-9578-66021fb488a2-lib-modules\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.890267 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.890239    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwb6m\" (UniqueName: \"kubernetes.io/projected/8d693f24-49b8-4dff-9578-66021fb488a2-kube-api-access-gwb6m\") pod \"perf-node-gather-daemonset-l2tfc\" (UID: \"8d693f24-49b8-4dff-9578-66021fb488a2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:16.969880 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:16.969804    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:17.100722 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:17.100691    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"]
May 25 06:26:17.107606 ip-10-0-135-159 kubenswrapper[2572]: W0525 06:26:17.104701    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8d693f24_49b8_4dff_9578_66021fb488a2.slice/crio-6c29425764fa62a5dedb2283b597c84b53ddd44ef1828eca1ba5a75a6ae5faa4 WatchSource:0}: Error finding container 6c29425764fa62a5dedb2283b597c84b53ddd44ef1828eca1ba5a75a6ae5faa4: Status 404 returned error can't find the container with id 6c29425764fa62a5dedb2283b597c84b53ddd44ef1828eca1ba5a75a6ae5faa4
May 25 06:26:17.426822 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:17.426796    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hhv67_516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff/dns/0.log"
May 25 06:26:17.444628 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:17.444605    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hhv67_516ed32d-ebc9-494d-a2b0-8ea9f3ae44ff/kube-rbac-proxy/0.log"
May 25 06:26:17.538459 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:17.538432    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-472vs_c5ff7734-4e0b-417c-a06f-1a9ea55333c9/dns-node-resolver/0.log"
May 25 06:26:17.862316 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:17.862025    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc" event={"ID":"8d693f24-49b8-4dff-9578-66021fb488a2","Type":"ContainerStarted","Data":"c67434a50c59879db5ed128a57bced5ee10cdd1bfb45d4b2c980312fd33e0b59"}
May 25 06:26:17.862316 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:17.862070    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc" event={"ID":"8d693f24-49b8-4dff-9578-66021fb488a2","Type":"ContainerStarted","Data":"6c29425764fa62a5dedb2283b597c84b53ddd44ef1828eca1ba5a75a6ae5faa4"}
May 25 06:26:17.862813 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:17.862441    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:17.882146 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:17.882105    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc" podStartSLOduration=1.88209276 podStartE2EDuration="1.88209276s" podCreationTimestamp="2026-05-25 06:26:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:26:17.87953889 +0000 UTC m=+1768.224156921" watchObservedRunningTime="2026-05-25 06:26:17.88209276 +0000 UTC m=+1768.226710790"
May 25 06:26:17.996056 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:17.996021    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5gbp5_718854ed-6ec3-4f1e-9349-6196422a2995/node-ca/0.log"
May 25 06:26:18.942753 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:18.942724    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cjpxj_5abec160-d16c-4c2c-9d6c-6422f7830854/serve-healthcheck-canary/0.log"
May 25 06:26:19.383031 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:19.383005    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kdh8k_f24927a7-b290-45ac-b3f1-00bfdc5e0803/kube-rbac-proxy/0.log"
May 25 06:26:19.400100 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:19.400073    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kdh8k_f24927a7-b290-45ac-b3f1-00bfdc5e0803/exporter/0.log"
May 25 06:26:19.421292 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:19.421273    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kdh8k_f24927a7-b290-45ac-b3f1-00bfdc5e0803/extractor/0.log"
May 25 06:26:23.876656 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:23.876626    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-l2tfc"
May 25 06:26:24.480053 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.480023    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g5mr_0624b917-1ca2-43da-b340-c5fb6e3d3d82/kube-multus-additional-cni-plugins/0.log"
May 25 06:26:24.497715 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.497685    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g5mr_0624b917-1ca2-43da-b340-c5fb6e3d3d82/egress-router-binary-copy/0.log"
May 25 06:26:24.518013 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.517991    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g5mr_0624b917-1ca2-43da-b340-c5fb6e3d3d82/cni-plugins/0.log"
May 25 06:26:24.537664 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.537636    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g5mr_0624b917-1ca2-43da-b340-c5fb6e3d3d82/bond-cni-plugin/0.log"
May 25 06:26:24.554656 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.554637    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g5mr_0624b917-1ca2-43da-b340-c5fb6e3d3d82/routeoverride-cni/0.log"
May 25 06:26:24.570733 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.570711    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g5mr_0624b917-1ca2-43da-b340-c5fb6e3d3d82/whereabouts-cni-bincopy/0.log"
May 25 06:26:24.587882 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.587863    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5g5mr_0624b917-1ca2-43da-b340-c5fb6e3d3d82/whereabouts-cni/0.log"
May 25 06:26:24.800174 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.800129    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r8w6d_24ac1167-5fd9-41e0-a10b-87e22e730e96/kube-multus/0.log"
May 25 06:26:24.820849 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.820807    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6kqfz_ceedf6b0-232e-4dcf-a1d2-694317d0046d/network-metrics-daemon/0.log"
May 25 06:26:24.836343 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:24.836307    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6kqfz_ceedf6b0-232e-4dcf-a1d2-694317d0046d/kube-rbac-proxy/0.log"
May 25 06:26:26.340256 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:26.340226    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjlbb_476dac2d-0fea-4248-a958-02680c3762d8/ovn-controller/0.log"
May 25 06:26:26.370463 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:26.370390    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjlbb_476dac2d-0fea-4248-a958-02680c3762d8/ovn-acl-logging/0.log"
May 25 06:26:26.392214 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:26.392189    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjlbb_476dac2d-0fea-4248-a958-02680c3762d8/kube-rbac-proxy-node/0.log"
May 25 06:26:26.412108 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:26.412085    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjlbb_476dac2d-0fea-4248-a958-02680c3762d8/kube-rbac-proxy-ovn-metrics/0.log"
May 25 06:26:26.426177 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:26.426152    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjlbb_476dac2d-0fea-4248-a958-02680c3762d8/northd/0.log"
May 25 06:26:26.442918 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:26.442900    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjlbb_476dac2d-0fea-4248-a958-02680c3762d8/nbdb/0.log"
May 25 06:26:26.460166 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:26.460149    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjlbb_476dac2d-0fea-4248-a958-02680c3762d8/sbdb/0.log"
May 25 06:26:26.618116 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:26.618083    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjlbb_476dac2d-0fea-4248-a958-02680c3762d8/ovnkube-controller/0.log"
May 25 06:26:27.633152 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:27.633012    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lww45_c3a9be39-aa81-4cca-b40e-f9e5f3109621/network-check-target-container/0.log"
May 25 06:26:28.491370 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:28.491335    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-tlmnl_3bd2d1aa-65b7-4138-bf8d-3d9ca3631e4c/iptables-alerter/0.log"
May 25 06:26:29.044050 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:29.044016    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-t9pjk_ae815701-2282-487d-b46f-85aad7c1c417/tuned/0.log"
May 25 06:26:32.070149 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:32.070123    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-2n4lx_366f4627-67e1-4237-bc30-b698c5877dc3/csi-driver/0.log"
May 25 06:26:32.094742 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:32.094708    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-2n4lx_366f4627-67e1-4237-bc30-b698c5877dc3/csi-node-driver-registrar/0.log"
May 25 06:26:32.111583 ip-10-0-135-159 kubenswrapper[2572]: I0525 06:26:32.111561    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-2n4lx_366f4627-67e1-4237-bc30-b698c5877dc3/csi-liveness-probe/0.log"