May 26 15:20:48.323712 ip-10-0-143-229 systemd[1]: Starting Kubernetes Kubelet...
May 26 15:20:48.747597 ip-10-0-143-229 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 15:20:48.747597 ip-10-0-143-229 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 15:20:48.747597 ip-10-0-143-229 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 15:20:48.747597 ip-10-0-143-229 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 15:20:48.747597 ip-10-0-143-229 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 15:20:48.750323 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.750228    2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 15:20:48.755054 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755024    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:20:48.755054 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755048    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:20:48.755054 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755053    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:20:48.755054 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755057    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:20:48.755054 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755061    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755066    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755070    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755074    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755078    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755082    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755086    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755090    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755093    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755098    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755101    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755104    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755108    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755112    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755116    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755129    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755134    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755137    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755141    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755145    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:20:48.755418 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755148    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755152    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755155    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755159    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755163    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755167    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755171    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755175    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755179    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755182    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755186    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755190    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755193    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755198    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755203    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755207    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755211    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755216    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755219    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755223    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:20:48.756202 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755227    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755232    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755236    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755240    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755244    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755247    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755251    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755256    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755261    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755265    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755269    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755274    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755278    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755286    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755305    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755309    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755314    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755319    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755340    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:20:48.757071 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755344    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755349    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755353    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755357    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755361    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755365    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755387    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755393    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755398    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755403    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755407    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755411    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755415    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755420    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755424    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755431    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755439    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755446    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755452    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755456    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:20:48.757863 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755461    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755465    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.755470    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756135    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756144    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756148    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756153    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756157    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756161    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756166    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756170    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756175    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756179    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756183    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756187    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756191    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756196    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756199    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756203    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:20:48.758468 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756208    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756212    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756216    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756219    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756223    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756227    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756231    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756236    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756241    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756246    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756250    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756254    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756259    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756263    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756267    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756271    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756275    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756280    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756284    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756289    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:20:48.758947 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756293    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756298    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756332    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756339    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756346    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756352    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756357    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756362    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756366    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756392    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756397    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756402    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756407    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756411    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756415    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756419    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756423    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756427    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756432    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:20:48.759547 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756436    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756440    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756445    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756450    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756454    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756458    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756462    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756467    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756471    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756475    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756479    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756484    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756488    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756493    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756498    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756502    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756506    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756510    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756515    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756518    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:20:48.760142 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756523    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756538    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756542    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756547    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756551    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756555    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756562    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756568    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756572    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756577    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.756581    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756688    2560 flags.go:64] FLAG: --address="0.0.0.0"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756700    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756711    2560 flags.go:64] FLAG: --anonymous-auth="true"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756724    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756732    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756737    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756745    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756752    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756757    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756762    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 15:20:48.760803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756768    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756779    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756784    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756789    2560 flags.go:64] FLAG: --cgroup-root=""
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756794    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756799    2560 flags.go:64] FLAG: --client-ca-file=""
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756804    2560 flags.go:64] FLAG: --cloud-config=""
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756809    2560 flags.go:64] FLAG: --cloud-provider="external"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756813    2560 flags.go:64] FLAG: --cluster-dns="[]"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756819    2560 flags.go:64] FLAG: --cluster-domain=""
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756825    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756830    2560 flags.go:64] FLAG: --config-dir=""
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756834    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756840    2560 flags.go:64] FLAG: --container-log-max-files="5"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756846    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756851    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756856    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756862    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756867    2560 flags.go:64] FLAG: --contention-profiling="false"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756871    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756876    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756882    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756887    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756893    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756898    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 15:20:48.761312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756903    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756910    2560 flags.go:64] FLAG: --enable-load-reader="false"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756915    2560 flags.go:64] FLAG: --enable-server="true"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756920    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756928    2560 flags.go:64] FLAG: --event-burst="100"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756933    2560 flags.go:64] FLAG: --event-qps="50"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756938    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756943    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756950    2560 flags.go:64] FLAG: --eviction-hard=""
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756956    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756961    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756966    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756971    2560 flags.go:64] FLAG: --eviction-soft=""
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756977    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756982    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756987    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756991    2560 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.756997    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757002    2560 flags.go:64] FLAG: --fail-swap-on="true"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757007    2560 flags.go:64] FLAG: --feature-gates=""
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757014    2560 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757019    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757024    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757029    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757034    2560 flags.go:64] FLAG: --healthz-port="10248"
May 26 15:20:48.762017 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757039    2560 flags.go:64] FLAG: --help="false"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757044    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-143-229.ec2.internal"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757049    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757054    2560 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757059    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757065    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757070    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757075    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757080    2560 flags.go:64] FLAG: --image-service-endpoint=""
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757084    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757090    2560 flags.go:64] FLAG: --kube-api-burst="100"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757095    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757101    2560 flags.go:64] FLAG: --kube-api-qps="50"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757105    2560 flags.go:64] FLAG: --kube-reserved=""
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757110    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757116    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757122    2560 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757126    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757131    2560 flags.go:64] FLAG: --lock-file=""
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757136    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757141    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757145    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757154    2560 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 15:20:48.762673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757159    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757164    2560 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757168    2560 flags.go:64] FLAG: --logging-format="text"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757173    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757179    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757184    2560 flags.go:64] FLAG: --manifest-url=""
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757188    2560 flags.go:64] FLAG: --manifest-url-header=""
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757196    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757201    2560 flags.go:64] FLAG: --max-open-files="1000000"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757207    2560 flags.go:64] FLAG: --max-pods="110"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757212    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757217    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757222    2560 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757227    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757232    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757237    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757242    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757255    2560 flags.go:64] FLAG: --node-status-max-images="50"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757260    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757265    2560 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757271    2560 flags.go:64] FLAG: --pod-cidr=""
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757276    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757284    2560 flags.go:64] FLAG: --pod-manifest-path=""
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757289    2560 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 15:20:48.763231 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757294    2560 flags.go:64] FLAG: --pods-per-core="0"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757301    2560 flags.go:64] FLAG: --port="10250"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757306    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757311    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05b9ec8d312cdbdc9"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757317    2560 flags.go:64] FLAG: --qos-reserved=""
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757322    2560 flags.go:64] FLAG: --read-only-port="10255"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757327    2560 flags.go:64] FLAG: --register-node="true"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757332    2560 flags.go:64] FLAG: --register-schedulable="true"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757337    2560 flags.go:64] FLAG: --register-with-taints=""
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757342    2560 flags.go:64] FLAG: --registry-burst="10"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757347    2560 flags.go:64] FLAG: --registry-qps="5"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757351    2560 flags.go:64] FLAG: --reserved-cpus=""
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757356    2560 flags.go:64] FLAG: --reserved-memory=""
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757362    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757384    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757389    2560 flags.go:64] FLAG: --rotate-certificates="false"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757394    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757399    2560 flags.go:64] FLAG: --runonce="false"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757404    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757409    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757414    2560 flags.go:64] FLAG: --seccomp-default="false"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757418    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757423    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757428    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757434    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757438    2560 flags.go:64] FLAG: --storage-driver-password="root"
May 26 15:20:48.763903 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757443    2560 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757450    2560 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757455    2560 flags.go:64] FLAG: --storage-driver-user="root"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757461    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757466    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757470    2560 flags.go:64] FLAG: --system-cgroups=""
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757475    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757486    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757491    2560 flags.go:64] FLAG: --tls-cert-file=""
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757496    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757502    2560 flags.go:64] FLAG: --tls-min-version=""
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757506    2560 flags.go:64] FLAG: --tls-private-key-file=""
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757511    2560 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757516    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757521    2560 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757526    2560 flags.go:64] FLAG: --v="2"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757532    2560 flags.go:64] FLAG: --version="false"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757539    2560 flags.go:64] FLAG: --vmodule=""
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757545    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.757550    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757706    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757712    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757717    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757721    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:20:48.764566 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757725    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757729    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757733    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757737    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757741    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757745    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757750    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757754    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757758    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757764    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757768    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757772    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757776    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757781    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757785    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757791    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757795    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757799    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757803    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757807    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:20:48.765183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757811    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757814    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757818    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757823    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757827    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757831    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757835    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757839    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757843    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757848    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757852    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757856    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757860    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757864    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757870    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757875    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757879    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757884    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757888    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:20:48.765704 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757892    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757897    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757903    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757907    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757911    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757915    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757920    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757925    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757931    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757937    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757943    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757948    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757952    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757957    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757961    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757964    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757969    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757973    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757977    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757981    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:20:48.766155 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757985    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757989    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757994    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.757998    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758002    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758006    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758011    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758015    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758019    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758023    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758027    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758031    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758036    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758040    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758046    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758050    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758054    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758058    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758062    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758067    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:20:48.766658 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758075    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:20:48.767134 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758079    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:20:48.767134 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.758083    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:20:48.767134 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.758882    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 15:20:48.767990 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.767965    2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 15:20:48.768030 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.767991    2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 15:20:48.768059 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768043    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:20:48.768059 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768050    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:20:48.768059 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768053    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:20:48.768059 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768056    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:20:48.768059 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768060    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768064    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768072    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768076    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768078    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768081    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768084    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768086    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768089    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768092    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768094    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768097    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768100    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768104    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768109    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768112    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768115    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768118    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768120    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768123    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:20:48.768183 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768126    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768128    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768131    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768133    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768136    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768139    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768141    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768145    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768147    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768150    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768152    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768155    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768157    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768160    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768164    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768167    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768170    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768172    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768175    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768177    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:20:48.768706 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768180    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768182    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768187    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768190    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768193    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768196    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768199    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768202    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768205    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768208    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768210    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768213    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768215    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768218    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768220    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768223    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768225    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768228    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768231    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:20:48.769178 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768233    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768236    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768239    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768242    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768244    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768247    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768249    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768253    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768256    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768258    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768261    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768264    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768266    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768269    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768271    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768274    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768276    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768279    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768281    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768284    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:20:48.769640 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768286    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768289    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768291    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.768296    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768424    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768428    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768431    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768434    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768437    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768440    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768443    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768446    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768448    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768451    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768455    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 15:20:48.770110 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768457    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768460    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768463    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768466    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768469    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768472    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768475    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768478    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768481    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768483    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768486    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768488    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768491    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768494    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768496    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768499    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768502    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768504    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768507    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768509    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 15:20:48.770496 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768512    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768514    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768516    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768519    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768522    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768537    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768540    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768543    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768545    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768548    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768550    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768553    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768556    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768558    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768561    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768563    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768566    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768568    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768572    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 15:20:48.770981 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768576    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768579    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768581    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768584    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768586    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768588    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768591    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768593    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768596    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768598    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768600    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768603    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768606    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768608    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768610    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768613    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768616    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768620    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768623    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 15:20:48.771499 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768625    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768628    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768630    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768633    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768635    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768638    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768640    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768643    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768645    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768648    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768650    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768653    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768655    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768658    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768660    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768663    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 15:20:48.771979 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:48.768665    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 15:20:48.772469 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.768670    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 15:20:48.772469 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.769597    2560 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 15:20:48.774452 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.774437    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 15:20:48.775611 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.775598    2560 server.go:1019] "Starting client certificate rotation"
May 26 15:20:48.775717 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.775702    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 15:20:48.775752 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.775741    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 15:20:48.806600 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.806570    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 15:20:48.812670 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.812641    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 15:20:48.829397 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.829363    2560 log.go:25] "Validated CRI v1 runtime API"
May 26 15:20:48.833436 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.833414    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 15:20:48.835767 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.835752    2560 log.go:25] "Validated CRI v1 image API"
May 26 15:20:48.837083 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.837070    2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 15:20:48.840651 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.840626    2560 fs.go:135] Filesystem UUIDs: map[7719a70e-5d07-4c86-9915-85167e50c984:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8c6d1cbe-6af9-4fe5-866c-6adc273cb09e:/dev/nvme0n1p3]
May 26 15:20:48.840710 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.840651    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 15:20:48.845854 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.845737    2560 manager.go:217] Machine: {Timestamp:2026-05-26 15:20:48.845220828 +0000 UTC m=+0.417388462 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124564 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f1ea8b034dbf8a902c43ab1b56252 SystemUUID:ec2f1ea8-b034-dbf8-a902-c43ab1b56252 BootID:b3d8d633-499e-4a6f-b411-9cf8b28ffc92 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:71:ab:6a:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:71:ab:6a:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:c6:1f:d2:64:75 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 15:20:48.845854 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.845850    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 15:20:48.845951 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.845930    2560 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 15:20:48.849069 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.849043    2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 15:20:48.849206 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.849071    2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-229.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 15:20:48.849247 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.849216    2560 topology_manager.go:138] "Creating topology manager with none policy"
May 26 15:20:48.849247 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.849224    2560 container_manager_linux.go:306] "Creating device plugin manager"
May 26 15:20:48.849247 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.849231    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 15:20:48.849247 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.849244    2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 15:20:48.851198 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.851187    2560 state_mem.go:36] "Initialized new in-memory state store"
May 26 15:20:48.851338 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.851312    2560 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 15:20:48.854080 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.854068    2560 kubelet.go:491] "Attempting to sync node with API server"
May 26 15:20:48.854114 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.854085    2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 15:20:48.854650 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.854640    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 15:20:48.854680 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.854655    2560 kubelet.go:397] "Adding apiserver pod source"
May 26 15:20:48.854680 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.854664    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 15:20:48.856008 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.855991    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 15:20:48.856057 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.856014    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 15:20:48.859870 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.859844    2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 15:20:48.862470 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.862455    2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 15:20:48.863365 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863353    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 15:20:48.863430 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863386    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 15:20:48.863430 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863394    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 15:20:48.863430 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863399    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 15:20:48.863430 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863407    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 15:20:48.863430 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863414    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 15:20:48.863430 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863420    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 15:20:48.863430 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863426    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 15:20:48.863430 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863433    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 15:20:48.863642 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863438    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 15:20:48.863642 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863448    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 15:20:48.863894 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.863885    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 15:20:48.864916 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.864907    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 15:20:48.864954 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.864916    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 15:20:48.868096 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.868081    2560 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 15:20:48.868177 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.868118    2560 server.go:1295] "Started kubelet"
May 26 15:20:48.868249 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.868211    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 15:20:48.868359 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.868269    2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 15:20:48.868359 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.868338    2560 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 15:20:48.868857 ip-10-0-143-229 systemd[1]: Started Kubernetes Kubelet.
May 26 15:20:48.869788 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.869763    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 15:20:48.869939 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.869818    2560 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-229.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 15:20:48.869939 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.869822    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 15:20:48.870610 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.870594    2560 server.go:317] "Adding debug handlers to kubelet server"
May 26 15:20:48.872507 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.872485    2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 15:20:48.874619 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.873512    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-229.ec2.internal.18b326b7dce132f0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-229.ec2.internal,UID:ip-10-0-143-229.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-229.ec2.internal,},FirstTimestamp:2026-05-26 15:20:48.868094704 +0000 UTC m=+0.440262338,LastTimestamp:2026-05-26 15:20:48.868094704 +0000 UTC m=+0.440262338,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-229.ec2.internal,}"
May 26 15:20:48.877673 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.877655    2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 15:20:48.879782 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.879763    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 15:20:48.881169 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.881145    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 15:20:48.881324 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.881303    2560 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 15:20:48.881324 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.881321    2560 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 15:20:48.881495 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.881479    2560 reconstruct.go:97] "Volume reconstruction finished"
May 26 15:20:48.881544 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.881496    2560 reconciler.go:26] "Reconciler: start to sync state"
May 26 15:20:48.881544 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.881425    2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 15:20:48.881923 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.881908    2560 factory.go:55] Registering systemd factory
May 26 15:20:48.881997 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.881950    2560 factory.go:223] Registration of the systemd container factory successfully
May 26 15:20:48.882170 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.882154    2560 factory.go:153] Registering CRI-O factory
May 26 15:20:48.882170 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.882171    2560 factory.go:223] Registration of the crio container factory successfully
May 26 15:20:48.882311 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.882201    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:48.882311 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.882223    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 15:20:48.882311 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.882243    2560 factory.go:103] Registering Raw factory
May 26 15:20:48.882311 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.882255    2560 manager.go:1196] Started watching for new ooms in manager
May 26 15:20:48.882650 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.882632    2560 manager.go:319] Starting recovery of all containers
May 26 15:20:48.884470 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.884438    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qh7jh"
May 26 15:20:48.890578 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.890512    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 15:20:48.892965 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.892787    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qh7jh"
May 26 15:20:48.894621 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.894593    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 15:20:48.894926 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.894898    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 15:20:48.895206 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.895193    2560 manager.go:324] Recovery completed
May 26 15:20:48.899877 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.899862    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:20:48.901743 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.901727    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:20:48.901825 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.901759    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:20:48.901825 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.901772    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientPID"
May 26 15:20:48.902283 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.902269    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 15:20:48.902283 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.902282    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 15:20:48.902411 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.902299    2560 state_mem.go:36] "Initialized new in-memory state store"
May 26 15:20:48.906076 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.906064    2560 policy_none.go:49] "None policy: Start"
May 26 15:20:48.906123 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.906080    2560 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 15:20:48.906123 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.906090    2560 state_mem.go:35] "Initializing new in-memory state store"
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.942861    2560 manager.go:341] "Starting Device Plugin manager"
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.942893    2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.942905    2560 server.go:85] "Starting device plugin registration server"
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.943214    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.943231    2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.943338    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.943481    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:48.943492    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.944007    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 15:20:48.963673 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:48.944043    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.037107 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.037021    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 15:20:49.037107 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.037050    2560 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 15:20:49.037107 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.037073    2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 15:20:49.037107 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.037081    2560 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 15:20:49.037327 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.037121    2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 15:20:49.039681 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.039659    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:20:49.043994 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.043981    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:20:49.044803 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.044789    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:20:49.044859 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.044812    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:20:49.044859 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.044822    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientPID"
May 26 15:20:49.044859 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.044842    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-229.ec2.internal"
May 26 15:20:49.065007 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.064977    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-229.ec2.internal"
May 26 15:20:49.065103 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.065014    2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-229.ec2.internal\": node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.106651 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.106621    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.138170 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.138126    2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal"]
May 26 15:20:49.138250 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.138216    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:20:49.139124 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.139096    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:20:49.139124 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.139128    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:20:49.139284 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.139142    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientPID"
May 26 15:20:49.140511 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.140498    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:20:49.141141 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.141126    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.141215 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.141159    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:20:49.141843 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.141825    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:20:49.141914 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.141853    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:20:49.141914 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.141866    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientPID"
May 26 15:20:49.141914 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.141833    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:20:49.142000 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.141945    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:20:49.142000 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.141958    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientPID"
May 26 15:20:49.143125 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.143100    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.143205 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.143152    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 15:20:49.143999 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.143985    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientMemory"
May 26 15:20:49.144078 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.144008    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasNoDiskPressure"
May 26 15:20:49.144078 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.144018    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeHasSufficientPID"
May 26 15:20:49.163009 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.162983    2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-229.ec2.internal\" not found" node="ip-10-0-143-229.ec2.internal"
May 26 15:20:49.167015 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.166995    2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-229.ec2.internal\" not found" node="ip-10-0-143-229.ec2.internal"
May 26 15:20:49.206982 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.206952    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.282692 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.282650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/909c80c5890e3b696c6ce2036be29b77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal\" (UID: \"909c80c5890e3b696c6ce2036be29b77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.282692 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.282690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/909c80c5890e3b696c6ce2036be29b77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal\" (UID: \"909c80c5890e3b696c6ce2036be29b77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.282922 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.282707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab53f28968cb404326448da577bad436-config\") pod \"kube-apiserver-proxy-ip-10-0-143-229.ec2.internal\" (UID: \"ab53f28968cb404326448da577bad436\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.307549 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.307473    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.383001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.382959    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab53f28968cb404326448da577bad436-config\") pod \"kube-apiserver-proxy-ip-10-0-143-229.ec2.internal\" (UID: \"ab53f28968cb404326448da577bad436\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.383001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.382925    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab53f28968cb404326448da577bad436-config\") pod \"kube-apiserver-proxy-ip-10-0-143-229.ec2.internal\" (UID: \"ab53f28968cb404326448da577bad436\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.383152 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.383042    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/909c80c5890e3b696c6ce2036be29b77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal\" (UID: \"909c80c5890e3b696c6ce2036be29b77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.383152 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.383079    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/909c80c5890e3b696c6ce2036be29b77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal\" (UID: \"909c80c5890e3b696c6ce2036be29b77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.383152 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.383119    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/909c80c5890e3b696c6ce2036be29b77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal\" (UID: \"909c80c5890e3b696c6ce2036be29b77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.383152 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.383127    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/909c80c5890e3b696c6ce2036be29b77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal\" (UID: \"909c80c5890e3b696c6ce2036be29b77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.408085 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.408054    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.466249 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.466216    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.469993 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.469972    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal"
May 26 15:20:49.508574 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.508545    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.609098 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.609009    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.709551 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.709511    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.775720 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.775684    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 15:20:49.776237 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.775818    2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 15:20:49.810272 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.810234    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.880867 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.880790    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 15:20:49.881262 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.881247    2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:20:49.895504 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.895473    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 15:15:48 +0000 UTC" deadline="2027-11-15 23:34:58.757268115 +0000 UTC"
May 26 15:20:49.895504 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.895501    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12920h14m8.861770547s"
May 26 15:20:49.901454 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.901437    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 15:20:49.911063 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:49.911039    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:49.930480 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.930458    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8hvwv"
May 26 15:20:49.941980 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:49.941950    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8hvwv"
May 26 15:20:50.012165 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:50.012128    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:50.061528 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:50.061487    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909c80c5890e3b696c6ce2036be29b77.slice/crio-b12502f8f55262b00467ca0624ccc163d2f164de5d6f58037a5af051b71180bc WatchSource:0}: Error finding container b12502f8f55262b00467ca0624ccc163d2f164de5d6f58037a5af051b71180bc: Status 404 returned error can't find the container with id b12502f8f55262b00467ca0624ccc163d2f164de5d6f58037a5af051b71180bc
May 26 15:20:50.061759 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:50.061734    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab53f28968cb404326448da577bad436.slice/crio-bf65615078b041066518997cea44dd3280e13b4f915abcdca1fe1aa394344234 WatchSource:0}: Error finding container bf65615078b041066518997cea44dd3280e13b4f915abcdca1fe1aa394344234: Status 404 returned error can't find the container with id bf65615078b041066518997cea44dd3280e13b4f915abcdca1fe1aa394344234
May 26 15:20:50.066293 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.066276    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:20:50.113217 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:50.113180    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:50.213762 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:50.213677    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-229.ec2.internal\" not found"
May 26 15:20:50.252468 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.252435    2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:20:50.254983 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.254963    2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:20:50.281493 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.281457    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal"
May 26 15:20:50.295729 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.295704    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 15:20:50.296882 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.296869    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal"
May 26 15:20:50.306694 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.306675    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 15:20:50.855969 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.855935    2560 apiserver.go:52] "Watching apiserver"
May 26 15:20:50.868686 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.868645    2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 15:20:50.870179 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.870142    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zk77v","kube-system/konnectivity-agent-kf6ww","openshift-image-registry/node-ca-xqx9q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal","openshift-multus/multus-additional-cni-plugins-j5bjn","openshift-multus/multus-d7j8m","openshift-multus/network-metrics-daemon-ljhrb","openshift-network-operator/iptables-alerter-fdx4j","kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch","openshift-cluster-node-tuning-operator/tuned-pdgxn","openshift-dns/node-resolver-np6z6","openshift-network-diagnostics/network-check-target-d7kpv","openshift-ovn-kubernetes/ovnkube-node-7rmh8"]
May 26 15:20:50.872938 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.872903    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.875031 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.874953    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:50.875150 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:50.875030    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:20:50.875934 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.875903    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fxxlr\""
May 26 15:20:50.876046 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.875969    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 15:20:50.876046 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.875982    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 15:20:50.876465 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.876297    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 15:20:50.877202 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.877182    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:50.879687 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.879666    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 15:20:50.880199 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.880054    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 15:20:50.880199 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.880109    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 15:20:50.880199 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.880175    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rjffv\""
May 26 15:20:50.882240 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.881974    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.884258 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.884238    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.884350 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.884291    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.885959 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.885934    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 15:20:50.886036 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.885971    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 15:20:50.886581 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.886561    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 15:20:50.887029 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.886759    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 15:20:50.887029 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.886881    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gksf6\""
May 26 15:20:50.888292 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.887687    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 15:20:50.888292 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.887765    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:50.888828 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.888603    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 15:20:50.888828 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.888656    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zkdbs\""
May 26 15:20:50.890043 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.890023    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 15:20:50.890527 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.890506    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5lnzm\""
May 26 15:20:50.890768 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.890746    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 15:20:50.890877 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.890790    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 15:20:50.891042 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.890987    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 15:20:50.891276 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891233    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z82q5\""
May 26 15:20:50.891363 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891275    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 15:20:50.891528 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891511    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 15:20:50.891607 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891593    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 15:20:50.891834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.891907 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-run-openvswitch\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.891907 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-systemd-units\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.892004 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891915    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52061267-92fd-4dfa-bb08-75bc2c9d420f-ovn-node-metrics-cert\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.892004 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd6vk\" (UniqueName: \"kubernetes.io/projected/db2e9d9f-5c38-494c-ae45-5472beb5ef96-kube-api-access-jd6vk\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.892004 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4svd\" (UniqueName: \"kubernetes.io/projected/52061267-92fd-4dfa-bb08-75bc2c9d420f-kube-api-access-f4svd\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.892004 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.891997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.892195 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.892022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp4wr\" (UniqueName: \"kubernetes.io/projected/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-kube-api-access-wp4wr\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.892195 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.892061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.892195 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.892086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-socket-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.892195 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.892109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxr7\" (UniqueName: \"kubernetes.io/projected/a0ee8ee6-c760-45d0-a193-aebac77e849a-kube-api-access-dbxr7\") pod \"node-ca-xqx9q\" (UID: \"a0ee8ee6-c760-45d0-a193-aebac77e849a\") " pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:50.892195 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.892133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-log-socket\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.892195 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.892156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-cni-bin\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.892195 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.892179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.892558 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.892489    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 15:20:50.892667 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.892628    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:20:50.893065 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52061267-92fd-4dfa-bb08-75bc2c9d420f-ovnkube-config\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.893160 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-sys-fs\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.893212 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-slash\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.893212 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-cni-netd\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.893312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-os-release\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.893312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.893312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:50.893312 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-cnibin\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-kubelet\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-run-ovn-kubernetes\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893387    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52061267-92fd-4dfa-bb08-75bc2c9d420f-ovnkube-script-lib\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-device-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-run-netns\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893462    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-var-lib-openvswitch\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-run-ovn\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.893542 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-node-log\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.894003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-system-cni-dir\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.894003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-etc-openvswitch\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.894003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0ee8ee6-c760-45d0-a193-aebac77e849a-host\") pod \"node-ca-xqx9q\" (UID: \"a0ee8ee6-c760-45d0-a193-aebac77e849a\") " pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:50.894003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0ee8ee6-c760-45d0-a193-aebac77e849a-serviceca\") pod \"node-ca-xqx9q\" (UID: \"a0ee8ee6-c760-45d0-a193-aebac77e849a\") " pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:50.894003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-run-systemd\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.894003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-registration-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.894003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52061267-92fd-4dfa-bb08-75bc2c9d420f-env-overrides\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.894003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.893820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.894973 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.894953    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:50.895062 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.895012    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:50.895062 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:50.895016    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:20:50.895155 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:50.895064    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:20:50.896586 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.896345    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 15:20:50.897691 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.897225    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c624h\""
May 26 15:20:50.897691 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.897491    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 15:20:50.899674 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.899652    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:50.899769 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.899652    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.902306 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.902286    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 15:20:50.902889 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.902511    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 15:20:50.902889 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.902585    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mlg7m\""
May 26 15:20:50.902889 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.902610    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 15:20:50.902889 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.902788    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 15:20:50.902889 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.902841    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wdfdj\""
May 26 15:20:50.942764 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.942733    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:15:49 +0000 UTC" deadline="2028-01-21 19:32:38.141525105 +0000 UTC"
May 26 15:20:50.942764 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.942759    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14524h11m47.198768382s"
May 26 15:20:50.982911 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.982879    2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 15:20:50.994334 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994301    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-run-ovn\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.994496 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994338    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-node-log\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.994496 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-socket-dir-parent\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.994496 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-hostroot\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.994496 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994433    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-run-ovn\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.994496 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994437    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-node-log\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.994496 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-etc-kubernetes\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994535    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-etc-openvswitch\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994556    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-run-systemd\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994571    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-registration-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994599    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-etc-openvswitch\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-run-netns\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994628    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-run-systemd\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-run-multus-certs\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27b43a61-5dab-42a0-a314-b81bc799dc6c-hosts-file\") pod \"node-resolver-np6z6\" (UID: \"27b43a61-5dab-42a0-a314-b81bc799dc6c\") " pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994663    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-registration-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994691    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994712    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-cnibin\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994731    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-run-openvswitch\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-var-lib-cni-multus\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.994765 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27b43a61-5dab-42a0-a314-b81bc799dc6c-tmp-dir\") pod \"node-resolver-np6z6\" (UID: \"27b43a61-5dab-42a0-a314-b81bc799dc6c\") " pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994793    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994799    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-system-cni-dir\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-run\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994808    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-run-openvswitch\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994847    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-log-socket\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994871    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-cni-bin\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994919    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-cni-bin\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994910    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-log-socket\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994940    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994968    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52061267-92fd-4dfa-bb08-75bc2c9d420f-ovnkube-config\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.994992    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-sys-fs\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lh25\" (UniqueName: \"kubernetes.io/projected/ce8c0661-c426-4f51-97de-709e4d46b664-kube-api-access-4lh25\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995038    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-host\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995082    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-slash\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.995389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995100    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-sys-fs\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995105    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995163    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-conf-dir\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995175    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-slash\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-modprobe-d\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995326    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-cnibin\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995389    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52061267-92fd-4dfa-bb08-75bc2c9d420f-ovnkube-script-lib\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995416    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-system-cni-dir\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995430    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h89c4\" (UniqueName: \"kubernetes.io/projected/249e20cb-bbe1-4d3d-afe8-0e339b0f8537-kube-api-access-h89c4\") pod \"iptables-alerter-fdx4j\" (UID: \"249e20cb-bbe1-4d3d-afe8-0e339b0f8537\") " pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db605d53-5646-4f55-9299-5258fc583cf9-konnectivity-ca\") pod \"konnectivity-agent-kf6ww\" (UID: \"db605d53-5646-4f55-9299-5258fc583cf9\") " pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-sysctl-conf\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995594    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0ee8ee6-c760-45d0-a193-aebac77e849a-host\") pod \"node-ca-xqx9q\" (UID: \"a0ee8ee6-c760-45d0-a193-aebac77e849a\") " pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995620    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0ee8ee6-c760-45d0-a193-aebac77e849a-serviceca\") pod \"node-ca-xqx9q\" (UID: \"a0ee8ee6-c760-45d0-a193-aebac77e849a\") " pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995628    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-system-cni-dir\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-cni-dir\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995645    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52061267-92fd-4dfa-bb08-75bc2c9d420f-ovnkube-config\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.996158 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-run-k8s-cni-cncf-io\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5277094-f350-4b44-84a7-18dc051f137b-dbus\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995700    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52061267-92fd-4dfa-bb08-75bc2c9d420f-env-overrides\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995701    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0ee8ee6-c760-45d0-a193-aebac77e849a-host\") pod \"node-ca-xqx9q\" (UID: \"a0ee8ee6-c760-45d0-a193-aebac77e849a\") " pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995717    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995669    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-cnibin\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-cni-binary-copy\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-var-lib-cni-bin\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52tbh\" (UniqueName: \"kubernetes.io/projected/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-kube-api-access-52tbh\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/249e20cb-bbe1-4d3d-afe8-0e339b0f8537-iptables-alerter-script\") pod \"iptables-alerter-fdx4j\" (UID: \"249e20cb-bbe1-4d3d-afe8-0e339b0f8537\") " pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-sysctl-d\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-lib-modules\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995884    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995915    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-systemd-units\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995944    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52061267-92fd-4dfa-bb08-75bc2c9d420f-ovn-node-metrics-cert\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.995987    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-systemd-units\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996028    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jd6vk\" (UniqueName: \"kubernetes.io/projected/db2e9d9f-5c38-494c-ae45-5472beb5ef96-kube-api-access-jd6vk\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.996856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996041    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52061267-92fd-4dfa-bb08-75bc2c9d420f-ovnkube-script-lib\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996085    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0ee8ee6-c760-45d0-a193-aebac77e849a-serviceca\") pod \"node-ca-xqx9q\" (UID: \"a0ee8ee6-c760-45d0-a193-aebac77e849a\") " pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996171    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52061267-92fd-4dfa-bb08-75bc2c9d420f-env-overrides\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996206    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-kubernetes\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996230    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhct6\" (UniqueName: \"kubernetes.io/projected/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-kube-api-access-jhct6\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996259    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4svd\" (UniqueName: \"kubernetes.io/projected/52061267-92fd-4dfa-bb08-75bc2c9d420f-kube-api-access-f4svd\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996284    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp4wr\" (UniqueName: \"kubernetes.io/projected/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-kube-api-access-wp4wr\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996296    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996310    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996336    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-socket-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-os-release\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5277094-f350-4b44-84a7-18dc051f137b-kubelet-config\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-sysconfig\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996452    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxr7\" (UniqueName: \"kubernetes.io/projected/a0ee8ee6-c760-45d0-a193-aebac77e849a-kube-api-access-dbxr7\") pod \"node-ca-xqx9q\" (UID: \"a0ee8ee6-c760-45d0-a193-aebac77e849a\") " pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/249e20cb-bbe1-4d3d-afe8-0e339b0f8537-host-slash\") pod \"iptables-alerter-fdx4j\" (UID: \"249e20cb-bbe1-4d3d-afe8-0e339b0f8537\") " pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-sys\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.997472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996516    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996535    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-var-lib-kubelet\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-tuned\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996569    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-socket-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9vvc\" (UniqueName: \"kubernetes.io/projected/27b43a61-5dab-42a0-a314-b81bc799dc6c-kube-api-access-j9vvc\") pod \"node-resolver-np6z6\" (UID: \"27b43a61-5dab-42a0-a314-b81bc799dc6c\") " pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996715    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-cni-netd\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996734    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-os-release\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996761    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996789    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-cni-netd\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-daemon-config\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996820    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-os-release\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-tmp\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996927    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-kubelet\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996955    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-run-ovn-kubernetes\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.996980    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997004    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-device-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997017    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-kubelet\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997026    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-run-ovn-kubernetes\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-var-lib-kubelet\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997075    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db2e9d9f-5c38-494c-ae45-5472beb5ef96-device-dir\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db605d53-5646-4f55-9299-5258fc583cf9-agent-certs\") pod \"konnectivity-agent-kf6ww\" (UID: \"db605d53-5646-4f55-9299-5258fc583cf9\") " pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-systemd\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997197    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-run-netns\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997221    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-var-lib-openvswitch\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997233    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-host-run-netns\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997254    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997284    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52061267-92fd-4dfa-bb08-75bc2c9d420f-var-lib-openvswitch\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:50.998628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:50.997441    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:51.000677 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.000650    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52061267-92fd-4dfa-bb08-75bc2c9d420f-ovn-node-metrics-cert\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:51.003069 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.003039    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:20:51.003159 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.003076    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:20:51.003159 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.003090    2560 projected.go:194] Error preparing data for projected volume kube-api-access-ghc4z for pod openshift-network-diagnostics/network-check-target-d7kpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:51.003287 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.003194    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z podName:f5be5ddd-c88e-4659-bdbe-727479d61265 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:51.503150096 +0000 UTC m=+3.075317716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ghc4z" (UniqueName: "kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z") pod "network-check-target-d7kpv" (UID: "f5be5ddd-c88e-4659-bdbe-727479d61265") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:51.006172 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.005943    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4svd\" (UniqueName: \"kubernetes.io/projected/52061267-92fd-4dfa-bb08-75bc2c9d420f-kube-api-access-f4svd\") pod \"ovnkube-node-7rmh8\" (UID: \"52061267-92fd-4dfa-bb08-75bc2c9d420f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:51.006172 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.006137    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp4wr\" (UniqueName: \"kubernetes.io/projected/ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd-kube-api-access-wp4wr\") pod \"multus-additional-cni-plugins-j5bjn\" (UID: \"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd\") " pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:51.006385 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.006348    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd6vk\" (UniqueName: \"kubernetes.io/projected/db2e9d9f-5c38-494c-ae45-5472beb5ef96-kube-api-access-jd6vk\") pod \"aws-ebs-csi-driver-node-t6lch\" (UID: \"db2e9d9f-5c38-494c-ae45-5472beb5ef96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:51.006608 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.006588    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxr7\" (UniqueName: \"kubernetes.io/projected/a0ee8ee6-c760-45d0-a193-aebac77e849a-kube-api-access-dbxr7\") pod \"node-ca-xqx9q\" (UID: \"a0ee8ee6-c760-45d0-a193-aebac77e849a\") " pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:51.041487 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.041404    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal" event={"ID":"ab53f28968cb404326448da577bad436","Type":"ContainerStarted","Data":"bf65615078b041066518997cea44dd3280e13b4f915abcdca1fe1aa394344234"}
May 26 15:20:51.042653 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.042620    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal" event={"ID":"909c80c5890e3b696c6ce2036be29b77","Type":"ContainerStarted","Data":"b12502f8f55262b00467ca0624ccc163d2f164de5d6f58037a5af051b71180bc"}
May 26 15:20:51.098243 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098206    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-socket-dir-parent\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098243 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098242    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-hostroot\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098259    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-etc-kubernetes\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098284    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098312    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-run-netns\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098330    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-run-multus-certs\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098334    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-etc-kubernetes\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098331    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-hostroot\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098348    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27b43a61-5dab-42a0-a314-b81bc799dc6c-hosts-file\") pod \"node-resolver-np6z6\" (UID: \"27b43a61-5dab-42a0-a314-b81bc799dc6c\") " pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098398    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-socket-dir-parent\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098403    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27b43a61-5dab-42a0-a314-b81bc799dc6c-hosts-file\") pod \"node-resolver-np6z6\" (UID: \"27b43a61-5dab-42a0-a314-b81bc799dc6c\") " pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098424    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-cnibin\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098461    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-run-netns\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098477    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-cnibin\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098481    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-var-lib-cni-multus\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.098489    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098509    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27b43a61-5dab-42a0-a314-b81bc799dc6c-tmp-dir\") pod \"node-resolver-np6z6\" (UID: \"27b43a61-5dab-42a0-a314-b81bc799dc6c\") " pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:51.098518 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098521    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-run-multus-certs\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098535    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-system-cni-dir\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098557    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-run\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.098569    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret podName:b5277094-f350-4b44-84a7-18dc051f137b nodeName:}" failed. No retries permitted until 2026-05-26 15:20:51.598553382 +0000 UTC m=+3.170721026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret") pod "global-pull-secret-syncer-zk77v" (UID: "b5277094-f350-4b44-84a7-18dc051f137b") : object "kube-system"/"original-pull-secret" not registered
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098597    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-run\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098603    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lh25\" (UniqueName: \"kubernetes.io/projected/ce8c0661-c426-4f51-97de-709e4d46b664-kube-api-access-4lh25\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098499    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-var-lib-cni-multus\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098667    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-system-cni-dir\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098695    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-host\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098742    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-conf-dir\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098805    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27b43a61-5dab-42a0-a314-b81bc799dc6c-tmp-dir\") pod \"node-resolver-np6z6\" (UID: \"27b43a61-5dab-42a0-a314-b81bc799dc6c\") " pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098811    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-modprobe-d\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098835    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h89c4\" (UniqueName: \"kubernetes.io/projected/249e20cb-bbe1-4d3d-afe8-0e339b0f8537-kube-api-access-h89c4\") pod \"iptables-alerter-fdx4j\" (UID: \"249e20cb-bbe1-4d3d-afe8-0e339b0f8537\") " pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098825    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-conf-dir\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098860    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db605d53-5646-4f55-9299-5258fc583cf9-konnectivity-ca\") pod \"konnectivity-agent-kf6ww\" (UID: \"db605d53-5646-4f55-9299-5258fc583cf9\") " pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098887    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-sysctl-conf\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098910    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-cni-dir\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.099193 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098935    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-run-k8s-cni-cncf-io\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098937    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-modprobe-d\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098953    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5277094-f350-4b44-84a7-18dc051f137b-dbus\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098842    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-host\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.098993    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-run-k8s-cni-cncf-io\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099002    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-cni-dir\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099029    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-cni-binary-copy\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099054    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-var-lib-cni-bin\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099078    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52tbh\" (UniqueName: \"kubernetes.io/projected/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-kube-api-access-52tbh\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099084    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5277094-f350-4b44-84a7-18dc051f137b-dbus\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099092    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-sysctl-conf\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099102    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/249e20cb-bbe1-4d3d-afe8-0e339b0f8537-iptables-alerter-script\") pod \"iptables-alerter-fdx4j\" (UID: \"249e20cb-bbe1-4d3d-afe8-0e339b0f8537\") " pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099126    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-sysctl-d\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099136    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-var-lib-cni-bin\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099147    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-lib-modules\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099174    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099198    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-kubernetes\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099220    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhct6\" (UniqueName: \"kubernetes.io/projected/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-kube-api-access-jhct6\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099248    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-os-release\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099283    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5277094-f350-4b44-84a7-18dc051f137b-kubelet-config\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099322    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-sysconfig\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099348    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/249e20cb-bbe1-4d3d-afe8-0e339b0f8537-host-slash\") pod \"iptables-alerter-fdx4j\" (UID: \"249e20cb-bbe1-4d3d-afe8-0e339b0f8537\") " pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.099357    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099391    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-sys\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099414    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-var-lib-kubelet\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099440    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-tuned\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099456    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5277094-f350-4b44-84a7-18dc051f137b-kubelet-config\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.099472    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs podName:ce8c0661-c426-4f51-97de-709e4d46b664 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:51.599454591 +0000 UTC m=+3.171622230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs") pod "network-metrics-daemon-ljhrb" (UID: "ce8c0661-c426-4f51-97de-709e4d46b664") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099493    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-kubernetes\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099493    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9vvc\" (UniqueName: \"kubernetes.io/projected/27b43a61-5dab-42a0-a314-b81bc799dc6c-kube-api-access-j9vvc\") pod \"node-resolver-np6z6\" (UID: \"27b43a61-5dab-42a0-a314-b81bc799dc6c\") " pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099529    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-daemon-config\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099553    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-tmp\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099586    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-var-lib-kubelet\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099611    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db605d53-5646-4f55-9299-5258fc583cf9-agent-certs\") pod \"konnectivity-agent-kf6ww\" (UID: \"db605d53-5646-4f55-9299-5258fc583cf9\") " pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099622    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-cni-binary-copy\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.100838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099634    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-systemd\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099678    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-systemd\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099694    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-os-release\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099715    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/249e20cb-bbe1-4d3d-afe8-0e339b0f8537-iptables-alerter-script\") pod \"iptables-alerter-fdx4j\" (UID: \"249e20cb-bbe1-4d3d-afe8-0e339b0f8537\") " pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099774    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-sysctl-d\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099792    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-sys\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099809    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-lib-modules\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099830    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-host-var-lib-kubelet\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099831    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-sysconfig\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099407    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db605d53-5646-4f55-9299-5258fc583cf9-konnectivity-ca\") pod \"konnectivity-agent-kf6ww\" (UID: \"db605d53-5646-4f55-9299-5258fc583cf9\") " pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099843    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-var-lib-kubelet\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.099882    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/249e20cb-bbe1-4d3d-afe8-0e339b0f8537-host-slash\") pod \"iptables-alerter-fdx4j\" (UID: \"249e20cb-bbe1-4d3d-afe8-0e339b0f8537\") " pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:51.101699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.100157    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-multus-daemon-config\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.102244 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.101980    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-etc-tuned\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.102244 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.102109    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-tmp\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.102517 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.102491    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db605d53-5646-4f55-9299-5258fc583cf9-agent-certs\") pod \"konnectivity-agent-kf6ww\" (UID: \"db605d53-5646-4f55-9299-5258fc583cf9\") " pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:20:51.109433 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.109346    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52tbh\" (UniqueName: \"kubernetes.io/projected/0dfa6c5c-07c4-4096-b8ce-41cdb17074e9-kube-api-access-52tbh\") pod \"multus-d7j8m\" (UID: \"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9\") " pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.109692 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.109650    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lh25\" (UniqueName: \"kubernetes.io/projected/ce8c0661-c426-4f51-97de-709e4d46b664-kube-api-access-4lh25\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:51.110174 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.110151    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhct6\" (UniqueName: \"kubernetes.io/projected/131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f-kube-api-access-jhct6\") pod \"tuned-pdgxn\" (UID: \"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f\") " pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.110578 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.110558    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h89c4\" (UniqueName: \"kubernetes.io/projected/249e20cb-bbe1-4d3d-afe8-0e339b0f8537-kube-api-access-h89c4\") pod \"iptables-alerter-fdx4j\" (UID: \"249e20cb-bbe1-4d3d-afe8-0e339b0f8537\") " pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:51.110648 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.110558    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9vvc\" (UniqueName: \"kubernetes.io/projected/27b43a61-5dab-42a0-a314-b81bc799dc6c-kube-api-access-j9vvc\") pod \"node-resolver-np6z6\" (UID: \"27b43a61-5dab-42a0-a314-b81bc799dc6c\") " pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:51.187997 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.187959    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch"
May 26 15:20:51.198877 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.198848    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqx9q"
May 26 15:20:51.206767 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.206738    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5bjn"
May 26 15:20:51.210592 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.210534    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:20:51.218227 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.218203    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d7j8m"
May 26 15:20:51.225957 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.225930    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdx4j"
May 26 15:20:51.233481 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.233461    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:20:51.240062 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.240036    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-np6z6"
May 26 15:20:51.245702 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.245682    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pdgxn"
May 26 15:20:51.326597 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.326554    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 15:20:51.604003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.603917    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:51.604003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.603973    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:51.604003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.604011    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:51.604289 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.604069    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:20:51.604289 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.604104    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:51.604289 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.604132    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:20:51.604289 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.604134    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret podName:b5277094-f350-4b44-84a7-18dc051f137b nodeName:}" failed. No retries permitted until 2026-05-26 15:20:52.604119929 +0000 UTC m=+4.176287551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret") pod "global-pull-secret-syncer-zk77v" (UID: "b5277094-f350-4b44-84a7-18dc051f137b") : object "kube-system"/"original-pull-secret" not registered
May 26 15:20:51.604289 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.604151    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:20:51.604289 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.604154    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs podName:ce8c0661-c426-4f51-97de-709e4d46b664 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:52.604148251 +0000 UTC m=+4.176315872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs") pod "network-metrics-daemon-ljhrb" (UID: "ce8c0661-c426-4f51-97de-709e4d46b664") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:51.604289 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.604162    2560 projected.go:194] Error preparing data for projected volume kube-api-access-ghc4z for pod openshift-network-diagnostics/network-check-target-d7kpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:51.604289 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:51.604204    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z podName:f5be5ddd-c88e-4659-bdbe-727479d61265 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:52.60418861 +0000 UTC m=+4.176356245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghc4z" (UniqueName: "kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z") pod "network-check-target-d7kpv" (UID: "f5be5ddd-c88e-4659-bdbe-727479d61265") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:51.789613 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:51.789584    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249e20cb_bbe1_4d3d_afe8_0e339b0f8537.slice/crio-a3eccc996e2ebcd4345bffde563c240d0038bccdc4fcb0e2ef0297abd8737f39 WatchSource:0}: Error finding container a3eccc996e2ebcd4345bffde563c240d0038bccdc4fcb0e2ef0297abd8737f39: Status 404 returned error can't find the container with id a3eccc996e2ebcd4345bffde563c240d0038bccdc4fcb0e2ef0297abd8737f39
May 26 15:20:51.791026 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:51.790948    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2e9d9f_5c38_494c_ae45_5472beb5ef96.slice/crio-29a00862bbb13ee584c57d3fd67ba3af28c53d74aa27fa908d0da45a0c2b68a8 WatchSource:0}: Error finding container 29a00862bbb13ee584c57d3fd67ba3af28c53d74aa27fa908d0da45a0c2b68a8: Status 404 returned error can't find the container with id 29a00862bbb13ee584c57d3fd67ba3af28c53d74aa27fa908d0da45a0c2b68a8
May 26 15:20:51.792237 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:51.792213    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcd8d06_f1a6_4bb4_8fe0_99e943ef05dd.slice/crio-8d4e9b52f2e480d046fbf8044c9ad5bc21d3d94a5b8e82f707f26406be2ca319 WatchSource:0}: Error finding container 8d4e9b52f2e480d046fbf8044c9ad5bc21d3d94a5b8e82f707f26406be2ca319: Status 404 returned error can't find the container with id 8d4e9b52f2e480d046fbf8044c9ad5bc21d3d94a5b8e82f707f26406be2ca319
May 26 15:20:51.793571 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:51.793545    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dfa6c5c_07c4_4096_b8ce_41cdb17074e9.slice/crio-0cef8389c4256a77dc243b58b1ce4b46ae39812649b766d944b422feb5e4ef03 WatchSource:0}: Error finding container 0cef8389c4256a77dc243b58b1ce4b46ae39812649b766d944b422feb5e4ef03: Status 404 returned error can't find the container with id 0cef8389c4256a77dc243b58b1ce4b46ae39812649b766d944b422feb5e4ef03
May 26 15:20:51.795220 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:51.795197    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131b6fdd_2f70_4c4a_a552_dfe6aabf8c9f.slice/crio-22cdbe5dd8c5f25ac6da5f54e39265f0f262c8fe58e2091d94ca7043f2241727 WatchSource:0}: Error finding container 22cdbe5dd8c5f25ac6da5f54e39265f0f262c8fe58e2091d94ca7043f2241727: Status 404 returned error can't find the container with id 22cdbe5dd8c5f25ac6da5f54e39265f0f262c8fe58e2091d94ca7043f2241727
May 26 15:20:51.797335 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:51.797316    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ee8ee6_c760_45d0_a193_aebac77e849a.slice/crio-79f999296231326651e585af535da9ed05e08cd54fc935f6fcab52152d471c65 WatchSource:0}: Error finding container 79f999296231326651e585af535da9ed05e08cd54fc935f6fcab52152d471c65: Status 404 returned error can't find the container with id 79f999296231326651e585af535da9ed05e08cd54fc935f6fcab52152d471c65
May 26 15:20:51.798480 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:51.798459    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b43a61_5dab_42a0_a314_b81bc799dc6c.slice/crio-0fc14024d1587fc2802b2f856eb9e4482eac8df300426231d4a863914c9b689e WatchSource:0}: Error finding container 0fc14024d1587fc2802b2f856eb9e4482eac8df300426231d4a863914c9b689e: Status 404 returned error can't find the container with id 0fc14024d1587fc2802b2f856eb9e4482eac8df300426231d4a863914c9b689e
May 26 15:20:51.799242 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:51.799216    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb605d53_5646_4f55_9299_5258fc583cf9.slice/crio-a01ca55d7557f78d21a537842a6e073f6b601f5c2288d2de2799e217a6c1152f WatchSource:0}: Error finding container a01ca55d7557f78d21a537842a6e073f6b601f5c2288d2de2799e217a6c1152f: Status 404 returned error can't find the container with id a01ca55d7557f78d21a537842a6e073f6b601f5c2288d2de2799e217a6c1152f
May 26 15:20:51.801000 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:20:51.800922    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52061267_92fd_4dfa_bb08_75bc2c9d420f.slice/crio-ef1f42c5e0c9e96b04d67f0c55f86124452c057682287e1de8169fe0e8d17437 WatchSource:0}: Error finding container ef1f42c5e0c9e96b04d67f0c55f86124452c057682287e1de8169fe0e8d17437: Status 404 returned error can't find the container with id ef1f42c5e0c9e96b04d67f0c55f86124452c057682287e1de8169fe0e8d17437
May 26 15:20:51.943453 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.943148    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:15:49 +0000 UTC" deadline="2028-03-03 09:12:05.289783024 +0000 UTC"
May 26 15:20:51.943453 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:51.943435    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15521h51m13.346354281s"
May 26 15:20:52.037791 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.037761    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:52.037947 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:52.037865    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:20:52.046030 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.045997    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch" event={"ID":"db2e9d9f-5c38-494c-ae45-5472beb5ef96","Type":"ContainerStarted","Data":"29a00862bbb13ee584c57d3fd67ba3af28c53d74aa27fa908d0da45a0c2b68a8"}
May 26 15:20:52.047502 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.047465    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal" event={"ID":"ab53f28968cb404326448da577bad436","Type":"ContainerStarted","Data":"6fcbddb9ce6825a7c8ecf73a2710a54ddb6761419ef9e97f6642ffb6b746225c"}
May 26 15:20:52.048428 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.048394    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" event={"ID":"52061267-92fd-4dfa-bb08-75bc2c9d420f","Type":"ContainerStarted","Data":"ef1f42c5e0c9e96b04d67f0c55f86124452c057682287e1de8169fe0e8d17437"}
May 26 15:20:52.049381 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.049344    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqx9q" event={"ID":"a0ee8ee6-c760-45d0-a193-aebac77e849a","Type":"ContainerStarted","Data":"79f999296231326651e585af535da9ed05e08cd54fc935f6fcab52152d471c65"}
May 26 15:20:52.050449 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.050423    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pdgxn" event={"ID":"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f","Type":"ContainerStarted","Data":"22cdbe5dd8c5f25ac6da5f54e39265f0f262c8fe58e2091d94ca7043f2241727"}
May 26 15:20:52.051428 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.051399    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d7j8m" event={"ID":"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9","Type":"ContainerStarted","Data":"0cef8389c4256a77dc243b58b1ce4b46ae39812649b766d944b422feb5e4ef03"}
May 26 15:20:52.052582 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.052561    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" event={"ID":"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd","Type":"ContainerStarted","Data":"8d4e9b52f2e480d046fbf8044c9ad5bc21d3d94a5b8e82f707f26406be2ca319"}
May 26 15:20:52.053319 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.053298    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdx4j" event={"ID":"249e20cb-bbe1-4d3d-afe8-0e339b0f8537","Type":"ContainerStarted","Data":"a3eccc996e2ebcd4345bffde563c240d0038bccdc4fcb0e2ef0297abd8737f39"}
May 26 15:20:52.056779 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.056755    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kf6ww" event={"ID":"db605d53-5646-4f55-9299-5258fc583cf9","Type":"ContainerStarted","Data":"a01ca55d7557f78d21a537842a6e073f6b601f5c2288d2de2799e217a6c1152f"}
May 26 15:20:52.058922 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.058901    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-np6z6" event={"ID":"27b43a61-5dab-42a0-a314-b81bc799dc6c","Type":"ContainerStarted","Data":"0fc14024d1587fc2802b2f856eb9e4482eac8df300426231d4a863914c9b689e"}
May 26 15:20:52.612700 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.612608    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:52.612700 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.612690    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:52.612920 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:52.612734    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:52.612920 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:52.612881    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:20:52.612920 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:52.612899    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:20:52.612920 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:52.612911    2560 projected.go:194] Error preparing data for projected volume kube-api-access-ghc4z for pod openshift-network-diagnostics/network-check-target-d7kpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:52.613114 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:52.612969    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z podName:f5be5ddd-c88e-4659-bdbe-727479d61265 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:54.612950057 +0000 UTC m=+6.185117686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghc4z" (UniqueName: "kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z") pod "network-check-target-d7kpv" (UID: "f5be5ddd-c88e-4659-bdbe-727479d61265") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:52.613114 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:52.613041    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:52.613114 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:52.613074    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs podName:ce8c0661-c426-4f51-97de-709e4d46b664 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:54.61306269 +0000 UTC m=+6.185230325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs") pod "network-metrics-daemon-ljhrb" (UID: "ce8c0661-c426-4f51-97de-709e4d46b664") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:52.613271 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:52.613124    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:20:52.613271 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:52.613152    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret podName:b5277094-f350-4b44-84a7-18dc051f137b nodeName:}" failed. No retries permitted until 2026-05-26 15:20:54.61314288 +0000 UTC m=+6.185310508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret") pod "global-pull-secret-syncer-zk77v" (UID: "b5277094-f350-4b44-84a7-18dc051f137b") : object "kube-system"/"original-pull-secret" not registered
May 26 15:20:53.038636 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:53.038554    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:53.039065 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:53.038694    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:20:53.039065 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:53.038554    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:53.039177 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:53.039128    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:20:53.076333 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:53.076295    2560 generic.go:358] "Generic (PLEG): container finished" podID="909c80c5890e3b696c6ce2036be29b77" containerID="58fd592568ddcec535860a00e851eac691f543c175d7c9e9d30afba7cd893e59" exitCode=0
May 26 15:20:53.077266 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:53.077240    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal" event={"ID":"909c80c5890e3b696c6ce2036be29b77","Type":"ContainerDied","Data":"58fd592568ddcec535860a00e851eac691f543c175d7c9e9d30afba7cd893e59"}
May 26 15:20:53.095820 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:53.095768    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-229.ec2.internal" podStartSLOduration=3.095749283 podStartE2EDuration="3.095749283s" podCreationTimestamp="2026-05-26 15:20:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:20:52.077827031 +0000 UTC m=+3.649994671" watchObservedRunningTime="2026-05-26 15:20:53.095749283 +0000 UTC m=+4.667916927"
May 26 15:20:54.037548 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:54.037509    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:54.037724 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:54.037652    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:20:54.084065 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:54.084028    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal" event={"ID":"909c80c5890e3b696c6ce2036be29b77","Type":"ContainerStarted","Data":"a8697104eec9417e251d1f733046b8eec178ec0a0284293c2d4ceafe2585a116"}
May 26 15:20:54.631678 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:54.631634    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:54.631929 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:54.631711    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:54.631929 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:54.631754    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:54.631929 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:54.631758    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:20:54.631929 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:54.631835    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret podName:b5277094-f350-4b44-84a7-18dc051f137b nodeName:}" failed. No retries permitted until 2026-05-26 15:20:58.631815267 +0000 UTC m=+10.203982903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret") pod "global-pull-secret-syncer-zk77v" (UID: "b5277094-f350-4b44-84a7-18dc051f137b") : object "kube-system"/"original-pull-secret" not registered
May 26 15:20:54.631929 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:54.631863    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:54.631929 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:54.631866    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:20:54.631929 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:54.631890    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:20:54.631929 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:54.631903    2560 projected.go:194] Error preparing data for projected volume kube-api-access-ghc4z for pod openshift-network-diagnostics/network-check-target-d7kpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:54.631929 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:54.631912    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs podName:ce8c0661-c426-4f51-97de-709e4d46b664 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:58.631895629 +0000 UTC m=+10.204063257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs") pod "network-metrics-daemon-ljhrb" (UID: "ce8c0661-c426-4f51-97de-709e4d46b664") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:54.632433 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:54.631947    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z podName:f5be5ddd-c88e-4659-bdbe-727479d61265 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:58.631933192 +0000 UTC m=+10.204100818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghc4z" (UniqueName: "kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z") pod "network-check-target-d7kpv" (UID: "f5be5ddd-c88e-4659-bdbe-727479d61265") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:55.040287 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:55.040209    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:55.040445 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:55.040351    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:20:55.040894 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:55.040746    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:55.040894 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:55.040841    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:20:56.037897 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:56.037859    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:56.038306 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:56.037991    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:20:57.037796 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:57.037758    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:57.037979 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:57.037942    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:20:57.038322 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:57.038263    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:57.038406 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:57.038384    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:20:58.037647 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:58.037599    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:58.037840 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:58.037738    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:20:58.665841 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:58.665774    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:58.666274 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:58.665850    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:58.666274 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:58.665895    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:20:58.666274 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:58.666029    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:20:58.666274 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:58.666117    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret podName:b5277094-f350-4b44-84a7-18dc051f137b nodeName:}" failed. No retries permitted until 2026-05-26 15:21:06.66609414 +0000 UTC m=+18.238261780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret") pod "global-pull-secret-syncer-zk77v" (UID: "b5277094-f350-4b44-84a7-18dc051f137b") : object "kube-system"/"original-pull-secret" not registered
May 26 15:20:58.666274 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:58.666124    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:58.666274 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:58.666045    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:20:58.666274 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:58.666187    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs podName:ce8c0661-c426-4f51-97de-709e4d46b664 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:06.666169848 +0000 UTC m=+18.238337487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs") pod "network-metrics-daemon-ljhrb" (UID: "ce8c0661-c426-4f51-97de-709e4d46b664") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:20:58.666274 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:58.666237    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:20:58.666274 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:58.666253    2560 projected.go:194] Error preparing data for projected volume kube-api-access-ghc4z for pod openshift-network-diagnostics/network-check-target-d7kpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:58.666762 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:58.666299    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z podName:f5be5ddd-c88e-4659-bdbe-727479d61265 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:06.666286787 +0000 UTC m=+18.238454421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghc4z" (UniqueName: "kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z") pod "network-check-target-d7kpv" (UID: "f5be5ddd-c88e-4659-bdbe-727479d61265") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:20:59.042310 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:59.042220    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:20:59.042499 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:20:59.042386    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:20:59.042558 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:59.042508    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:20:59.043349 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:20:59.043140    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:00.038404 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:00.038344    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:00.038910 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:00.038492    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:01.037738 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:01.037702    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:01.037738 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:01.037729    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:01.038077 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:01.037845    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:01.038077 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:01.037988    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:02.037948 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:02.037864    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:02.038407 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:02.037986    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:03.038262 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:03.038222    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:03.038792 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:03.038222    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:03.038792 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:03.038395    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:03.038792 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:03.038440    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:04.037762 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:04.037720    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:04.037937 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:04.037864    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:05.037635 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:05.037510    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:05.038086 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:05.037655    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:05.038086 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:05.037722    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:05.038086 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:05.037833    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:06.037906 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:06.037866    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:06.038301 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:06.038008    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:06.723249 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:06.723200    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:06.723464 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:06.723272    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:06.723464 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:06.723319    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:06.723464 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:06.723401    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:21:06.723464 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:06.723428    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:21:06.723464 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:06.723440    2560 projected.go:194] Error preparing data for projected volume kube-api-access-ghc4z for pod openshift-network-diagnostics/network-check-target-d7kpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:21:06.723464 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:06.723441    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:21:06.723729 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:06.723441    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:21:06.723729 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:06.723495    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret podName:b5277094-f350-4b44-84a7-18dc051f137b nodeName:}" failed. No retries permitted until 2026-05-26 15:21:22.723479065 +0000 UTC m=+34.295646690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret") pod "global-pull-secret-syncer-zk77v" (UID: "b5277094-f350-4b44-84a7-18dc051f137b") : object "kube-system"/"original-pull-secret" not registered
May 26 15:21:06.723729 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:06.723521    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs podName:ce8c0661-c426-4f51-97de-709e4d46b664 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:22.723503605 +0000 UTC m=+34.295671238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs") pod "network-metrics-daemon-ljhrb" (UID: "ce8c0661-c426-4f51-97de-709e4d46b664") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:21:06.723729 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:06.723539    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z podName:f5be5ddd-c88e-4659-bdbe-727479d61265 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:22.723529834 +0000 UTC m=+34.295697470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghc4z" (UniqueName: "kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z") pod "network-check-target-d7kpv" (UID: "f5be5ddd-c88e-4659-bdbe-727479d61265") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:21:07.037594 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:07.037510    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:07.037751 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:07.037647    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:07.037751 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:07.037703    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:07.037857 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:07.037827    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:08.037979 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:08.037942    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:08.038425 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:08.038053    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:09.038451 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:09.038408    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:09.038922 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:09.038424    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:09.038922 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:09.038537    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:09.038922 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:09.038649    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:10.038210 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:10.038069    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:10.038210 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:10.038192    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:10.114822 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:10.114600    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" event={"ID":"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd","Type":"ContainerStarted","Data":"6b1c09953799239e49f8aa933b2bed60c3fba7885fc7e03c763b26e145629753"}
May 26 15:21:10.116171 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:10.116149    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kf6ww" event={"ID":"db605d53-5646-4f55-9299-5258fc583cf9","Type":"ContainerStarted","Data":"88dc7662d102a17b8fd7a5036408d9dd059b6b83fe371d459b57c984aab9158c"}
May 26 15:21:10.117552 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:10.117528    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch" event={"ID":"db2e9d9f-5c38-494c-ae45-5472beb5ef96","Type":"ContainerStarted","Data":"c12fbf6f089db111eb4469f1d46b274ff19a6521e3d3a07c1c86432f056eb51c"}
May 26 15:21:10.119436 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:10.119408    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqx9q" event={"ID":"a0ee8ee6-c760-45d0-a193-aebac77e849a","Type":"ContainerStarted","Data":"0720b49872e1e616992db57721f840ac3316cdbc59c39f4c9b14c10dd2645430"}
May 26 15:21:10.138575 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:10.138487    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-229.ec2.internal" podStartSLOduration=20.138470532 podStartE2EDuration="20.138470532s" podCreationTimestamp="2026-05-26 15:20:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:20:54.102683872 +0000 UTC m=+5.674851512" watchObservedRunningTime="2026-05-26 15:21:10.138470532 +0000 UTC m=+21.710638176"
May 26 15:21:10.153742 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:10.153688    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqx9q" podStartSLOduration=3.088463419 podStartE2EDuration="21.153668802s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:51.799075938 +0000 UTC m=+3.371243558" lastFinishedPulling="2026-05-26 15:21:09.864281305 +0000 UTC m=+21.436448941" observedRunningTime="2026-05-26 15:21:10.152667563 +0000 UTC m=+21.724835208" watchObservedRunningTime="2026-05-26 15:21:10.153668802 +0000 UTC m=+21.725836496"
May 26 15:21:10.168923 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:10.168880    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kf6ww" podStartSLOduration=11.194231107 podStartE2EDuration="21.168863282s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:51.801282249 +0000 UTC m=+3.373449871" lastFinishedPulling="2026-05-26 15:21:01.775914413 +0000 UTC m=+13.348082046" observedRunningTime="2026-05-26 15:21:10.16865921 +0000 UTC m=+21.740826853" watchObservedRunningTime="2026-05-26 15:21:10.168863282 +0000 UTC m=+21.741030926"
May 26 15:21:10.188998 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:10.188813    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pdgxn" podStartSLOduration=3.120461657 podStartE2EDuration="21.188789798s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:51.79697052 +0000 UTC m=+3.369138144" lastFinishedPulling="2026-05-26 15:21:09.865298652 +0000 UTC m=+21.437466285" observedRunningTime="2026-05-26 15:21:10.187980467 +0000 UTC m=+21.760148176" watchObservedRunningTime="2026-05-26 15:21:10.188789798 +0000 UTC m=+21.760957441"
May 26 15:21:11.038160 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.037989    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:11.038307 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.038005    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:11.038307 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:11.038272    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:11.038443 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:11.038331    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:11.068248 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.068221    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 15:21:11.124554 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.124522    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-np6z6" event={"ID":"27b43a61-5dab-42a0-a314-b81bc799dc6c","Type":"ContainerStarted","Data":"7917577a630921f8852c83ea82238a9d7b74129dc952dc3b98fe7efcee7fd6d3"}
May 26 15:21:11.126203 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.126181    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch" event={"ID":"db2e9d9f-5c38-494c-ae45-5472beb5ef96","Type":"ContainerStarted","Data":"fae4f9cb63eaf71e56b6262db55dfbf6b2ab93f0365f59c59ce2b5e320a47bbf"}
May 26 15:21:11.128638 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.128616    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" event={"ID":"52061267-92fd-4dfa-bb08-75bc2c9d420f","Type":"ContainerStarted","Data":"10f07251e3b653b1fcc2dfe7f9a12793c3732ccae2b5b747f802c258da05c70c"}
May 26 15:21:11.128709 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.128641    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" event={"ID":"52061267-92fd-4dfa-bb08-75bc2c9d420f","Type":"ContainerStarted","Data":"bf2028cde92d79a0123ae56ef4a45c7901aef97bd7b5ff12553b82ebb9608b65"}
May 26 15:21:11.128709 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.128653    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" event={"ID":"52061267-92fd-4dfa-bb08-75bc2c9d420f","Type":"ContainerStarted","Data":"43907d9e7e67c363e17aa58161d81500238ea5d823f0c2b930ac7eccbb086b6f"}
May 26 15:21:11.128709 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.128661    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" event={"ID":"52061267-92fd-4dfa-bb08-75bc2c9d420f","Type":"ContainerStarted","Data":"5bfcd5d497cea33a7850eb3ff0dfd653af638894eae9e70621c5b5aecdb19566"}
May 26 15:21:11.128709 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.128669    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" event={"ID":"52061267-92fd-4dfa-bb08-75bc2c9d420f","Type":"ContainerStarted","Data":"7482f70f793031a84439616f780ad8f9ab43fc6af199336b34e3603078bfb8fe"}
May 26 15:21:11.128709 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.128677    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" event={"ID":"52061267-92fd-4dfa-bb08-75bc2c9d420f","Type":"ContainerStarted","Data":"c50e7c64e765779ec8b7676725b5ea7f37b24528b7bc3a104c763b3b2bb3606e"}
May 26 15:21:11.129902 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.129881    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pdgxn" event={"ID":"131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f","Type":"ContainerStarted","Data":"f50cdd2526c4be36e71b7f9d4736001940e140c0f60c7c5c629d47631e60e201"}
May 26 15:21:11.131081 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.131061    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d7j8m" event={"ID":"0dfa6c5c-07c4-4096-b8ce-41cdb17074e9","Type":"ContainerStarted","Data":"642204d10dc9bfb1ff3adcb6d7aac98e9e6f4745435eb9c43dbc6f476e1c348a"}
May 26 15:21:11.132295 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.132269    2560 generic.go:358] "Generic (PLEG): container finished" podID="ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd" containerID="6b1c09953799239e49f8aa933b2bed60c3fba7885fc7e03c763b26e145629753" exitCode=0
May 26 15:21:11.132365 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.132345    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" event={"ID":"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd","Type":"ContainerDied","Data":"6b1c09953799239e49f8aa933b2bed60c3fba7885fc7e03c763b26e145629753"}
May 26 15:21:11.146037 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.145979    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-np6z6" podStartSLOduration=4.081966312 podStartE2EDuration="22.145963704s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:51.800302288 +0000 UTC m=+3.372469920" lastFinishedPulling="2026-05-26 15:21:09.864299686 +0000 UTC m=+21.436467312" observedRunningTime="2026-05-26 15:21:11.14535962 +0000 UTC m=+22.717527264" watchObservedRunningTime="2026-05-26 15:21:11.145963704 +0000 UTC m=+22.718131352"
May 26 15:21:11.163920 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.163874    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-d7j8m" podStartSLOduration=4.077486684 podStartE2EDuration="22.16385954s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:51.795742451 +0000 UTC m=+3.367910076" lastFinishedPulling="2026-05-26 15:21:09.882115306 +0000 UTC m=+21.454282932" observedRunningTime="2026-05-26 15:21:11.163781702 +0000 UTC m=+22.735949345" watchObservedRunningTime="2026-05-26 15:21:11.16385954 +0000 UTC m=+22.736027182"
May 26 15:21:11.530200 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.530146    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:21:11.530876 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.530859    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:21:11.955323 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.955214    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T15:21:11.068237602Z","UUID":"c6763cd5-d275-46ae-963b-689cc1000777","Handler":null,"Name":"","Endpoint":""}
May 26 15:21:11.958606 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.958583    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 15:21:11.958707 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:11.958615    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 15:21:12.038212 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:12.038178    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:12.038409 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:12.038304    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:12.135761 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:12.135676    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdx4j" event={"ID":"249e20cb-bbe1-4d3d-afe8-0e339b0f8537","Type":"ContainerStarted","Data":"8b3bf39d6cbc64ca40b14cfe1f01e907d851466fac73df6ba33291de5fc132a0"}
May 26 15:21:12.137605 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:12.137572    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch" event={"ID":"db2e9d9f-5c38-494c-ae45-5472beb5ef96","Type":"ContainerStarted","Data":"9933536a5573c5fd7732734d3fa0f2263781110bf01f7d0004383ef8f4c36299"}
May 26 15:21:12.137795 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:12.137777    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:21:12.138244 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:12.138227    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kf6ww"
May 26 15:21:12.150820 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:12.150782    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fdx4j" podStartSLOduration=5.078413513 podStartE2EDuration="23.15077065s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:51.791365735 +0000 UTC m=+3.363533355" lastFinishedPulling="2026-05-26 15:21:09.863722864 +0000 UTC m=+21.435890492" observedRunningTime="2026-05-26 15:21:12.150734664 +0000 UTC m=+23.722902309" watchObservedRunningTime="2026-05-26 15:21:12.15077065 +0000 UTC m=+23.722938293"
May 26 15:21:12.184586 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:12.184536    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6lch" podStartSLOduration=3.151143272 podStartE2EDuration="23.184521858s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:51.792902985 +0000 UTC m=+3.365070608" lastFinishedPulling="2026-05-26 15:21:11.826281558 +0000 UTC m=+23.398449194" observedRunningTime="2026-05-26 15:21:12.183875245 +0000 UTC m=+23.756042887" watchObservedRunningTime="2026-05-26 15:21:12.184521858 +0000 UTC m=+23.756689507"
May 26 15:21:13.037991 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:13.037737    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:13.038180 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:13.037758    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:13.038180 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:13.038104    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:13.038180 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:13.038169    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:13.143511 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:13.143458    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" event={"ID":"52061267-92fd-4dfa-bb08-75bc2c9d420f","Type":"ContainerStarted","Data":"aa1ab2056254c7972d9e5eb539ed6f1d5e2bf7f6d23e66604547e5ff591d0763"}
May 26 15:21:14.037296 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:14.037259    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:14.037496 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:14.037385    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:15.037322 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:15.037288    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:15.038018 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:15.037296    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:15.038018 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:15.037450    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:15.038018 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:15.037500    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:16.038287 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:16.038050    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:16.038807 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:16.038311    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:16.151909 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:16.151849    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" event={"ID":"52061267-92fd-4dfa-bb08-75bc2c9d420f","Type":"ContainerStarted","Data":"a4508dd327b7e1ff27c4756e0ef03f7f89eba30751be55d13870c4d1b852fee8"}
May 26 15:21:16.152213 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:16.152162    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:21:16.152213 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:16.152195    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:21:16.153523 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:16.153500    2560 generic.go:358] "Generic (PLEG): container finished" podID="ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd" containerID="e5f8c12da5c98842c765f63d1c5c32fade099310d6d70cfa4d94b35761d21c0c" exitCode=0
May 26 15:21:16.153617 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:16.153543    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" event={"ID":"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd","Type":"ContainerDied","Data":"e5f8c12da5c98842c765f63d1c5c32fade099310d6d70cfa4d94b35761d21c0c"}
May 26 15:21:16.168806 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:16.168776    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:21:16.207782 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:16.207731    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8" podStartSLOduration=9.099910977 podStartE2EDuration="27.207717394s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:51.803340775 +0000 UTC m=+3.375508396" lastFinishedPulling="2026-05-26 15:21:09.911147188 +0000 UTC m=+21.483314813" observedRunningTime="2026-05-26 15:21:16.18068437 +0000 UTC m=+27.752852012" watchObservedRunningTime="2026-05-26 15:21:16.207717394 +0000 UTC m=+27.779885030"
May 26 15:21:17.037610 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.037578    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:17.037856 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.037578    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:17.037856 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:17.037707    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:17.037856 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:17.037755    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:17.156475 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.156446    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:21:17.172543 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.172511    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:21:17.506781 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.506540    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zk77v"]
May 26 15:21:17.506969 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.506877    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:17.507021 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:17.506995    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:17.509681 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.509657    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d7kpv"]
May 26 15:21:17.509818 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.509763    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:17.509883 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:17.509866    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:17.510295 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.510272    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ljhrb"]
May 26 15:21:17.510406 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:17.510354    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:17.510496 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:17.510478    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:18.159278 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:18.159237    2560 generic.go:358] "Generic (PLEG): container finished" podID="ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd" containerID="11efee029de8b57ad3f149c21de90c5e9c44895010cf6e3f483680f718ce9b45" exitCode=0
May 26 15:21:18.159762 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:18.159323    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" event={"ID":"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd","Type":"ContainerDied","Data":"11efee029de8b57ad3f149c21de90c5e9c44895010cf6e3f483680f718ce9b45"}
May 26 15:21:19.039015 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:19.038974    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:19.039250 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:19.039028    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:19.039250 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:19.039099    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:19.039250 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:19.039123    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:19.039250 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:19.039208    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:19.039502 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:19.039303    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:20.165702 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:20.165661    2560 generic.go:358] "Generic (PLEG): container finished" podID="ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd" containerID="231dd367efb933c9c296d7f0c93d54e4e1982aeb0f1e53663ab985ecda629555" exitCode=0
May 26 15:21:20.166532 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:20.165715    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" event={"ID":"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd","Type":"ContainerDied","Data":"231dd367efb933c9c296d7f0c93d54e4e1982aeb0f1e53663ab985ecda629555"}
May 26 15:21:21.037801 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:21.037767    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:21.037801 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:21.037786    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:21.038042 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:21.037774    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:21.038042 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:21.037882    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7kpv" podUID="f5be5ddd-c88e-4659-bdbe-727479d61265"
May 26 15:21:21.038042 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:21.037967    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zk77v" podUID="b5277094-f350-4b44-84a7-18dc051f137b"
May 26 15:21:21.038042 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:21.038024    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:21:22.739501 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.739461    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:22.739501 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.739518    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:22.740106 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.739552    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:22.740106 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:22.739649    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 15:21:22.740106 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:22.739667    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:21:22.740106 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:22.739736    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs podName:ce8c0661-c426-4f51-97de-709e4d46b664 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:54.739719423 +0000 UTC m=+66.311887050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs") pod "network-metrics-daemon-ljhrb" (UID: "ce8c0661-c426-4f51-97de-709e4d46b664") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 15:21:22.740106 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:22.739672    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 15:21:22.740106 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:22.739763    2560 projected.go:194] Error preparing data for projected volume kube-api-access-ghc4z for pod openshift-network-diagnostics/network-check-target-d7kpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:21:22.740106 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:22.739804    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z podName:f5be5ddd-c88e-4659-bdbe-727479d61265 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:54.73978546 +0000 UTC m=+66.311953087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghc4z" (UniqueName: "kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z") pod "network-check-target-d7kpv" (UID: "f5be5ddd-c88e-4659-bdbe-727479d61265") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 15:21:22.740106 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:22.739652    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 15:21:22.740106 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:22.739890    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret podName:b5277094-f350-4b44-84a7-18dc051f137b nodeName:}" failed. No retries permitted until 2026-05-26 15:21:54.739868515 +0000 UTC m=+66.312036151 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret") pod "global-pull-secret-syncer-zk77v" (UID: "b5277094-f350-4b44-84a7-18dc051f137b") : object "kube-system"/"original-pull-secret" not registered
May 26 15:21:22.762072 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.762047    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-229.ec2.internal" event="NodeReady"
May 26 15:21:22.762244 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.762170    2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 15:21:22.796547 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.796514    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78989f7bf8-d2frg"]
May 26 15:21:22.817744 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.817709    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"]
May 26 15:21:22.836234 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.835881    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"]
May 26 15:21:22.836442 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.836248    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:22.836442 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.836352    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"
May 26 15:21:22.839165 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.839140    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 15:21:22.840658 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.840640    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 15:21:22.841126 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.841106    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 15:21:22.841387 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.841351    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 15:21:22.841481 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.841419    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 15:21:22.841544 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.841345    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nl659\""
May 26 15:21:22.841716 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.841697    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj9mv\""
May 26 15:21:22.841801 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.841713    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 15:21:22.841846 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.841801    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 26 15:21:22.852698 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.852668    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"]
May 26 15:21:22.852809 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.852791    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:22.855596 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.855579    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 26 15:21:22.857705 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.857686    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 15:21:22.873815 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.873793    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"]
May 26 15:21:22.873913 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.873822    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"]
May 26 15:21:22.873913 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.873839    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78989f7bf8-d2frg"]
May 26 15:21:22.874003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.873923    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"]
May 26 15:21:22.874003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.873938    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wzgkw"]
May 26 15:21:22.874003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.873949    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:22.877230 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.877208    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 26 15:21:22.877339 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.877236    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 26 15:21:22.877339 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.877273    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 26 15:21:22.877458 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.877339    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 26 15:21:22.892846 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.892823    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-njcdt"]
May 26 15:21:22.892976 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.892958    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:22.895953 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.895932    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 15:21:22.895953 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.895944    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 15:21:22.896120 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.895979    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pt65f\""
May 26 15:21:22.896120 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.896034    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 15:21:22.910991 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.910971    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wzgkw"]
May 26 15:21:22.911109 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.911080    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njcdt"
May 26 15:21:22.911109 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.911086    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njcdt"]
May 26 15:21:22.913990 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.913966    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 15:21:22.914556 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.914539    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 15:21:22.914658 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.914541    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-smt4m\""
May 26 15:21:22.940920 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.940887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bd487f2-2ba7-459f-ac86-23dd96d11eb4-tmp\") pod \"klusterlet-addon-workmgr-5f8ddd9896-zzx9z\" (UID: \"7bd487f2-2ba7-459f-ac86-23dd96d11eb4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:22.941088 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.940928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:22.941088 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.940979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-installation-pull-secrets\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:22.941088 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jwz5\" (UniqueName: \"kubernetes.io/projected/53a25559-9994-4d74-91c1-04ab3afaaa6d-kube-api-access-7jwz5\") pod \"managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq\" (UID: \"53a25559-9994-4d74-91c1-04ab3afaaa6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"
May 26 15:21:22.941088 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-certificates\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:22.941287 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53a25559-9994-4d74-91c1-04ab3afaaa6d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq\" (UID: \"53a25559-9994-4d74-91c1-04ab3afaaa6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"
May 26 15:21:22.941287 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56972302-3a20-4ba8-93ed-5414e16ef6d6-ca-trust-extracted\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:22.941287 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941171    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-bound-sa-token\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:22.941287 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941230    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-image-registry-private-configuration\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:22.941517 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdwqc\" (UniqueName: \"kubernetes.io/projected/7bd487f2-2ba7-459f-ac86-23dd96d11eb4-kube-api-access-mdwqc\") pod \"klusterlet-addon-workmgr-5f8ddd9896-zzx9z\" (UID: \"7bd487f2-2ba7-459f-ac86-23dd96d11eb4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:22.941517 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7bd487f2-2ba7-459f-ac86-23dd96d11eb4-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f8ddd9896-zzx9z\" (UID: \"7bd487f2-2ba7-459f-ac86-23dd96d11eb4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:22.941517 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-trusted-ca\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:22.941517 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:22.941436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5z6v\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-kube-api-access-q5z6v\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.038432 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.038335    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:23.038432 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.038382    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:23.038734 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.038713    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:23.041579 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.041553    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 15:21:23.041753 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.041731    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bd487f2-2ba7-459f-ac86-23dd96d11eb4-tmp\") pod \"klusterlet-addon-workmgr-5f8ddd9896-zzx9z\" (UID: \"7bd487f2-2ba7-459f-ac86-23dd96d11eb4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:23.041854 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.041774    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.041854 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.041805    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-installation-pull-secrets\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.041969 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.041884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc65a42-c872-477d-a3db-545e2aec595e-tmp-dir\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.041969 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.041905    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 15:21:23.041969 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.041916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7ht9\" (UniqueName: \"kubernetes.io/projected/6dc65a42-c872-477d-a3db-545e2aec595e-kube-api-access-c7ht9\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.041969 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.041946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-hub\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.041969 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.041963    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:21:23.042205 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.041983    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78989f7bf8-d2frg: secret "image-registry-tls" not found
May 26 15:21:23.042205 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042174    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bd487f2-2ba7-459f-ac86-23dd96d11eb4-tmp\") pod \"klusterlet-addon-workmgr-5f8ddd9896-zzx9z\" (UID: \"7bd487f2-2ba7-459f-ac86-23dd96d11eb4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:23.042304 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mffqw\" (UniqueName: \"kubernetes.io/projected/333fca6e-6577-47a0-a322-7e4c8046f987-kube-api-access-mffqw\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:23.042304 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.042266    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls podName:56972302-3a20-4ba8-93ed-5414e16ef6d6 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:23.542242839 +0000 UTC m=+35.114410464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls") pod "image-registry-78989f7bf8-d2frg" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6") : secret "image-registry-tls" not found
May 26 15:21:23.042439 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042399    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzb4k\""
May 26 15:21:23.042489 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042467    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgdkb\""
May 26 15:21:23.042576 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.042631 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52z8t\" (UniqueName: \"kubernetes.io/projected/5d040e51-403b-4e81-b02a-0358f8f23ca6-kube-api-access-52z8t\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.042631 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042596    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 15:21:23.042727 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5d040e51-403b-4e81-b02a-0358f8f23ca6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.042727 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042652    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 15:21:23.042727 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042686    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jwz5\" (UniqueName: \"kubernetes.io/projected/53a25559-9994-4d74-91c1-04ab3afaaa6d-kube-api-access-7jwz5\") pod \"managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq\" (UID: \"53a25559-9994-4d74-91c1-04ab3afaaa6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"
May 26 15:21:23.042727 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042713    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-certificates\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.042908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042744    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53a25559-9994-4d74-91c1-04ab3afaaa6d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq\" (UID: \"53a25559-9994-4d74-91c1-04ab3afaaa6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"
May 26 15:21:23.042908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042769    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56972302-3a20-4ba8-93ed-5414e16ef6d6-ca-trust-extracted\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.042908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042794    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-bound-sa-token\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.042908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-ca\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.042908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042850    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-image-registry-private-configuration\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.042908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.042908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:23.043253 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.042956    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdwqc\" (UniqueName: \"kubernetes.io/projected/7bd487f2-2ba7-459f-ac86-23dd96d11eb4-kube-api-access-mdwqc\") pod \"klusterlet-addon-workmgr-5f8ddd9896-zzx9z\" (UID: \"7bd487f2-2ba7-459f-ac86-23dd96d11eb4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:23.043253 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.043001    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7bd487f2-2ba7-459f-ac86-23dd96d11eb4-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f8ddd9896-zzx9z\" (UID: \"7bd487f2-2ba7-459f-ac86-23dd96d11eb4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:23.043253 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.043026    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-trusted-ca\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.043253 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.043054    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5z6v\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-kube-api-access-q5z6v\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.043253 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.043078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc65a42-c872-477d-a3db-545e2aec595e-config-volume\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.043253 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.043106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.043253 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.043123    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56972302-3a20-4ba8-93ed-5414e16ef6d6-ca-trust-extracted\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.043576 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.043462    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-certificates\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.044006 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.043979    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-trusted-ca\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.047272 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.047245    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-installation-pull-secrets\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.047448 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.047428    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53a25559-9994-4d74-91c1-04ab3afaaa6d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq\" (UID: \"53a25559-9994-4d74-91c1-04ab3afaaa6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"
May 26 15:21:23.047515 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.047442    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7bd487f2-2ba7-459f-ac86-23dd96d11eb4-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f8ddd9896-zzx9z\" (UID: \"7bd487f2-2ba7-459f-ac86-23dd96d11eb4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:23.047515 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.047489    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-image-registry-private-configuration\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.053185 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.053161    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5z6v\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-kube-api-access-q5z6v\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.054068 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.053775    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-bound-sa-token\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.054283 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.054262    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jwz5\" (UniqueName: \"kubernetes.io/projected/53a25559-9994-4d74-91c1-04ab3afaaa6d-kube-api-access-7jwz5\") pod \"managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq\" (UID: \"53a25559-9994-4d74-91c1-04ab3afaaa6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"
May 26 15:21:23.055694 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.055674    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdwqc\" (UniqueName: \"kubernetes.io/projected/7bd487f2-2ba7-459f-ac86-23dd96d11eb4-kube-api-access-mdwqc\") pod \"klusterlet-addon-workmgr-5f8ddd9896-zzx9z\" (UID: \"7bd487f2-2ba7-459f-ac86-23dd96d11eb4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:23.143647 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.143611    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52z8t\" (UniqueName: \"kubernetes.io/projected/5d040e51-403b-4e81-b02a-0358f8f23ca6-kube-api-access-52z8t\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.143647 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.143652    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5d040e51-403b-4e81-b02a-0358f8f23ca6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.143937 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.143728    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-ca\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.143937 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.143773    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.143937 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.143789    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:23.143937 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.143849    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc65a42-c872-477d-a3db-545e2aec595e-config-volume\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.143937 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.143868    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.143937 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.143927    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:21:23.144233 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.143945    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc65a42-c872-477d-a3db-545e2aec595e-tmp-dir\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.144233 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.143972    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7ht9\" (UniqueName: \"kubernetes.io/projected/6dc65a42-c872-477d-a3db-545e2aec595e-kube-api-access-c7ht9\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.144233 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.144002    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert podName:333fca6e-6577-47a0-a322-7e4c8046f987 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:23.643983996 +0000 UTC m=+35.216151633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert") pod "ingress-canary-wzgkw" (UID: "333fca6e-6577-47a0-a322-7e4c8046f987") : secret "canary-serving-cert" not found
May 26 15:21:23.144233 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.144023    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-hub\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.144233 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.144052    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mffqw\" (UniqueName: \"kubernetes.io/projected/333fca6e-6577-47a0-a322-7e4c8046f987-kube-api-access-mffqw\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:23.144233 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.144083    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.144578 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.144287    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:21:23.144578 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.144346    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls podName:6dc65a42-c872-477d-a3db-545e2aec595e nodeName:}" failed. No retries permitted until 2026-05-26 15:21:23.644330736 +0000 UTC m=+35.216498370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls") pod "dns-default-njcdt" (UID: "6dc65a42-c872-477d-a3db-545e2aec595e") : secret "dns-default-metrics-tls" not found
May 26 15:21:23.145159 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.144754    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5d040e51-403b-4e81-b02a-0358f8f23ca6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.145159 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.144819    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc65a42-c872-477d-a3db-545e2aec595e-config-volume\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.145159 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.144947    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc65a42-c872-477d-a3db-545e2aec595e-tmp-dir\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.146914 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.146893    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.146914 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.146906    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.147074 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.146940    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-ca\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.147348 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.147330    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5d040e51-403b-4e81-b02a-0358f8f23ca6-hub\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.153669 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.153627    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mffqw\" (UniqueName: \"kubernetes.io/projected/333fca6e-6577-47a0-a322-7e4c8046f987-kube-api-access-mffqw\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:23.153896 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.153872    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7ht9\" (UniqueName: \"kubernetes.io/projected/6dc65a42-c872-477d-a3db-545e2aec595e-kube-api-access-c7ht9\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.153896 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.153887    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52z8t\" (UniqueName: \"kubernetes.io/projected/5d040e51-403b-4e81-b02a-0358f8f23ca6-kube-api-access-52z8t\") pod \"cluster-proxy-proxy-agent-66f4d5c866-4dpqk\" (UID: \"5d040e51-403b-4e81-b02a-0358f8f23ca6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.161847 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.161825    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"
May 26 15:21:23.169738 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.169678    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:23.187355 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.187318    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:21:23.358472 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.358230    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"]
May 26 15:21:23.361053 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.361033    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq"]
May 26 15:21:23.362754 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:21:23.362726    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd487f2_2ba7_459f_ac86_23dd96d11eb4.slice/crio-c19f42f010d905a098f9a4960a18048629950979d432375eb2d1d6d5d40594b8 WatchSource:0}: Error finding container c19f42f010d905a098f9a4960a18048629950979d432375eb2d1d6d5d40594b8: Status 404 returned error can't find the container with id c19f42f010d905a098f9a4960a18048629950979d432375eb2d1d6d5d40594b8
May 26 15:21:23.364627 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:21:23.364533    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53a25559_9994_4d74_91c1_04ab3afaaa6d.slice/crio-fa1999319364ac6163d6d9efa20227e9a323bec0fdb591b274aa7c6bed521d8c WatchSource:0}: Error finding container fa1999319364ac6163d6d9efa20227e9a323bec0fdb591b274aa7c6bed521d8c: Status 404 returned error can't find the container with id fa1999319364ac6163d6d9efa20227e9a323bec0fdb591b274aa7c6bed521d8c
May 26 15:21:23.376303 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.376259    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"]
May 26 15:21:23.547941 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.547907    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:23.548154 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.548077    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:21:23.548154 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.548100    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78989f7bf8-d2frg: secret "image-registry-tls" not found
May 26 15:21:23.548272 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.548176    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls podName:56972302-3a20-4ba8-93ed-5414e16ef6d6 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:24.5481507 +0000 UTC m=+36.120318343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls") pod "image-registry-78989f7bf8-d2frg" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6") : secret "image-registry-tls" not found
May 26 15:21:23.648796 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.648704    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:23.648796 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:23.648786    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:23.649033 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.648845    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:21:23.649033 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.648923    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert podName:333fca6e-6577-47a0-a322-7e4c8046f987 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:24.648904046 +0000 UTC m=+36.221071671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert") pod "ingress-canary-wzgkw" (UID: "333fca6e-6577-47a0-a322-7e4c8046f987") : secret "canary-serving-cert" not found
May 26 15:21:23.649033 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.648936    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:21:23.649033 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:23.648995    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls podName:6dc65a42-c872-477d-a3db-545e2aec595e nodeName:}" failed. No retries permitted until 2026-05-26 15:21:24.648978331 +0000 UTC m=+36.221145971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls") pod "dns-default-njcdt" (UID: "6dc65a42-c872-477d-a3db-545e2aec595e") : secret "dns-default-metrics-tls" not found
May 26 15:21:24.175236 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:24.175190    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z" event={"ID":"7bd487f2-2ba7-459f-ac86-23dd96d11eb4","Type":"ContainerStarted","Data":"c19f42f010d905a098f9a4960a18048629950979d432375eb2d1d6d5d40594b8"}
May 26 15:21:24.176392 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:24.176352    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" event={"ID":"5d040e51-403b-4e81-b02a-0358f8f23ca6","Type":"ContainerStarted","Data":"bb7c82ccde59888ac7e3b3bcd7c60a0f35cfd1a9e735cd7e6a4bd513eb058309"}
May 26 15:21:24.177481 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:24.177449    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq" event={"ID":"53a25559-9994-4d74-91c1-04ab3afaaa6d","Type":"ContainerStarted","Data":"fa1999319364ac6163d6d9efa20227e9a323bec0fdb591b274aa7c6bed521d8c"}
May 26 15:21:24.557389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:24.557338    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:24.557651 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:24.557498    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:21:24.557651 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:24.557521    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78989f7bf8-d2frg: secret "image-registry-tls" not found
May 26 15:21:24.557651 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:24.557591    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls podName:56972302-3a20-4ba8-93ed-5414e16ef6d6 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:26.557571113 +0000 UTC m=+38.129738750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls") pod "image-registry-78989f7bf8-d2frg" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6") : secret "image-registry-tls" not found
May 26 15:21:24.658259 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:24.658226    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:24.658524 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:24.658287    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:24.658524 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:24.658362    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:21:24.658524 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:24.658403    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:21:24.658524 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:24.658445    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls podName:6dc65a42-c872-477d-a3db-545e2aec595e nodeName:}" failed. No retries permitted until 2026-05-26 15:21:26.65843187 +0000 UTC m=+38.230599492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls") pod "dns-default-njcdt" (UID: "6dc65a42-c872-477d-a3db-545e2aec595e") : secret "dns-default-metrics-tls" not found
May 26 15:21:24.658524 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:24.658460    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert podName:333fca6e-6577-47a0-a322-7e4c8046f987 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:26.658453846 +0000 UTC m=+38.230621467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert") pod "ingress-canary-wzgkw" (UID: "333fca6e-6577-47a0-a322-7e4c8046f987") : secret "canary-serving-cert" not found
May 26 15:21:26.193519 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:26.193478    2560 generic.go:358] "Generic (PLEG): container finished" podID="ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd" containerID="034eaeddb50de2022087b0bbfcd7567a65726d1e4a4f8afaa01d22defe23253d" exitCode=0
May 26 15:21:26.194050 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:26.193552    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" event={"ID":"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd","Type":"ContainerDied","Data":"034eaeddb50de2022087b0bbfcd7567a65726d1e4a4f8afaa01d22defe23253d"}
May 26 15:21:26.576444 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:26.576393    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:26.576663 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:26.576560    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:21:26.576663 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:26.576585    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78989f7bf8-d2frg: secret "image-registry-tls" not found
May 26 15:21:26.576663 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:26.576648    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls podName:56972302-3a20-4ba8-93ed-5414e16ef6d6 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:30.576628542 +0000 UTC m=+42.148796187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls") pod "image-registry-78989f7bf8-d2frg" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6") : secret "image-registry-tls" not found
May 26 15:21:26.678632 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:26.677736    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:26.678632 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:26.677820    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:26.678632 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:26.678010    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:21:26.678632 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:26.678072    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls podName:6dc65a42-c872-477d-a3db-545e2aec595e nodeName:}" failed. No retries permitted until 2026-05-26 15:21:30.678053056 +0000 UTC m=+42.250220683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls") pod "dns-default-njcdt" (UID: "6dc65a42-c872-477d-a3db-545e2aec595e") : secret "dns-default-metrics-tls" not found
May 26 15:21:26.678632 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:26.678486    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:21:26.678632 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:26.678534    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert podName:333fca6e-6577-47a0-a322-7e4c8046f987 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:30.678519461 +0000 UTC m=+42.250687088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert") pod "ingress-canary-wzgkw" (UID: "333fca6e-6577-47a0-a322-7e4c8046f987") : secret "canary-serving-cert" not found
May 26 15:21:27.202973 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:27.202861    2560 generic.go:358] "Generic (PLEG): container finished" podID="ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd" containerID="149d94b5d4f9fa804ffe62257338edd45dadf52c1a40cbf3bc947e3231e3f71f" exitCode=0
May 26 15:21:27.202973 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:27.202925    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" event={"ID":"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd","Type":"ContainerDied","Data":"149d94b5d4f9fa804ffe62257338edd45dadf52c1a40cbf3bc947e3231e3f71f"}
May 26 15:21:28.208387 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:28.208108    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" event={"ID":"ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd","Type":"ContainerStarted","Data":"7c29c22b3e131ca1ae21846942d46a3df07758e47a9d4f8d3038e5bf92b3039f"}
May 26 15:21:28.233820 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:28.233758    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j5bjn" podStartSLOduration=5.194409537 podStartE2EDuration="39.233737241s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:51.794553617 +0000 UTC m=+3.366721239" lastFinishedPulling="2026-05-26 15:21:25.833881321 +0000 UTC m=+37.406048943" observedRunningTime="2026-05-26 15:21:28.231052912 +0000 UTC m=+39.803220554" watchObservedRunningTime="2026-05-26 15:21:28.233737241 +0000 UTC m=+39.805904885"
May 26 15:21:30.612782 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:30.612742    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:30.613159 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:30.612896    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:21:30.613159 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:30.612916    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78989f7bf8-d2frg: secret "image-registry-tls" not found
May 26 15:21:30.613159 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:30.612975    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls podName:56972302-3a20-4ba8-93ed-5414e16ef6d6 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:38.612960083 +0000 UTC m=+50.185127704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls") pod "image-registry-78989f7bf8-d2frg" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6") : secret "image-registry-tls" not found
May 26 15:21:30.713644 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:30.713609    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:30.713814 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:30.713665    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:30.713814 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:30.713775    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:21:30.713814 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:30.713783    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:21:30.713951 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:30.713847    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls podName:6dc65a42-c872-477d-a3db-545e2aec595e nodeName:}" failed. No retries permitted until 2026-05-26 15:21:38.713830139 +0000 UTC m=+50.285997763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls") pod "dns-default-njcdt" (UID: "6dc65a42-c872-477d-a3db-545e2aec595e") : secret "dns-default-metrics-tls" not found
May 26 15:21:30.713951 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:30.713866    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert podName:333fca6e-6577-47a0-a322-7e4c8046f987 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:38.713856762 +0000 UTC m=+50.286024383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert") pod "ingress-canary-wzgkw" (UID: "333fca6e-6577-47a0-a322-7e4c8046f987") : secret "canary-serving-cert" not found
May 26 15:21:33.219388 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:33.219338    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z" event={"ID":"7bd487f2-2ba7-459f-ac86-23dd96d11eb4","Type":"ContainerStarted","Data":"4443a220889d8232c634370c23e621b670932ee916ec034238d1062610e2b7bc"}
May 26 15:21:33.219838 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:33.219643    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:33.220787 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:33.220747    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" event={"ID":"5d040e51-403b-4e81-b02a-0358f8f23ca6","Type":"ContainerStarted","Data":"d4707e4e579a160ac6fdf9cbc63123cac5f6178fbff2eca2fc5160bc93e8e653"}
May 26 15:21:33.220916 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:33.220781    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z" podUID="7bd487f2-2ba7-459f-ac86-23dd96d11eb4" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused"
May 26 15:21:33.221928 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:33.221893    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq" event={"ID":"53a25559-9994-4d74-91c1-04ab3afaaa6d","Type":"ContainerStarted","Data":"1913c751dc8457d3389041d124c9e8750ebd37cf05fd357247041bf9a5792ea4"}
May 26 15:21:33.237228 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:33.236812    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z" podStartSLOduration=28.560988763 podStartE2EDuration="38.236793497s" podCreationTimestamp="2026-05-26 15:20:55 +0000 UTC" firstStartedPulling="2026-05-26 15:21:23.36478776 +0000 UTC m=+34.936955398" lastFinishedPulling="2026-05-26 15:21:33.040592503 +0000 UTC m=+44.612760132" observedRunningTime="2026-05-26 15:21:33.235762471 +0000 UTC m=+44.807930115" watchObservedRunningTime="2026-05-26 15:21:33.236793497 +0000 UTC m=+44.808961141"
May 26 15:21:33.251631 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:33.251585    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq" podStartSLOduration=28.570283331 podStartE2EDuration="38.251570188s" podCreationTimestamp="2026-05-26 15:20:55 +0000 UTC" firstStartedPulling="2026-05-26 15:21:23.36641646 +0000 UTC m=+34.938584088" lastFinishedPulling="2026-05-26 15:21:33.04770332 +0000 UTC m=+44.619870945" observedRunningTime="2026-05-26 15:21:33.250917231 +0000 UTC m=+44.823084876" watchObservedRunningTime="2026-05-26 15:21:33.251570188 +0000 UTC m=+44.823737830"
May 26 15:21:34.225557 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:34.225525    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:21:35.227537 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:35.227502    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" event={"ID":"5d040e51-403b-4e81-b02a-0358f8f23ca6","Type":"ContainerStarted","Data":"c3263a8300d4da92e53952e3f1eb988753b5e64c3c7914399deff80c8b7d8135"}
May 26 15:21:35.227537 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:35.227538    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" event={"ID":"5d040e51-403b-4e81-b02a-0358f8f23ca6","Type":"ContainerStarted","Data":"9ee33bca8460bc75e761c8e062e53375c3a57795cbc08ded5044978a3d411277"}
May 26 15:21:35.249029 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:35.248970    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" podStartSLOduration=28.574185836 podStartE2EDuration="40.248956917s" podCreationTimestamp="2026-05-26 15:20:55 +0000 UTC" firstStartedPulling="2026-05-26 15:21:23.385885491 +0000 UTC m=+34.958053117" lastFinishedPulling="2026-05-26 15:21:35.060656574 +0000 UTC m=+46.632824198" observedRunningTime="2026-05-26 15:21:35.247468508 +0000 UTC m=+46.819636153" watchObservedRunningTime="2026-05-26 15:21:35.248956917 +0000 UTC m=+46.821124554"
May 26 15:21:38.671111 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:38.671070    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:38.671541 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:38.671213    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:21:38.671541 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:38.671247    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78989f7bf8-d2frg: secret "image-registry-tls" not found
May 26 15:21:38.671541 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:38.671315    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls podName:56972302-3a20-4ba8-93ed-5414e16ef6d6 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:54.671296993 +0000 UTC m=+66.243464617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls") pod "image-registry-78989f7bf8-d2frg" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6") : secret "image-registry-tls" not found
May 26 15:21:38.771808 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:38.771758    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:38.771945 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:38.771847    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:38.771945 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:38.771896    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:21:38.772009 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:38.771958    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert podName:333fca6e-6577-47a0-a322-7e4c8046f987 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:54.771943617 +0000 UTC m=+66.344111238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert") pod "ingress-canary-wzgkw" (UID: "333fca6e-6577-47a0-a322-7e4c8046f987") : secret "canary-serving-cert" not found
May 26 15:21:38.772009 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:38.771987    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:21:38.772075 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:38.772033    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls podName:6dc65a42-c872-477d-a3db-545e2aec595e nodeName:}" failed. No retries permitted until 2026-05-26 15:21:54.772019047 +0000 UTC m=+66.344186689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls") pod "dns-default-njcdt" (UID: "6dc65a42-c872-477d-a3db-545e2aec595e") : secret "dns-default-metrics-tls" not found
May 26 15:21:49.177914 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:49.177884    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmh8"
May 26 15:21:54.699051 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.699013    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:21:54.699548 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:54.699167    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:21:54.699548 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:54.699182    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78989f7bf8-d2frg: secret "image-registry-tls" not found
May 26 15:21:54.699548 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:54.699239    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls podName:56972302-3a20-4ba8-93ed-5414e16ef6d6 nodeName:}" failed. No retries permitted until 2026-05-26 15:22:26.6992211 +0000 UTC m=+98.271388727 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls") pod "image-registry-78989f7bf8-d2frg" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6") : secret "image-registry-tls" not found
May 26 15:21:54.799943 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.799905    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:54.799943 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.799952    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:21:54.800160 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.799975    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:21:54.800160 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.800003    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:21:54.800160 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.800026    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:54.800160 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:54.800063    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:21:54.800160 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:54.800110    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:21:54.800160 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:54.800126    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert podName:333fca6e-6577-47a0-a322-7e4c8046f987 nodeName:}" failed. No retries permitted until 2026-05-26 15:22:26.800110915 +0000 UTC m=+98.372278536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert") pod "ingress-canary-wzgkw" (UID: "333fca6e-6577-47a0-a322-7e4c8046f987") : secret "canary-serving-cert" not found
May 26 15:21:54.800160 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:54.800147    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls podName:6dc65a42-c872-477d-a3db-545e2aec595e nodeName:}" failed. No retries permitted until 2026-05-26 15:22:26.800136588 +0000 UTC m=+98.372304208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls") pod "dns-default-njcdt" (UID: "6dc65a42-c872-477d-a3db-545e2aec595e") : secret "dns-default-metrics-tls" not found
May 26 15:21:54.803565 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.803541    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 15:21:54.803565 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.803564    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 15:21:54.803725 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.803554    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 15:21:54.810912 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:54.810893    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 15:21:54.810992 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:21:54.810957    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs podName:ce8c0661-c426-4f51-97de-709e4d46b664 nodeName:}" failed. No retries permitted until 2026-05-26 15:22:58.810936618 +0000 UTC m=+130.383104240 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs") pod "network-metrics-daemon-ljhrb" (UID: "ce8c0661-c426-4f51-97de-709e4d46b664") : secret "metrics-daemon-secret" not found
May 26 15:21:54.813408 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.813394    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 15:21:54.814536 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.814518    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5277094-f350-4b44-84a7-18dc051f137b-original-pull-secret\") pod \"global-pull-secret-syncer-zk77v\" (UID: \"b5277094-f350-4b44-84a7-18dc051f137b\") " pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:54.824002 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.823983    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghc4z\" (UniqueName: \"kubernetes.io/projected/f5be5ddd-c88e-4659-bdbe-727479d61265-kube-api-access-ghc4z\") pod \"network-check-target-d7kpv\" (UID: \"f5be5ddd-c88e-4659-bdbe-727479d61265\") " pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:54.868044 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.868022    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zk77v"
May 26 15:21:54.878782 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.878761    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzb4k\""
May 26 15:21:54.886337 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:54.886313    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:55.000706 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:55.000678    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zk77v"]
May 26 15:21:55.003668 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:21:55.003640    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5277094_f350_4b44_84a7_18dc051f137b.slice/crio-5e2809feca0b021693fd9995d20537c86606fd904990dfa472efcbae7d882733 WatchSource:0}: Error finding container 5e2809feca0b021693fd9995d20537c86606fd904990dfa472efcbae7d882733: Status 404 returned error can't find the container with id 5e2809feca0b021693fd9995d20537c86606fd904990dfa472efcbae7d882733
May 26 15:21:55.010513 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:55.010492    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d7kpv"]
May 26 15:21:55.013184 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:21:55.013161    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5be5ddd_c88e_4659_bdbe_727479d61265.slice/crio-6c1b3830830c69005bd8f7dc77780c672dd82a8f6d6048273dccf09aee9089aa WatchSource:0}: Error finding container 6c1b3830830c69005bd8f7dc77780c672dd82a8f6d6048273dccf09aee9089aa: Status 404 returned error can't find the container with id 6c1b3830830c69005bd8f7dc77780c672dd82a8f6d6048273dccf09aee9089aa
May 26 15:21:55.267176 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:55.267141    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d7kpv" event={"ID":"f5be5ddd-c88e-4659-bdbe-727479d61265","Type":"ContainerStarted","Data":"6c1b3830830c69005bd8f7dc77780c672dd82a8f6d6048273dccf09aee9089aa"}
May 26 15:21:55.268172 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:55.268143    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zk77v" event={"ID":"b5277094-f350-4b44-84a7-18dc051f137b","Type":"ContainerStarted","Data":"5e2809feca0b021693fd9995d20537c86606fd904990dfa472efcbae7d882733"}
May 26 15:21:58.277254 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:58.277162    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d7kpv" event={"ID":"f5be5ddd-c88e-4659-bdbe-727479d61265","Type":"ContainerStarted","Data":"e16f188323af8bda077e55db7544153dd0119f95baded20eb8cbb7ab4bdaa015"}
May 26 15:21:58.277710 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:58.277296    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:21:58.293436 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:21:58.293389    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d7kpv" podStartSLOduration=66.314927364 podStartE2EDuration="1m9.293352034s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:21:55.014983167 +0000 UTC m=+66.587150793" lastFinishedPulling="2026-05-26 15:21:57.99340784 +0000 UTC m=+69.565575463" observedRunningTime="2026-05-26 15:21:58.292337213 +0000 UTC m=+69.864504857" watchObservedRunningTime="2026-05-26 15:21:58.293352034 +0000 UTC m=+69.865519679"
May 26 15:22:00.283115 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:22:00.283074    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zk77v" event={"ID":"b5277094-f350-4b44-84a7-18dc051f137b","Type":"ContainerStarted","Data":"cb1cad431dd2e28342a4b9e00d11445650f91c86650d9dec12e6480eb63d1013"}
May 26 15:22:00.298908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:22:00.298856    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zk77v" podStartSLOduration=66.351002901 podStartE2EDuration="1m11.298840063s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:21:55.005339628 +0000 UTC m=+66.577507249" lastFinishedPulling="2026-05-26 15:21:59.953176785 +0000 UTC m=+71.525344411" observedRunningTime="2026-05-26 15:22:00.298014513 +0000 UTC m=+71.870182156" watchObservedRunningTime="2026-05-26 15:22:00.298840063 +0000 UTC m=+71.871007707"
May 26 15:22:26.749164 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:22:26.749119    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:22:26.749701 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:22:26.749261    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 15:22:26.749701 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:22:26.749280    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78989f7bf8-d2frg: secret "image-registry-tls" not found
May 26 15:22:26.749701 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:22:26.749337    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls podName:56972302-3a20-4ba8-93ed-5414e16ef6d6 nodeName:}" failed. No retries permitted until 2026-05-26 15:23:30.749321232 +0000 UTC m=+162.321488853 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls") pod "image-registry-78989f7bf8-d2frg" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6") : secret "image-registry-tls" not found
May 26 15:22:26.849985 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:22:26.849935    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:22:26.850154 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:22:26.850018    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:22:26.850154 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:22:26.850093    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 15:22:26.850154 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:22:26.850112    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 15:22:26.850257 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:22:26.850169    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert podName:333fca6e-6577-47a0-a322-7e4c8046f987 nodeName:}" failed. No retries permitted until 2026-05-26 15:23:30.850154436 +0000 UTC m=+162.422322069 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert") pod "ingress-canary-wzgkw" (UID: "333fca6e-6577-47a0-a322-7e4c8046f987") : secret "canary-serving-cert" not found
May 26 15:22:26.850257 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:22:26.850181    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls podName:6dc65a42-c872-477d-a3db-545e2aec595e nodeName:}" failed. No retries permitted until 2026-05-26 15:23:30.850175509 +0000 UTC m=+162.422343130 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls") pod "dns-default-njcdt" (UID: "6dc65a42-c872-477d-a3db-545e2aec595e") : secret "dns-default-metrics-tls" not found
May 26 15:22:29.282931 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:22:29.282897    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d7kpv"
May 26 15:22:58.893357 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:22:58.893314    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:22:58.893850 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:22:58.893480    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 15:22:58.893850 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:22:58.893547    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs podName:ce8c0661-c426-4f51-97de-709e4d46b664 nodeName:}" failed. No retries permitted until 2026-05-26 15:25:00.893529913 +0000 UTC m=+252.465697535 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs") pod "network-metrics-daemon-ljhrb" (UID: "ce8c0661-c426-4f51-97de-709e4d46b664") : secret "metrics-daemon-secret" not found
May 26 15:23:21.910228 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:21.910198    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-np6z6_27b43a61-5dab-42a0-a314-b81bc799dc6c/dns-node-resolver/0.log"
May 26 15:23:23.110485 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:23.110458    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqx9q_a0ee8ee6-c760-45d0-a193-aebac77e849a/node-ca/0.log"
May 26 15:23:25.849009 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:23:25.848964    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg" podUID="56972302-3a20-4ba8-93ed-5414e16ef6d6"
May 26 15:23:25.917939 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:23:25.917905    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-wzgkw" podUID="333fca6e-6577-47a0-a322-7e4c8046f987"
May 26 15:23:25.924040 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:23:25.924010    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-njcdt" podUID="6dc65a42-c872-477d-a3db-545e2aec595e"
May 26 15:23:26.082090 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:23:26.082030    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ljhrb" podUID="ce8c0661-c426-4f51-97de-709e4d46b664"
May 26 15:23:26.485490 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:26.485462    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:23:26.485658 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:26.485463    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:23:26.485658 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:26.485463    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njcdt"
May 26 15:23:30.846550 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.846454    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:23:30.848944 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.848917    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"image-registry-78989f7bf8-d2frg\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") " pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:23:30.947063 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.947025    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:23:30.947223 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.947093    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:23:30.949588 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.949551    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc65a42-c872-477d-a3db-545e2aec595e-metrics-tls\") pod \"dns-default-njcdt\" (UID: \"6dc65a42-c872-477d-a3db-545e2aec595e\") " pod="openshift-dns/dns-default-njcdt"
May 26 15:23:30.949711 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.949595    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/333fca6e-6577-47a0-a322-7e4c8046f987-cert\") pod \"ingress-canary-wzgkw\" (UID: \"333fca6e-6577-47a0-a322-7e4c8046f987\") " pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:23:30.990921 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.990884    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pt65f\""
May 26 15:23:30.991116 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.990895    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj9mv\""
May 26 15:23:30.991116 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.990896    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-smt4m\""
May 26 15:23:30.997444 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.997422    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:23:30.997554 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.997511    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njcdt"
May 26 15:23:30.997554 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:30.997519    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wzgkw"
May 26 15:23:31.143998 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:31.143941    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78989f7bf8-d2frg"]
May 26 15:23:31.149030 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:23:31.149000    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56972302_3a20_4ba8_93ed_5414e16ef6d6.slice/crio-46ed816dae71f60417883eb3f9949d62b2b94fb161472ee224fcca24ef3c5996 WatchSource:0}: Error finding container 46ed816dae71f60417883eb3f9949d62b2b94fb161472ee224fcca24ef3c5996: Status 404 returned error can't find the container with id 46ed816dae71f60417883eb3f9949d62b2b94fb161472ee224fcca24ef3c5996
May 26 15:23:31.159548 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:31.159519    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njcdt"]
May 26 15:23:31.162803 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:23:31.162771    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc65a42_c872_477d_a3db_545e2aec595e.slice/crio-a22c027735c1205fb700f41021365004c8e7c6ef773c4d3446af8d1dffa5b0ee WatchSource:0}: Error finding container a22c027735c1205fb700f41021365004c8e7c6ef773c4d3446af8d1dffa5b0ee: Status 404 returned error can't find the container with id a22c027735c1205fb700f41021365004c8e7c6ef773c4d3446af8d1dffa5b0ee
May 26 15:23:31.172066 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:31.172037    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wzgkw"]
May 26 15:23:31.177318 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:23:31.177287    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333fca6e_6577_47a0_a322_7e4c8046f987.slice/crio-fb624e344f00f3c4708acd5a9a7f8dd7dbb440a44ab0ccb030f0e9f7f0934aae WatchSource:0}: Error finding container fb624e344f00f3c4708acd5a9a7f8dd7dbb440a44ab0ccb030f0e9f7f0934aae: Status 404 returned error can't find the container with id fb624e344f00f3c4708acd5a9a7f8dd7dbb440a44ab0ccb030f0e9f7f0934aae
May 26 15:23:31.500305 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:31.500268    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wzgkw" event={"ID":"333fca6e-6577-47a0-a322-7e4c8046f987","Type":"ContainerStarted","Data":"fb624e344f00f3c4708acd5a9a7f8dd7dbb440a44ab0ccb030f0e9f7f0934aae"}
May 26 15:23:31.501596 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:31.501566    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg" event={"ID":"56972302-3a20-4ba8-93ed-5414e16ef6d6","Type":"ContainerStarted","Data":"95670790a55b8aa4d1ec3d3594bdf559ef6a430a4c4891c5b2a1c1731a991095"}
May 26 15:23:31.501725 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:31.501604    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg" event={"ID":"56972302-3a20-4ba8-93ed-5414e16ef6d6","Type":"ContainerStarted","Data":"46ed816dae71f60417883eb3f9949d62b2b94fb161472ee224fcca24ef3c5996"}
May 26 15:23:31.501725 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:31.501646    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:23:31.502597 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:31.502579    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njcdt" event={"ID":"6dc65a42-c872-477d-a3db-545e2aec595e","Type":"ContainerStarted","Data":"a22c027735c1205fb700f41021365004c8e7c6ef773c4d3446af8d1dffa5b0ee"}
May 26 15:23:31.523718 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:31.523668    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg" podStartSLOduration=162.523653893 podStartE2EDuration="2m42.523653893s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:23:31.523069766 +0000 UTC m=+163.095237410" watchObservedRunningTime="2026-05-26 15:23:31.523653893 +0000 UTC m=+163.095821535"
May 26 15:23:33.509855 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.509817    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wzgkw" event={"ID":"333fca6e-6577-47a0-a322-7e4c8046f987","Type":"ContainerStarted","Data":"d232aabb744ae629dce066ff4e1ae0648fc8357a41d2b658b0dbe2d0d2ee7d5d"}
May 26 15:23:33.511039 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.511016    2560 generic.go:358] "Generic (PLEG): container finished" podID="53a25559-9994-4d74-91c1-04ab3afaaa6d" containerID="1913c751dc8457d3389041d124c9e8750ebd37cf05fd357247041bf9a5792ea4" exitCode=255
May 26 15:23:33.511142 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.511088    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq" event={"ID":"53a25559-9994-4d74-91c1-04ab3afaaa6d","Type":"ContainerDied","Data":"1913c751dc8457d3389041d124c9e8750ebd37cf05fd357247041bf9a5792ea4"}
May 26 15:23:33.511435 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.511418    2560 scope.go:117] "RemoveContainer" containerID="1913c751dc8457d3389041d124c9e8750ebd37cf05fd357247041bf9a5792ea4"
May 26 15:23:33.512739 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.512683    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njcdt" event={"ID":"6dc65a42-c872-477d-a3db-545e2aec595e","Type":"ContainerStarted","Data":"b78c0056a7feccb5f6ff2b7898fcee0ef870c77a9f1ee1e6e5df96cf6fdf36de"}
May 26 15:23:33.512739 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.512708    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njcdt" event={"ID":"6dc65a42-c872-477d-a3db-545e2aec595e","Type":"ContainerStarted","Data":"a37e732cd266687a57221d2ad8cf77d9b3eac6511d74e3651e0d43e3bc4d4cbc"}
May 26 15:23:33.512860 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.512793    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-njcdt"
May 26 15:23:33.514016 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.513994    2560 generic.go:358] "Generic (PLEG): container finished" podID="7bd487f2-2ba7-459f-ac86-23dd96d11eb4" containerID="4443a220889d8232c634370c23e621b670932ee916ec034238d1062610e2b7bc" exitCode=1
May 26 15:23:33.514099 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.514028    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z" event={"ID":"7bd487f2-2ba7-459f-ac86-23dd96d11eb4","Type":"ContainerDied","Data":"4443a220889d8232c634370c23e621b670932ee916ec034238d1062610e2b7bc"}
May 26 15:23:33.514285 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.514273    2560 scope.go:117] "RemoveContainer" containerID="4443a220889d8232c634370c23e621b670932ee916ec034238d1062610e2b7bc"
May 26 15:23:33.526697 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.526661    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wzgkw" podStartSLOduration=129.634924818 podStartE2EDuration="2m11.526649254s" podCreationTimestamp="2026-05-26 15:21:22 +0000 UTC" firstStartedPulling="2026-05-26 15:23:31.179163457 +0000 UTC m=+162.751331078" lastFinishedPulling="2026-05-26 15:23:33.070887879 +0000 UTC m=+164.643055514" observedRunningTime="2026-05-26 15:23:33.526124211 +0000 UTC m=+165.098291855" watchObservedRunningTime="2026-05-26 15:23:33.526649254 +0000 UTC m=+165.098816897"
May 26 15:23:33.572670 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:33.572613    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-njcdt" podStartSLOduration=129.669867378 podStartE2EDuration="2m11.572593298s" podCreationTimestamp="2026-05-26 15:21:22 +0000 UTC" firstStartedPulling="2026-05-26 15:23:31.164710387 +0000 UTC m=+162.736878008" lastFinishedPulling="2026-05-26 15:23:33.067436305 +0000 UTC m=+164.639603928" observedRunningTime="2026-05-26 15:23:33.571744723 +0000 UTC m=+165.143912366" watchObservedRunningTime="2026-05-26 15:23:33.572593298 +0000 UTC m=+165.144760942"
May 26 15:23:34.225184 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:34.225145    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:23:34.518122 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:34.518020    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z" event={"ID":"7bd487f2-2ba7-459f-ac86-23dd96d11eb4","Type":"ContainerStarted","Data":"828ca03a1a86e47ad1d86ee0cacc2bde71c403d422b84b32248eada94b679ea9"}
May 26 15:23:34.518552 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:34.518203    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:23:34.518854 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:34.518828    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f8ddd9896-zzx9z"
May 26 15:23:34.519671 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:34.519652    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78f49bd8f4-m5hfq" event={"ID":"53a25559-9994-4d74-91c1-04ab3afaaa6d","Type":"ContainerStarted","Data":"9b37c6e6deeffe5ec05122b200659faf6758eec33438e2586728b238ec7df627"}
May 26 15:23:40.037733 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:40.037679    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:23:41.473255 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.473221    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qpd9p"]
May 26 15:23:41.475802 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.475781    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.478569 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.478548    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nz49q\""
May 26 15:23:41.479938 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.479917    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 15:23:41.480046 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.479968    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 15:23:41.480046 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.479967    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 15:23:41.480157 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.480064    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 15:23:41.487271 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.487248    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qpd9p"]
May 26 15:23:41.529975 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.529944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05b08468-114e-4c4d-84a1-e8185bbb767c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.529975 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.529979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05b08468-114e-4c4d-84a1-e8185bbb767c-crio-socket\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.530194 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.529998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b08468-114e-4c4d-84a1-e8185bbb767c-data-volume\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.530194 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.530013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjgtj\" (UniqueName: \"kubernetes.io/projected/05b08468-114e-4c4d-84a1-e8185bbb767c-kube-api-access-gjgtj\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.530194 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.530135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05b08468-114e-4c4d-84a1-e8185bbb767c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.631006 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.630973    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05b08468-114e-4c4d-84a1-e8185bbb767c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.631180 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.631012    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05b08468-114e-4c4d-84a1-e8185bbb767c-crio-socket\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.631180 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.631035    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b08468-114e-4c4d-84a1-e8185bbb767c-data-volume\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.631180 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.631058    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjgtj\" (UniqueName: \"kubernetes.io/projected/05b08468-114e-4c4d-84a1-e8185bbb767c-kube-api-access-gjgtj\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.631180 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.631117    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05b08468-114e-4c4d-84a1-e8185bbb767c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.631180 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.631119    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05b08468-114e-4c4d-84a1-e8185bbb767c-crio-socket\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.631508 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.631487    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b08468-114e-4c4d-84a1-e8185bbb767c-data-volume\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.631682 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.631666    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05b08468-114e-4c4d-84a1-e8185bbb767c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.633256 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.633234    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05b08468-114e-4c4d-84a1-e8185bbb767c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.643864 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.643829    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjgtj\" (UniqueName: \"kubernetes.io/projected/05b08468-114e-4c4d-84a1-e8185bbb767c-kube-api-access-gjgtj\") pod \"insights-runtime-extractor-qpd9p\" (UID: \"05b08468-114e-4c4d-84a1-e8185bbb767c\") " pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.785509 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.785422    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qpd9p"
May 26 15:23:41.907295 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:41.907166    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qpd9p"]
May 26 15:23:41.909986 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:23:41.909957    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b08468_114e_4c4d_84a1_e8185bbb767c.slice/crio-d825ea355800b2a6134cd8bfb05440bb639a04153ef2385c50f0d9c69d8d6f6d WatchSource:0}: Error finding container d825ea355800b2a6134cd8bfb05440bb639a04153ef2385c50f0d9c69d8d6f6d: Status 404 returned error can't find the container with id d825ea355800b2a6134cd8bfb05440bb639a04153ef2385c50f0d9c69d8d6f6d
May 26 15:23:42.544806 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:42.544770    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpd9p" event={"ID":"05b08468-114e-4c4d-84a1-e8185bbb767c","Type":"ContainerStarted","Data":"cc8134eaff1a158a2557684fc1e7dd64bb08f5edf174b7704ad47823d445f064"}
May 26 15:23:42.544806 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:42.544810    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpd9p" event={"ID":"05b08468-114e-4c4d-84a1-e8185bbb767c","Type":"ContainerStarted","Data":"d825ea355800b2a6134cd8bfb05440bb639a04153ef2385c50f0d9c69d8d6f6d"}
May 26 15:23:43.522624 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:43.522587    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-njcdt"
May 26 15:23:43.549961 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:43.549925    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpd9p" event={"ID":"05b08468-114e-4c4d-84a1-e8185bbb767c","Type":"ContainerStarted","Data":"06b1dbfd088ec47a8d794f1d74663a7800d95ab64a72c88aef9cb5f95e877e12"}
May 26 15:23:44.554488 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:44.554457    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpd9p" event={"ID":"05b08468-114e-4c4d-84a1-e8185bbb767c","Type":"ContainerStarted","Data":"a116d1422be219898ee7fd9f088011d067da0c2e523cbcff0fb3cc3f950e1174"}
May 26 15:23:44.573069 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:44.573013    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qpd9p" podStartSLOduration=1.441644802 podStartE2EDuration="3.572996459s" podCreationTimestamp="2026-05-26 15:23:41 +0000 UTC" firstStartedPulling="2026-05-26 15:23:41.965366816 +0000 UTC m=+173.537534443" lastFinishedPulling="2026-05-26 15:23:44.096718464 +0000 UTC m=+175.668886100" observedRunningTime="2026-05-26 15:23:44.572739291 +0000 UTC m=+176.144906936" watchObservedRunningTime="2026-05-26 15:23:44.572996459 +0000 UTC m=+176.145164106"
May 26 15:23:51.002228 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:51.002192    2560 patch_prober.go:28] interesting pod/image-registry-78989f7bf8-d2frg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 26 15:23:51.002603 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:51.002242    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg" podUID="56972302-3a20-4ba8-93ed-5414e16ef6d6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 15:23:52.510040 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:52.510005    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:23:56.264366 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.264326    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-plwvl"]
May 26 15:23:56.266805 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.266789    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.269869 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.269844    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 15:23:56.270001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.269960    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5nr68\""
May 26 15:23:56.270041 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.270012    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 15:23:56.270041 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.270027    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 15:23:56.271772 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.271753    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 15:23:56.271878 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.271776    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 15:23:56.271878 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.271820    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 15:23:56.341639 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.341609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-tls\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.341797 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.341653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-wtmp\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.341797 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.341686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-accelerators-collector-config\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.341797 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.341742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4332f04c-9344-44ca-907c-49c1edbdd148-root\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.341797 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.341761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-textfile\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.341797 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.341778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4332f04c-9344-44ca-907c-49c1edbdd148-metrics-client-ca\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.341982 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.341800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.341982 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.341822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcsjr\" (UniqueName: \"kubernetes.io/projected/4332f04c-9344-44ca-907c-49c1edbdd148-kube-api-access-fcsjr\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.341982 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.341861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4332f04c-9344-44ca-907c-49c1edbdd148-sys\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.442873 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.442834    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-wtmp\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.442873 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.442872    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-accelerators-collector-config\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443108 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.442916    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4332f04c-9344-44ca-907c-49c1edbdd148-root\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443108 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.442936    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-textfile\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443108 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.442954    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4332f04c-9344-44ca-907c-49c1edbdd148-metrics-client-ca\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443108 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.442979    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443108 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.443003    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcsjr\" (UniqueName: \"kubernetes.io/projected/4332f04c-9344-44ca-907c-49c1edbdd148-kube-api-access-fcsjr\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443108 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.443020    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-wtmp\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443108 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.443020    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4332f04c-9344-44ca-907c-49c1edbdd148-root\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443480 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.443156    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4332f04c-9344-44ca-907c-49c1edbdd148-sys\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443480 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.443233    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-tls\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443480 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.443270    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4332f04c-9344-44ca-907c-49c1edbdd148-sys\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443480 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.443333    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-textfile\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443684 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.443660    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-accelerators-collector-config\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.443736 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.443689    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4332f04c-9344-44ca-907c-49c1edbdd148-metrics-client-ca\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.445437 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.445415    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-tls\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.445548 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.445458    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4332f04c-9344-44ca-907c-49c1edbdd148-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.452475 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.452451    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcsjr\" (UniqueName: \"kubernetes.io/projected/4332f04c-9344-44ca-907c-49c1edbdd148-kube-api-access-fcsjr\") pod \"node-exporter-plwvl\" (UID: \"4332f04c-9344-44ca-907c-49c1edbdd148\") " pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.576096 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:56.575998    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-plwvl"
May 26 15:23:56.584322 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:23:56.584281    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4332f04c_9344_44ca_907c_49c1edbdd148.slice/crio-9ae23a39be0ebb051718801d099e8a6fb439d270ef0f7f6731cc723c996c62ac WatchSource:0}: Error finding container 9ae23a39be0ebb051718801d099e8a6fb439d270ef0f7f6731cc723c996c62ac: Status 404 returned error can't find the container with id 9ae23a39be0ebb051718801d099e8a6fb439d270ef0f7f6731cc723c996c62ac
May 26 15:23:57.587979 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:57.587942    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-plwvl" event={"ID":"4332f04c-9344-44ca-907c-49c1edbdd148","Type":"ContainerStarted","Data":"9ae23a39be0ebb051718801d099e8a6fb439d270ef0f7f6731cc723c996c62ac"}
May 26 15:23:58.593419 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:58.593347    2560 generic.go:358] "Generic (PLEG): container finished" podID="4332f04c-9344-44ca-907c-49c1edbdd148" containerID="89c298238396d1bb996b98db907b32f86b86053554a1d01f05e34eda8950041b" exitCode=0
May 26 15:23:58.593936 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:58.593454    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-plwvl" event={"ID":"4332f04c-9344-44ca-907c-49c1edbdd148","Type":"ContainerDied","Data":"89c298238396d1bb996b98db907b32f86b86053554a1d01f05e34eda8950041b"}
May 26 15:23:59.598242 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:59.598202    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-plwvl" event={"ID":"4332f04c-9344-44ca-907c-49c1edbdd148","Type":"ContainerStarted","Data":"dfc2dafdda7334b03be1df1b8d1147b741dbedc161f7cc74661c6199c2632015"}
May 26 15:23:59.598242 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:59.598248    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-plwvl" event={"ID":"4332f04c-9344-44ca-907c-49c1edbdd148","Type":"ContainerStarted","Data":"1eb75e656770cd9afb0c630718c930942d436c345193adb81511a1a3e599b2f9"}
May 26 15:23:59.623571 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:23:59.623512    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-plwvl" podStartSLOduration=2.65457646 podStartE2EDuration="3.623493938s" podCreationTimestamp="2026-05-26 15:23:56 +0000 UTC" firstStartedPulling="2026-05-26 15:23:56.586027271 +0000 UTC m=+188.158194892" lastFinishedPulling="2026-05-26 15:23:57.554944746 +0000 UTC m=+189.127112370" observedRunningTime="2026-05-26 15:23:59.623082041 +0000 UTC m=+191.195249684" watchObservedRunningTime="2026-05-26 15:23:59.623493938 +0000 UTC m=+191.195661581"
May 26 15:24:03.188785 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:03.188748    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" podUID="5d040e51-403b-4e81-b02a-0358f8f23ca6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 15:24:03.477570 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:03.477535    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78989f7bf8-d2frg"]
May 26 15:24:13.189091 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:13.189049    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" podUID="5d040e51-403b-4e81-b02a-0358f8f23ca6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 15:24:23.188952 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:23.188911    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" podUID="5d040e51-403b-4e81-b02a-0358f8f23ca6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 15:24:23.189318 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:23.188992    2560 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk"
May 26 15:24:23.189535 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:23.189499    2560 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c3263a8300d4da92e53952e3f1eb988753b5e64c3c7914399deff80c8b7d8135"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 26 15:24:23.189584 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:23.189557    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" podUID="5d040e51-403b-4e81-b02a-0358f8f23ca6" containerName="service-proxy" containerID="cri-o://c3263a8300d4da92e53952e3f1eb988753b5e64c3c7914399deff80c8b7d8135" gracePeriod=30
May 26 15:24:23.664203 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:23.664165    2560 generic.go:358] "Generic (PLEG): container finished" podID="5d040e51-403b-4e81-b02a-0358f8f23ca6" containerID="c3263a8300d4da92e53952e3f1eb988753b5e64c3c7914399deff80c8b7d8135" exitCode=2
May 26 15:24:23.664424 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:23.664220    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" event={"ID":"5d040e51-403b-4e81-b02a-0358f8f23ca6","Type":"ContainerDied","Data":"c3263a8300d4da92e53952e3f1eb988753b5e64c3c7914399deff80c8b7d8135"}
May 26 15:24:23.664424 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:23.664253    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f4d5c866-4dpqk" event={"ID":"5d040e51-403b-4e81-b02a-0358f8f23ca6","Type":"ContainerStarted","Data":"375be86e02baa490de3f716e89ab9dbca0663d13f3549618489c17c30c835cd6"}
May 26 15:24:28.496393 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.496314    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg" podUID="56972302-3a20-4ba8-93ed-5414e16ef6d6" containerName="registry" containerID="cri-o://95670790a55b8aa4d1ec3d3594bdf559ef6a430a4c4891c5b2a1c1731a991095" gracePeriod=30
May 26 15:24:28.678813 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.678613    2560 generic.go:358] "Generic (PLEG): container finished" podID="56972302-3a20-4ba8-93ed-5414e16ef6d6" containerID="95670790a55b8aa4d1ec3d3594bdf559ef6a430a4c4891c5b2a1c1731a991095" exitCode=0
May 26 15:24:28.678813 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.678700    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg" event={"ID":"56972302-3a20-4ba8-93ed-5414e16ef6d6","Type":"ContainerDied","Data":"95670790a55b8aa4d1ec3d3594bdf559ef6a430a4c4891c5b2a1c1731a991095"}
May 26 15:24:28.744512 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.744481    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:24:28.896943 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.896833    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-trusted-ca\") pod \"56972302-3a20-4ba8-93ed-5414e16ef6d6\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") "
May 26 15:24:28.896943 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.896900    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-image-registry-private-configuration\") pod \"56972302-3a20-4ba8-93ed-5414e16ef6d6\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") "
May 26 15:24:28.896943 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.896931    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5z6v\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-kube-api-access-q5z6v\") pod \"56972302-3a20-4ba8-93ed-5414e16ef6d6\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") "
May 26 15:24:28.897244 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.897091    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-certificates\") pod \"56972302-3a20-4ba8-93ed-5414e16ef6d6\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") "
May 26 15:24:28.897244 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.897130    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56972302-3a20-4ba8-93ed-5414e16ef6d6-ca-trust-extracted\") pod \"56972302-3a20-4ba8-93ed-5414e16ef6d6\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") "
May 26 15:24:28.897244 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.897165    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-installation-pull-secrets\") pod \"56972302-3a20-4ba8-93ed-5414e16ef6d6\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") "
May 26 15:24:28.897244 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.897183    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-bound-sa-token\") pod \"56972302-3a20-4ba8-93ed-5414e16ef6d6\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") "
May 26 15:24:28.897244 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.897221    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") pod \"56972302-3a20-4ba8-93ed-5414e16ef6d6\" (UID: \"56972302-3a20-4ba8-93ed-5414e16ef6d6\") "
May 26 15:24:28.897622 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.897461    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "56972302-3a20-4ba8-93ed-5414e16ef6d6" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:24:28.897622 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.897526    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "56972302-3a20-4ba8-93ed-5414e16ef6d6" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:24:28.899564 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.899520    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "56972302-3a20-4ba8-93ed-5414e16ef6d6" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:24:28.899740 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.899719    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "56972302-3a20-4ba8-93ed-5414e16ef6d6" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:24:28.899792 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.899712    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "56972302-3a20-4ba8-93ed-5414e16ef6d6" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:24:28.899843 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.899790    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-kube-api-access-q5z6v" (OuterVolumeSpecName: "kube-api-access-q5z6v") pod "56972302-3a20-4ba8-93ed-5414e16ef6d6" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6"). InnerVolumeSpecName "kube-api-access-q5z6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:24:28.899961 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.899935    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "56972302-3a20-4ba8-93ed-5414e16ef6d6" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:24:28.905661 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.905636    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56972302-3a20-4ba8-93ed-5414e16ef6d6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "56972302-3a20-4ba8-93ed-5414e16ef6d6" (UID: "56972302-3a20-4ba8-93ed-5414e16ef6d6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:24:28.998669 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.998639    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56972302-3a20-4ba8-93ed-5414e16ef6d6-ca-trust-extracted\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:24:28.998669 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.998664    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-installation-pull-secrets\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:24:28.998669 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.998675    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-bound-sa-token\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:24:28.998877 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.998685    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:24:28.998877 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.998694    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-trusted-ca\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:24:28.998877 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.998702    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56972302-3a20-4ba8-93ed-5414e16ef6d6-image-registry-private-configuration\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:24:28.998877 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.998712    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5z6v\" (UniqueName: \"kubernetes.io/projected/56972302-3a20-4ba8-93ed-5414e16ef6d6-kube-api-access-q5z6v\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:24:28.998877 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:28.998720    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56972302-3a20-4ba8-93ed-5414e16ef6d6-registry-certificates\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:24:29.682251 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:29.682217    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg" event={"ID":"56972302-3a20-4ba8-93ed-5414e16ef6d6","Type":"ContainerDied","Data":"46ed816dae71f60417883eb3f9949d62b2b94fb161472ee224fcca24ef3c5996"}
May 26 15:24:29.682251 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:29.682243    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78989f7bf8-d2frg"
May 26 15:24:29.682251 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:29.682259    2560 scope.go:117] "RemoveContainer" containerID="95670790a55b8aa4d1ec3d3594bdf559ef6a430a4c4891c5b2a1c1731a991095"
May 26 15:24:29.700605 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:29.700577    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78989f7bf8-d2frg"]
May 26 15:24:29.703938 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:29.703913    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78989f7bf8-d2frg"]
May 26 15:24:31.041424 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:24:31.041353    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56972302-3a20-4ba8-93ed-5414e16ef6d6" path="/var/lib/kubelet/pods/56972302-3a20-4ba8-93ed-5414e16ef6d6/volumes"
May 26 15:25:00.934076 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:00.933968    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:25:00.936242 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:00.936220    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c0661-c426-4f51-97de-709e4d46b664-metrics-certs\") pod \"network-metrics-daemon-ljhrb\" (UID: \"ce8c0661-c426-4f51-97de-709e4d46b664\") " pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:25:01.041895 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:01.041864    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgdkb\""
May 26 15:25:01.049318 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:01.049296    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhrb"
May 26 15:25:01.172140 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:01.172101    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ljhrb"]
May 26 15:25:01.175541 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:25:01.175503    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8c0661_c426_4f51_97de_709e4d46b664.slice/crio-d0796025d80be6b182156524ae8c301220e0487b170650af2149c09bf5077ec9 WatchSource:0}: Error finding container d0796025d80be6b182156524ae8c301220e0487b170650af2149c09bf5077ec9: Status 404 returned error can't find the container with id d0796025d80be6b182156524ae8c301220e0487b170650af2149c09bf5077ec9
May 26 15:25:01.765197 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:01.765153    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljhrb" event={"ID":"ce8c0661-c426-4f51-97de-709e4d46b664","Type":"ContainerStarted","Data":"d0796025d80be6b182156524ae8c301220e0487b170650af2149c09bf5077ec9"}
May 26 15:25:02.772476 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:02.772424    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljhrb" event={"ID":"ce8c0661-c426-4f51-97de-709e4d46b664","Type":"ContainerStarted","Data":"933e957bea0803b4a77c7dba672ae8488aff3a093e940ee37fb03cb5df0238fa"}
May 26 15:25:02.772476 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:02.772475    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljhrb" event={"ID":"ce8c0661-c426-4f51-97de-709e4d46b664","Type":"ContainerStarted","Data":"85ee2af7629f5ba7cf6b823ed4d108238300da0b14075c78104ccf1d0f47d7f2"}
May 26 15:25:02.789644 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:02.789597    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ljhrb" podStartSLOduration=252.695690962 podStartE2EDuration="4m13.789582984s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:25:01.177301445 +0000 UTC m=+252.749469067" lastFinishedPulling="2026-05-26 15:25:02.271193465 +0000 UTC m=+253.843361089" observedRunningTime="2026-05-26 15:25:02.78739439 +0000 UTC m=+254.359562030" watchObservedRunningTime="2026-05-26 15:25:02.789582984 +0000 UTC m=+254.361750630"
May 26 15:25:48.895402 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:25:48.895357    2560 kubelet.go:1628] "Image garbage collection succeeded"
May 26 15:27:47.860802 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.860760    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"]
May 26 15:27:47.861331 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.861111    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56972302-3a20-4ba8-93ed-5414e16ef6d6" containerName="registry"
May 26 15:27:47.861331 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.861128    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="56972302-3a20-4ba8-93ed-5414e16ef6d6" containerName="registry"
May 26 15:27:47.861331 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.861191    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="56972302-3a20-4ba8-93ed-5414e16ef6d6" containerName="registry"
May 26 15:27:47.864311 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.864289    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:47.867268 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.867246    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 15:27:47.867268 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.867268    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 15:27:47.867488 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.867277    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 15:27:47.867488 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.867424    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 15:27:47.867488 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.867461    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-lq6dn\""
May 26 15:27:47.867488 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.867481    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 15:27:47.867692 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.867607    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 15:27:47.867758 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.867744    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 26 15:27:47.875805 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.875782    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"]
May 26 15:27:47.997355 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.997325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-ui-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:47.997355 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.997356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-offline-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:47.997581 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.997394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-registry-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:47.997581 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.997421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh6pr\" (UniqueName: \"kubernetes.io/projected/25b3b909-f517-45ac-baf7-f89c5b3826b1-kube-api-access-mh6pr\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:47.997581 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.997465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-online-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:47.997581 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:47.997510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b3b909-f517-45ac-baf7-f89c5b3826b1-feast-data\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.098254 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.098221    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b3b909-f517-45ac-baf7-f89c5b3826b1-feast-data\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.098475 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.098281    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-ui-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.098475 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.098308    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-offline-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.098475 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.098330    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-registry-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.098475 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.098452    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mh6pr\" (UniqueName: \"kubernetes.io/projected/25b3b909-f517-45ac-baf7-f89c5b3826b1-kube-api-access-mh6pr\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.098688 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.098496    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-online-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.098688 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:27:48.098555    2560 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:27:48.098688 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.098567    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b3b909-f517-45ac-baf7-f89c5b3826b1-feast-data\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.098688 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:27:48.098634    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-registry-tls podName:25b3b909-f517-45ac-baf7-f89c5b3826b1 nodeName:}" failed. No retries permitted until 2026-05-26 15:27:48.598612434 +0000 UTC m=+420.170780063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-registry-tls") pod "feast-simple-feast-setup-7fbb8948c6-x6jtv" (UID: "25b3b909-f517-45ac-baf7-f89c5b3826b1") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:27:48.100893 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.100865    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-offline-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.100992 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.100911    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-ui-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.100992 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.100970    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-online-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.107149 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.107115    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh6pr\" (UniqueName: \"kubernetes.io/projected/25b3b909-f517-45ac-baf7-f89c5b3826b1-kube-api-access-mh6pr\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.601925 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.601888    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-registry-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.604186 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.604167    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-registry-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-x6jtv\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.772524 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.772471    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:27:48.899746 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.899724    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"]
May 26 15:27:48.902004 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:27:48.901980    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25b3b909_f517_45ac_baf7_f89c5b3826b1.slice/crio-04ceb34d660fd3f52e411703d21c4b409bc749bd6bff9e45e6b7f25acf1295b1 WatchSource:0}: Error finding container 04ceb34d660fd3f52e411703d21c4b409bc749bd6bff9e45e6b7f25acf1295b1: Status 404 returned error can't find the container with id 04ceb34d660fd3f52e411703d21c4b409bc749bd6bff9e45e6b7f25acf1295b1
May 26 15:27:48.904036 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:48.904018    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:27:49.185323 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:27:49.185243    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerStarted","Data":"04ceb34d660fd3f52e411703d21c4b409bc749bd6bff9e45e6b7f25acf1295b1"}
May 26 15:28:24.279322 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:24.279208    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerStarted","Data":"b5425a446c733e1fd4a7523d804359280f776640885f30b6329a698440b0d49b"}
May 26 15:28:29.293735 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:29.293702    2560 generic.go:358] "Generic (PLEG): container finished" podID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerID="b5425a446c733e1fd4a7523d804359280f776640885f30b6329a698440b0d49b" exitCode=0
May 26 15:28:29.294122 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:29.293775    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerDied","Data":"b5425a446c733e1fd4a7523d804359280f776640885f30b6329a698440b0d49b"}
May 26 15:28:30.298573 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:30.298535    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerStarted","Data":"025e24133a30152828c4ef962c8b016d24f023574356283d37fc08a055cd9745"}
May 26 15:28:35.317855 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:35.317818    2560 generic.go:358] "Generic (PLEG): container finished" podID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerID="025e24133a30152828c4ef962c8b016d24f023574356283d37fc08a055cd9745" exitCode=0
May 26 15:28:35.318311 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:35.317861    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerDied","Data":"025e24133a30152828c4ef962c8b016d24f023574356283d37fc08a055cd9745"}
May 26 15:28:35.324206 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:35.324186    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 26 15:28:36.324900 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.324860    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerStarted","Data":"63d5ff48ee77ead96d8041896c77355d461cbc70b84bd14493d14ecf24a8b99e"}
May 26 15:28:36.325387 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.324909    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerStarted","Data":"f27cdf80b9eb5226ea3f80abfecd0ac59062459d0f759bf9e6f11041a02b79ed"}
May 26 15:28:36.325387 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.324925    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerStarted","Data":"0749328425fedc363ec050470abeb5c329114d3f62db25e9c98d147e3d759646"}
May 26 15:28:36.325387 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.324939    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerStarted","Data":"94284a517a76aa17e1593ac8f8b384b248b3e1af49b0fa31bac1d0fae400e5b7"}
May 26 15:28:36.356086 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.356016    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podStartSLOduration=14.296148648 podStartE2EDuration="49.355994675s" podCreationTimestamp="2026-05-26 15:27:47 +0000 UTC" firstStartedPulling="2026-05-26 15:27:48.904170206 +0000 UTC m=+420.476337830" lastFinishedPulling="2026-05-26 15:28:23.964016227 +0000 UTC m=+455.536183857" observedRunningTime="2026-05-26 15:28:36.354567098 +0000 UTC m=+467.926734776" watchObservedRunningTime="2026-05-26 15:28:36.355994675 +0000 UTC m=+467.928162319"
May 26 15:28:36.773582 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.773538    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:36.773582 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.773592    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:36.773846 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.773605    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:36.773846 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.773617    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:36.775443 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.775404    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.13:8443: connect: connection refused"
May 26 15:28:36.775739 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.775432    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.13:6571: connect: connection refused"
May 26 15:28:36.775739 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.775440    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.13:8816: connect: connection refused"
May 26 15:28:36.775739 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:36.775443    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.13:6567/health\": dial tcp 10.132.0.13:6567: connect: connection refused"
May 26 15:28:38.773199 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:38.773142    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:38.773199 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:38.773208    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:38.773773 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:38.773221    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:38.773773 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:38.773234    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:39.773240 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:39.773197    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.13:6571: connect: connection refused"
May 26 15:28:39.773810 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:39.773197    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.13:8443: connect: connection refused"
May 26 15:28:39.773918 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:39.773224    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.13:8816: connect: connection refused"
May 26 15:28:39.773918 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:39.773261    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.13:6567/health\": dial tcp 10.132.0.13:6567: connect: connection refused"
May 26 15:28:42.773994 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:42.773963    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:42.774346 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:42.774057    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:42.774407 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:42.774345    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:42.774951 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:42.774933    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:42.775049 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:42.774986    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:42.775146 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:42.775133    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:42.778550 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:42.778533    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:28:43.352573 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:28:43.352526    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:29:45.281819 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.281741    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"]
May 26 15:29:45.282273 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.282088    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="registry" containerID="cri-o://94284a517a76aa17e1593ac8f8b384b248b3e1af49b0fa31bac1d0fae400e5b7" gracePeriod=30
May 26 15:29:45.282273 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.282180    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="ui" containerID="cri-o://63d5ff48ee77ead96d8041896c77355d461cbc70b84bd14493d14ecf24a8b99e" gracePeriod=30
May 26 15:29:45.282273 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.282176    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="online" containerID="cri-o://0749328425fedc363ec050470abeb5c329114d3f62db25e9c98d147e3d759646" gracePeriod=30
May 26 15:29:45.282273 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.282183    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="offline" containerID="cri-o://f27cdf80b9eb5226ea3f80abfecd0ac59062459d0f759bf9e6f11041a02b79ed" gracePeriod=30
May 26 15:29:45.565541 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.565451    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"]
May 26 15:29:45.568866 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.568849    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.572129 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.572108    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ltwdw\""
May 26 15:29:45.583247 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.583221    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"]
May 26 15:29:45.660189 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.660143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-online-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.660403 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.660204    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-offline-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.660403 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.660236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-registry-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.660403 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.660271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f984508-43c2-47e5-9df5-289f3dfdc890-feast-data\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.660403 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.660318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-ui-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.660580 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.660402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldg8r\" (UniqueName: \"kubernetes.io/projected/1f984508-43c2-47e5-9df5-289f3dfdc890-kube-api-access-ldg8r\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.761047 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.761004    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f984508-43c2-47e5-9df5-289f3dfdc890-feast-data\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.761199 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.761062    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-ui-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.761199 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.761126    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldg8r\" (UniqueName: \"kubernetes.io/projected/1f984508-43c2-47e5-9df5-289f3dfdc890-kube-api-access-ldg8r\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.761199 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.761158    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-online-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.761404 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.761198    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-offline-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.761404 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.761229    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-registry-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.761404 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:29:45.761337    2560 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:29:45.761567 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:29:45.761428    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-registry-tls podName:1f984508-43c2-47e5-9df5-289f3dfdc890 nodeName:}" failed. No retries permitted until 2026-05-26 15:29:46.261408084 +0000 UTC m=+537.833575721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-registry-tls") pod "feast-simple-feast-setup-7fbb8948c6-btgmd" (UID: "1f984508-43c2-47e5-9df5-289f3dfdc890") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 15:29:45.761567 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.761459    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f984508-43c2-47e5-9df5-289f3dfdc890-feast-data\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.764153 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.764124    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-ui-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.764153 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.764135    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-offline-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.764440 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.764422    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-online-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:45.770693 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:45.770669    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldg8r\" (UniqueName: \"kubernetes.io/projected/1f984508-43c2-47e5-9df5-289f3dfdc890-kube-api-access-ldg8r\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:46.265034 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:46.264988    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-registry-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:46.267334 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:46.267289    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-registry-tls\") pod \"feast-simple-feast-setup-7fbb8948c6-btgmd\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") " pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:46.476965 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:46.476915    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:29:46.511855 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:46.511818    2560 generic.go:358] "Generic (PLEG): container finished" podID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerID="63d5ff48ee77ead96d8041896c77355d461cbc70b84bd14493d14ecf24a8b99e" exitCode=0
May 26 15:29:46.511855 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:46.511844    2560 generic.go:358] "Generic (PLEG): container finished" podID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerID="0749328425fedc363ec050470abeb5c329114d3f62db25e9c98d147e3d759646" exitCode=0
May 26 15:29:46.512104 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:46.511869    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerDied","Data":"63d5ff48ee77ead96d8041896c77355d461cbc70b84bd14493d14ecf24a8b99e"}
May 26 15:29:46.512104 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:46.511893    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerDied","Data":"0749328425fedc363ec050470abeb5c329114d3f62db25e9c98d147e3d759646"}
May 26 15:29:46.608254 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:46.608230    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"]
May 26 15:29:46.609629 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:29:46.609602    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f984508_43c2_47e5_9df5_289f3dfdc890.slice/crio-c55ef4f286d0f5ec69d4739c01257221092082e2a136c71d76f265aed849c916 WatchSource:0}: Error finding container c55ef4f286d0f5ec69d4739c01257221092082e2a136c71d76f265aed849c916: Status 404 returned error can't find the container with id c55ef4f286d0f5ec69d4739c01257221092082e2a136c71d76f265aed849c916
May 26 15:29:47.516317 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:47.516278    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerStarted","Data":"b90c139e5a5415433b0c5f48277e113147c844c91e1ef560441903e866d52030"}
May 26 15:29:47.516721 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:47.516327    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerStarted","Data":"c55ef4f286d0f5ec69d4739c01257221092082e2a136c71d76f265aed849c916"}
May 26 15:29:51.527354 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:51.527301    2560 generic.go:358] "Generic (PLEG): container finished" podID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerID="b90c139e5a5415433b0c5f48277e113147c844c91e1ef560441903e866d52030" exitCode=0
May 26 15:29:51.527740 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:51.527397    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerDied","Data":"b90c139e5a5415433b0c5f48277e113147c844c91e1ef560441903e866d52030"}
May 26 15:29:52.532419 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:52.532385    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerStarted","Data":"62cd81249054dbd8848a2323f1f8f7f05a0224212b9b1943bdebb7047656fdf5"}
May 26 15:29:52.775644 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:52.775575    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.13:8443: connect: connection refused"
May 26 15:29:53.350245 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:53.350186    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.13:6567/health\": dial tcp 10.132.0.13:6567: connect: connection refused"
May 26 15:29:57.546136 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:57.546102    2560 generic.go:358] "Generic (PLEG): container finished" podID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerID="62cd81249054dbd8848a2323f1f8f7f05a0224212b9b1943bdebb7047656fdf5" exitCode=0
May 26 15:29:57.546536 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:57.546169    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerDied","Data":"62cd81249054dbd8848a2323f1f8f7f05a0224212b9b1943bdebb7047656fdf5"}
May 26 15:29:58.554143 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:58.554101    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerStarted","Data":"323ab19a24d805017bb37569915029c20c93538055f73e86134ca3a4158a7144"}
May 26 15:29:58.554625 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:58.554159    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerStarted","Data":"bddb5036273d3b0c9cf8b9c99f3f8043af73230242b86c47ffa08a0e40995164"}
May 26 15:29:58.554625 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:58.554177    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerStarted","Data":"5188e11e99ef4d5d1bbf2aca8c0a5c81bc44e70b156a825e32e13edde3de6d37"}
May 26 15:29:58.554625 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:58.554189    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerStarted","Data":"8bf84a9e2b6105d8fba0c34af0dc3bbcc252269c9d9da807407815cc0c3380ce"}
May 26 15:29:58.581896 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:29:58.581831    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podStartSLOduration=13.581812658 podStartE2EDuration="13.581812658s" podCreationTimestamp="2026-05-26 15:29:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:29:58.579294692 +0000 UTC m=+550.151462339" watchObservedRunningTime="2026-05-26 15:29:58.581812658 +0000 UTC m=+550.153980300"
May 26 15:30:01.477847 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:01.477792    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:01.477847 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:01.477849    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:01.478389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:01.477864    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:01.478389 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:01.478029    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:01.479872 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:01.479834    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="online" probeResult="failure" output="Get \"https://10.132.0.14:6567/health\": dial tcp 10.132.0.14:6567: connect: connection refused"
May 26 15:30:01.480012 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:01.479857    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.14:8816: connect: connection refused"
May 26 15:30:01.480012 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:01.479951    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.14:8443: connect: connection refused"
May 26 15:30:01.480012 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:01.480004    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.14:6571: connect: connection refused"
May 26 15:30:02.775851 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:02.775450    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.13:8443: connect: connection refused"
May 26 15:30:03.350794 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:03.350751    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.13:6567/health\": dial tcp 10.132.0.13:6567: connect: connection refused"
May 26 15:30:04.478720 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.478690    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.479220 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.479197    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.479271 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.479232    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.479457 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.479443    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.479519 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.479509    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.483504 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.483484    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.574107 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.574060    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.574107 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.574103    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.574364 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.574118    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.574459 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.574418    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.574530 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.574509    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:04.576872 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:04.576858    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:30:12.775075 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:12.775026    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.13:8443: connect: connection refused"
May 26 15:30:12.775557 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:12.775169    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:30:13.350449 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:13.350406    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.13:6567/health\": dial tcp 10.132.0.13:6567: connect: connection refused"
May 26 15:30:13.350613 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:13.350553    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:30:15.604775 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.604697    2560 generic.go:358] "Generic (PLEG): container finished" podID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerID="f27cdf80b9eb5226ea3f80abfecd0ac59062459d0f759bf9e6f11041a02b79ed" exitCode=137
May 26 15:30:15.604775 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.604721    2560 generic.go:358] "Generic (PLEG): container finished" podID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerID="94284a517a76aa17e1593ac8f8b384b248b3e1af49b0fa31bac1d0fae400e5b7" exitCode=137
May 26 15:30:15.604775 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.604750    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerDied","Data":"f27cdf80b9eb5226ea3f80abfecd0ac59062459d0f759bf9e6f11041a02b79ed"}
May 26 15:30:15.604775 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.604772    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerDied","Data":"94284a517a76aa17e1593ac8f8b384b248b3e1af49b0fa31bac1d0fae400e5b7"}
May 26 15:30:15.929173 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.929146    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:30:15.991023 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.990984    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh6pr\" (UniqueName: \"kubernetes.io/projected/25b3b909-f517-45ac-baf7-f89c5b3826b1-kube-api-access-mh6pr\") pod \"25b3b909-f517-45ac-baf7-f89c5b3826b1\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") "
May 26 15:30:15.991277 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.991044    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-ui-tls\") pod \"25b3b909-f517-45ac-baf7-f89c5b3826b1\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") "
May 26 15:30:15.991277 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.991068    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-online-tls\") pod \"25b3b909-f517-45ac-baf7-f89c5b3826b1\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") "
May 26 15:30:15.991277 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.991089    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b3b909-f517-45ac-baf7-f89c5b3826b1-feast-data\") pod \"25b3b909-f517-45ac-baf7-f89c5b3826b1\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") "
May 26 15:30:15.991277 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.991112    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-registry-tls\") pod \"25b3b909-f517-45ac-baf7-f89c5b3826b1\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") "
May 26 15:30:15.991277 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.991142    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-offline-tls\") pod \"25b3b909-f517-45ac-baf7-f89c5b3826b1\" (UID: \"25b3b909-f517-45ac-baf7-f89c5b3826b1\") "
May 26 15:30:15.991777 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.991732    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b3b909-f517-45ac-baf7-f89c5b3826b1-feast-data" (OuterVolumeSpecName: "feast-data") pod "25b3b909-f517-45ac-baf7-f89c5b3826b1" (UID: "25b3b909-f517-45ac-baf7-f89c5b3826b1"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:30:15.993558 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.993529    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "25b3b909-f517-45ac-baf7-f89c5b3826b1" (UID: "25b3b909-f517-45ac-baf7-f89c5b3826b1"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:30:15.993558 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.993544    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-online-tls" (OuterVolumeSpecName: "online-tls") pod "25b3b909-f517-45ac-baf7-f89c5b3826b1" (UID: "25b3b909-f517-45ac-baf7-f89c5b3826b1"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:30:15.993716 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.993634    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "25b3b909-f517-45ac-baf7-f89c5b3826b1" (UID: "25b3b909-f517-45ac-baf7-f89c5b3826b1"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:30:15.993716 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.993692    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25b3b909-f517-45ac-baf7-f89c5b3826b1" (UID: "25b3b909-f517-45ac-baf7-f89c5b3826b1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:30:15.993781 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:15.993712    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b3b909-f517-45ac-baf7-f89c5b3826b1-kube-api-access-mh6pr" (OuterVolumeSpecName: "kube-api-access-mh6pr") pod "25b3b909-f517-45ac-baf7-f89c5b3826b1" (UID: "25b3b909-f517-45ac-baf7-f89c5b3826b1"). InnerVolumeSpecName "kube-api-access-mh6pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:30:16.092440 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.092365    2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-ui-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:30:16.092440 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.092437    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-online-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:30:16.092440 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.092448    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b3b909-f517-45ac-baf7-f89c5b3826b1-feast-data\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:30:16.092440 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.092457    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-registry-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:30:16.092718 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.092465    2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b3b909-f517-45ac-baf7-f89c5b3826b1-offline-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:30:16.092718 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.092474    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh6pr\" (UniqueName: \"kubernetes.io/projected/25b3b909-f517-45ac-baf7-f89c5b3826b1-kube-api-access-mh6pr\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:30:16.610106 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.610070    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv" event={"ID":"25b3b909-f517-45ac-baf7-f89c5b3826b1","Type":"ContainerDied","Data":"04ceb34d660fd3f52e411703d21c4b409bc749bd6bff9e45e6b7f25acf1295b1"}
May 26 15:30:16.610106 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.610115    2560 scope.go:117] "RemoveContainer" containerID="63d5ff48ee77ead96d8041896c77355d461cbc70b84bd14493d14ecf24a8b99e"
May 26 15:30:16.610630 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.610077    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"
May 26 15:30:16.618493 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.618471    2560 scope.go:117] "RemoveContainer" containerID="f27cdf80b9eb5226ea3f80abfecd0ac59062459d0f759bf9e6f11041a02b79ed"
May 26 15:30:16.625005 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.624985    2560 scope.go:117] "RemoveContainer" containerID="0749328425fedc363ec050470abeb5c329114d3f62db25e9c98d147e3d759646"
May 26 15:30:16.631176 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.631156    2560 scope.go:117] "RemoveContainer" containerID="94284a517a76aa17e1593ac8f8b384b248b3e1af49b0fa31bac1d0fae400e5b7"
May 26 15:30:16.635317 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.635295    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"]
May 26 15:30:16.638275 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.638233    2560 scope.go:117] "RemoveContainer" containerID="025e24133a30152828c4ef962c8b016d24f023574356283d37fc08a055cd9745"
May 26 15:30:16.639804 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.639784    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-x6jtv"]
May 26 15:30:16.644872 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:16.644857    2560 scope.go:117] "RemoveContainer" containerID="b5425a446c733e1fd4a7523d804359280f776640885f30b6329a698440b0d49b"
May 26 15:30:17.041534 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:30:17.041501    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" path="/var/lib/kubelet/pods/25b3b909-f517-45ac-baf7-f89c5b3826b1/volumes"
May 26 15:31:07.265509 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265475    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"]
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265699    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="feast-init"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265708    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="feast-init"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265719    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="registry"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265725    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="registry"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265733    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="ui"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265739    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="ui"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265746    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="offline"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265751    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="offline"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265756    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="feast-apply"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265761    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="feast-apply"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265768    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="online"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265773    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="online"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265814    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="registry"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265822    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="online"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265828    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="ui"
May 26 15:31:07.265908 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.265834    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="25b3b909-f517-45ac-baf7-f89c5b3826b1" containerName="offline"
May 26 15:31:07.268783 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.268767    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.275820 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.275794    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 15:31:07.275959 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.275796    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 15:31:07.281946 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.281918    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 15:31:07.282068 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.281958    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 15:31:07.286735 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.286716    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 15:31:07.286850 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.286732    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 15:31:07.286850 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.286716    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 26 15:31:07.286850 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.286721    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-55jz6\""
May 26 15:31:07.287997 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.287976    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"]
May 26 15:31:07.343842 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.343805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcfdz\" (UniqueName: \"kubernetes.io/projected/876137b5-3fa2-4166-b9a3-043955463f44-kube-api-access-tcfdz\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.344035 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.343856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-ui-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.344035 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.343901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/876137b5-3fa2-4166-b9a3-043955463f44-feast-data\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.344035 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.343958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-online-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.344035 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.344007    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/876137b5-3fa2-4166-b9a3-043955463f44-registry-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.344214 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.344076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-offline-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.445003 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.444964    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-offline-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.445200 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.445010    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcfdz\" (UniqueName: \"kubernetes.io/projected/876137b5-3fa2-4166-b9a3-043955463f44-kube-api-access-tcfdz\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.445200 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.445057    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-ui-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.445200 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.445096    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/876137b5-3fa2-4166-b9a3-043955463f44-feast-data\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.445350 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.445230    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-online-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.445350 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.445279    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/876137b5-3fa2-4166-b9a3-043955463f44-registry-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.445583 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.445552    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/876137b5-3fa2-4166-b9a3-043955463f44-feast-data\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.445849 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.445831    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/876137b5-3fa2-4166-b9a3-043955463f44-registry-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.447715 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.447689    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-offline-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.447715 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.447704    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-online-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.447859 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.447797    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-ui-tls\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.453235 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.453215    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcfdz\" (UniqueName: \"kubernetes.io/projected/876137b5-3fa2-4166-b9a3-043955463f44-kube-api-access-tcfdz\") pod \"feast-simple-feast-remote-setup-55575497b8-h7wkb\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.578411 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.578296    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:07.704689 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.704660    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"]
May 26 15:31:07.705410 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:31:07.705385    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod876137b5_3fa2_4166_b9a3_043955463f44.slice/crio-0b00c4ba93d2ebde884155fa587b6468658bef081e3a7af8f92848a767577821 WatchSource:0}: Error finding container 0b00c4ba93d2ebde884155fa587b6468658bef081e3a7af8f92848a767577821: Status 404 returned error can't find the container with id 0b00c4ba93d2ebde884155fa587b6468658bef081e3a7af8f92848a767577821
May 26 15:31:07.746605 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:07.746580    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerStarted","Data":"0b00c4ba93d2ebde884155fa587b6468658bef081e3a7af8f92848a767577821"}
May 26 15:31:08.750147 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:08.750110    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerStarted","Data":"a61f1a72f41ae5c3b6037041b9da70f64b0e2ed54e955a19f53fafb8a62b8943"}
May 26 15:31:12.764411 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:12.764357    2560 generic.go:358] "Generic (PLEG): container finished" podID="876137b5-3fa2-4166-b9a3-043955463f44" containerID="a61f1a72f41ae5c3b6037041b9da70f64b0e2ed54e955a19f53fafb8a62b8943" exitCode=0
May 26 15:31:12.764816 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:12.764433    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerDied","Data":"a61f1a72f41ae5c3b6037041b9da70f64b0e2ed54e955a19f53fafb8a62b8943"}
May 26 15:31:13.768843 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:13.768797    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerStarted","Data":"728d3b5991669a6a8d22e71baa29d1a764b939be37a14b9c1ad4670ac8c7e917"}
May 26 15:31:18.784738 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:18.784702    2560 generic.go:358] "Generic (PLEG): container finished" podID="876137b5-3fa2-4166-b9a3-043955463f44" containerID="728d3b5991669a6a8d22e71baa29d1a764b939be37a14b9c1ad4670ac8c7e917" exitCode=0
May 26 15:31:18.785094 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:18.784761    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerDied","Data":"728d3b5991669a6a8d22e71baa29d1a764b939be37a14b9c1ad4670ac8c7e917"}
May 26 15:31:19.790440 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:19.790399    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerStarted","Data":"d9f95e8c7ed1eb728815d24a899f482762d12adc256e5b192bb97f0bdb1cee3c"}
May 26 15:31:19.790788 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:19.790454    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerStarted","Data":"474e3e3a907fdfb2509e3e97fe863a8f213c4623259d22c2784cff7f2e391f15"}
May 26 15:31:19.790788 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:19.790470    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerStarted","Data":"d18194910b78cbd865ef23013c44d5aff7df771e80a54241d820cc962cd11d71"}
May 26 15:31:19.820696 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:19.820627    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podStartSLOduration=12.82060757 podStartE2EDuration="12.82060757s" podCreationTimestamp="2026-05-26 15:31:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:31:19.8191104 +0000 UTC m=+631.391278089" watchObservedRunningTime="2026-05-26 15:31:19.82060757 +0000 UTC m=+631.392775213"
May 26 15:31:22.578934 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:22.578898    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:22.579608 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:22.579574    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:22.579608 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:22.579603    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:22.580774 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:22.580739    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused"
May 26 15:31:22.580881 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:22.580785    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused"
May 26 15:31:22.580881 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:22.580741    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.15:8816: connect: connection refused"
May 26 15:31:25.579713 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:25.579679    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:25.580145 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:25.579854    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:25.580309 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:25.580285    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:25.580404 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:25.580320    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:25.580534 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:25.580502    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:25.580716 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:25.580703    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:25.583666 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:25.583649    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:25.811593 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:25.810860    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:31:25.814687 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:31:25.814660    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:32:28.582097 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:28.581873    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"]
May 26 15:32:28.584805 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:28.582245    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="online" containerID="cri-o://d18194910b78cbd865ef23013c44d5aff7df771e80a54241d820cc962cd11d71" gracePeriod=30
May 26 15:32:28.584805 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:28.582656    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="ui" containerID="cri-o://d9f95e8c7ed1eb728815d24a899f482762d12adc256e5b192bb97f0bdb1cee3c" gracePeriod=30
May 26 15:32:28.584805 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:28.582702    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="offline" containerID="cri-o://474e3e3a907fdfb2509e3e97fe863a8f213c4623259d22c2784cff7f2e391f15" gracePeriod=30
May 26 15:32:28.700260 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:28.700225    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"]
May 26 15:32:28.700921 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:28.700697    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="registry" containerID="cri-o://8bf84a9e2b6105d8fba0c34af0dc3bbcc252269c9d9da807407815cc0c3380ce" gracePeriod=30
May 26 15:32:28.700921 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:28.700799    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="offline" containerID="cri-o://bddb5036273d3b0c9cf8b9c99f3f8043af73230242b86c47ffa08a0e40995164" gracePeriod=30
May 26 15:32:28.700921 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:28.700797    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="ui" containerID="cri-o://323ab19a24d805017bb37569915029c20c93538055f73e86134ca3a4158a7144" gracePeriod=30
May 26 15:32:28.700921 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:28.700797    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="online" containerID="cri-o://5188e11e99ef4d5d1bbf2aca8c0a5c81bc44e70b156a825e32e13edde3de6d37" gracePeriod=30
May 26 15:32:30.006201 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:30.006167    2560 generic.go:358] "Generic (PLEG): container finished" podID="876137b5-3fa2-4166-b9a3-043955463f44" containerID="d9f95e8c7ed1eb728815d24a899f482762d12adc256e5b192bb97f0bdb1cee3c" exitCode=0
May 26 15:32:30.006201 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:30.006193    2560 generic.go:358] "Generic (PLEG): container finished" podID="876137b5-3fa2-4166-b9a3-043955463f44" containerID="d18194910b78cbd865ef23013c44d5aff7df771e80a54241d820cc962cd11d71" exitCode=0
May 26 15:32:30.006681 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:30.006238    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerDied","Data":"d9f95e8c7ed1eb728815d24a899f482762d12adc256e5b192bb97f0bdb1cee3c"}
May 26 15:32:30.006681 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:30.006273    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerDied","Data":"d18194910b78cbd865ef23013c44d5aff7df771e80a54241d820cc962cd11d71"}
May 26 15:32:30.008919 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:30.008897    2560 generic.go:358] "Generic (PLEG): container finished" podID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerID="323ab19a24d805017bb37569915029c20c93538055f73e86134ca3a4158a7144" exitCode=0
May 26 15:32:30.008919 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:30.008916    2560 generic.go:358] "Generic (PLEG): container finished" podID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerID="5188e11e99ef4d5d1bbf2aca8c0a5c81bc44e70b156a825e32e13edde3de6d37" exitCode=0
May 26 15:32:30.009072 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:30.008942    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerDied","Data":"323ab19a24d805017bb37569915029c20c93538055f73e86134ca3a4158a7144"}
May 26 15:32:30.009072 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:30.008961    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerDied","Data":"5188e11e99ef4d5d1bbf2aca8c0a5c81bc44e70b156a825e32e13edde3de6d37"}
May 26 15:32:34.574159 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:34.574112    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="online" probeResult="failure" output="Get \"https://10.132.0.14:6567/health\": dial tcp 10.132.0.14:6567: connect: connection refused"
May 26 15:32:34.574639 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:34.574115    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.14:8443: connect: connection refused"
May 26 15:32:35.581024 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:35.580975    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused"
May 26 15:32:35.811634 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:35.811592    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused"
May 26 15:32:44.574770 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:44.574718    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.14:8443: connect: connection refused"
May 26 15:32:44.575170 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:44.574787    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="online" probeResult="failure" output="Get \"https://10.132.0.14:6567/health\": dial tcp 10.132.0.14:6567: connect: connection refused"
May 26 15:32:45.581108 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:45.581066    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused"
May 26 15:32:45.810951 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:45.810908    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused"
May 26 15:32:54.574350 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:54.574303    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.14:8443: connect: connection refused"
May 26 15:32:54.574796 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:54.574306    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="online" probeResult="failure" output="Get \"https://10.132.0.14:6567/health\": dial tcp 10.132.0.14:6567: connect: connection refused"
May 26 15:32:54.574796 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:54.574467    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:32:54.574796 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:54.574537    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:32:55.580733 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:55.580691    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.15:8443: connect: connection refused"
May 26 15:32:55.581152 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:55.580815    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:32:55.811040 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:55.811001    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.15:6567/health\": dial tcp 10.132.0.15:6567: connect: connection refused"
May 26 15:32:55.811207 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:55.811129    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:32:59.089402 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.089350    2560 generic.go:358] "Generic (PLEG): container finished" podID="876137b5-3fa2-4166-b9a3-043955463f44" containerID="474e3e3a907fdfb2509e3e97fe863a8f213c4623259d22c2784cff7f2e391f15" exitCode=137
May 26 15:32:59.089815 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.089425    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerDied","Data":"474e3e3a907fdfb2509e3e97fe863a8f213c4623259d22c2784cff7f2e391f15"}
May 26 15:32:59.091819 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.091795    2560 generic.go:358] "Generic (PLEG): container finished" podID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerID="bddb5036273d3b0c9cf8b9c99f3f8043af73230242b86c47ffa08a0e40995164" exitCode=137
May 26 15:32:59.091819 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.091814    2560 generic.go:358] "Generic (PLEG): container finished" podID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerID="8bf84a9e2b6105d8fba0c34af0dc3bbcc252269c9d9da807407815cc0c3380ce" exitCode=137
May 26 15:32:59.091964 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.091871    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerDied","Data":"bddb5036273d3b0c9cf8b9c99f3f8043af73230242b86c47ffa08a0e40995164"}
May 26 15:32:59.091964 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.091911    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerDied","Data":"8bf84a9e2b6105d8fba0c34af0dc3bbcc252269c9d9da807407815cc0c3380ce"}
May 26 15:32:59.224907 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.224886    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:32:59.335788 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.335765    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:32:59.372327 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.372251    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-ui-tls\") pod \"876137b5-3fa2-4166-b9a3-043955463f44\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") "
May 26 15:32:59.372327 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.372305    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/876137b5-3fa2-4166-b9a3-043955463f44-feast-data\") pod \"876137b5-3fa2-4166-b9a3-043955463f44\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") "
May 26 15:32:59.372327 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.372328    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcfdz\" (UniqueName: \"kubernetes.io/projected/876137b5-3fa2-4166-b9a3-043955463f44-kube-api-access-tcfdz\") pod \"876137b5-3fa2-4166-b9a3-043955463f44\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") "
May 26 15:32:59.372633 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.372381    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-online-tls\") pod \"876137b5-3fa2-4166-b9a3-043955463f44\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") "
May 26 15:32:59.372633 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.372408    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/876137b5-3fa2-4166-b9a3-043955463f44-registry-tls\") pod \"876137b5-3fa2-4166-b9a3-043955463f44\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") "
May 26 15:32:59.372633 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.372432    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-offline-tls\") pod \"876137b5-3fa2-4166-b9a3-043955463f44\" (UID: \"876137b5-3fa2-4166-b9a3-043955463f44\") "
May 26 15:32:59.372960 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.372919    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/876137b5-3fa2-4166-b9a3-043955463f44-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "876137b5-3fa2-4166-b9a3-043955463f44" (UID: "876137b5-3fa2-4166-b9a3-043955463f44"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 15:32:59.373078 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.372995    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876137b5-3fa2-4166-b9a3-043955463f44-feast-data" (OuterVolumeSpecName: "feast-data") pod "876137b5-3fa2-4166-b9a3-043955463f44" (UID: "876137b5-3fa2-4166-b9a3-043955463f44"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:32:59.374723 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.374695    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876137b5-3fa2-4166-b9a3-043955463f44-kube-api-access-tcfdz" (OuterVolumeSpecName: "kube-api-access-tcfdz") pod "876137b5-3fa2-4166-b9a3-043955463f44" (UID: "876137b5-3fa2-4166-b9a3-043955463f44"). InnerVolumeSpecName "kube-api-access-tcfdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:32:59.374723 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.374715    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "876137b5-3fa2-4166-b9a3-043955463f44" (UID: "876137b5-3fa2-4166-b9a3-043955463f44"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:59.374859 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.374838    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "876137b5-3fa2-4166-b9a3-043955463f44" (UID: "876137b5-3fa2-4166-b9a3-043955463f44"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:59.374909 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.374868    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-online-tls" (OuterVolumeSpecName: "online-tls") pod "876137b5-3fa2-4166-b9a3-043955463f44" (UID: "876137b5-3fa2-4166-b9a3-043955463f44"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:59.473421 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473346    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-ui-tls\") pod \"1f984508-43c2-47e5-9df5-289f3dfdc890\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") "
May 26 15:32:59.473421 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473432    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f984508-43c2-47e5-9df5-289f3dfdc890-feast-data\") pod \"1f984508-43c2-47e5-9df5-289f3dfdc890\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") "
May 26 15:32:59.473664 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473453    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-online-tls\") pod \"1f984508-43c2-47e5-9df5-289f3dfdc890\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") "
May 26 15:32:59.473664 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473488    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-offline-tls\") pod \"1f984508-43c2-47e5-9df5-289f3dfdc890\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") "
May 26 15:32:59.473664 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473509    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldg8r\" (UniqueName: \"kubernetes.io/projected/1f984508-43c2-47e5-9df5-289f3dfdc890-kube-api-access-ldg8r\") pod \"1f984508-43c2-47e5-9df5-289f3dfdc890\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") "
May 26 15:32:59.473664 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473543    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-registry-tls\") pod \"1f984508-43c2-47e5-9df5-289f3dfdc890\" (UID: \"1f984508-43c2-47e5-9df5-289f3dfdc890\") "
May 26 15:32:59.473865 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473713    2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-ui-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.473865 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473729    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/876137b5-3fa2-4166-b9a3-043955463f44-feast-data\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.473865 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473746    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcfdz\" (UniqueName: \"kubernetes.io/projected/876137b5-3fa2-4166-b9a3-043955463f44-kube-api-access-tcfdz\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.473865 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473761    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-online-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.473865 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473774    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/876137b5-3fa2-4166-b9a3-043955463f44-registry-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.473865 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473787    2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/876137b5-3fa2-4166-b9a3-043955463f44-offline-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.474146 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.473963    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f984508-43c2-47e5-9df5-289f3dfdc890-feast-data" (OuterVolumeSpecName: "feast-data") pod "1f984508-43c2-47e5-9df5-289f3dfdc890" (UID: "1f984508-43c2-47e5-9df5-289f3dfdc890"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:32:59.475696 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.475661    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1f984508-43c2-47e5-9df5-289f3dfdc890" (UID: "1f984508-43c2-47e5-9df5-289f3dfdc890"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:59.475808 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.475676    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1f984508-43c2-47e5-9df5-289f3dfdc890" (UID: "1f984508-43c2-47e5-9df5-289f3dfdc890"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:59.475808 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.475712    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f984508-43c2-47e5-9df5-289f3dfdc890-kube-api-access-ldg8r" (OuterVolumeSpecName: "kube-api-access-ldg8r") pod "1f984508-43c2-47e5-9df5-289f3dfdc890" (UID: "1f984508-43c2-47e5-9df5-289f3dfdc890"). InnerVolumeSpecName "kube-api-access-ldg8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:32:59.475936 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.475920    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-online-tls" (OuterVolumeSpecName: "online-tls") pod "1f984508-43c2-47e5-9df5-289f3dfdc890" (UID: "1f984508-43c2-47e5-9df5-289f3dfdc890"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:59.476049 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.476034    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1f984508-43c2-47e5-9df5-289f3dfdc890" (UID: "1f984508-43c2-47e5-9df5-289f3dfdc890"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:32:59.574592 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.574561    2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-offline-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.574592 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.574591    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldg8r\" (UniqueName: \"kubernetes.io/projected/1f984508-43c2-47e5-9df5-289f3dfdc890-kube-api-access-ldg8r\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.574758 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.574601    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-registry-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.574758 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.574611    2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-ui-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.574758 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.574619    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f984508-43c2-47e5-9df5-289f3dfdc890-feast-data\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:32:59.574758 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:32:59.574627    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f984508-43c2-47e5-9df5-289f3dfdc890-online-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:33:00.096445 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.096404    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb" event={"ID":"876137b5-3fa2-4166-b9a3-043955463f44","Type":"ContainerDied","Data":"0b00c4ba93d2ebde884155fa587b6468658bef081e3a7af8f92848a767577821"}
May 26 15:33:00.096901 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.096454    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"
May 26 15:33:00.096901 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.096463    2560 scope.go:117] "RemoveContainer" containerID="d9f95e8c7ed1eb728815d24a899f482762d12adc256e5b192bb97f0bdb1cee3c"
May 26 15:33:00.099060 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.099041    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"
May 26 15:33:00.099060 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.099045    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd" event={"ID":"1f984508-43c2-47e5-9df5-289f3dfdc890","Type":"ContainerDied","Data":"c55ef4f286d0f5ec69d4739c01257221092082e2a136c71d76f265aed849c916"}
May 26 15:33:00.104668 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.104649    2560 scope.go:117] "RemoveContainer" containerID="474e3e3a907fdfb2509e3e97fe863a8f213c4623259d22c2784cff7f2e391f15"
May 26 15:33:00.111711 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.111700    2560 scope.go:117] "RemoveContainer" containerID="d18194910b78cbd865ef23013c44d5aff7df771e80a54241d820cc962cd11d71"
May 26 15:33:00.118152 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.118132    2560 scope.go:117] "RemoveContainer" containerID="728d3b5991669a6a8d22e71baa29d1a764b939be37a14b9c1ad4670ac8c7e917"
May 26 15:33:00.123572 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.123549    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"]
May 26 15:33:00.125056 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.125042    2560 scope.go:117] "RemoveContainer" containerID="a61f1a72f41ae5c3b6037041b9da70f64b0e2ed54e955a19f53fafb8a62b8943"
May 26 15:33:00.128178 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.128156    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fbb8948c6-btgmd"]
May 26 15:33:00.131573 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.131557    2560 scope.go:117] "RemoveContainer" containerID="323ab19a24d805017bb37569915029c20c93538055f73e86134ca3a4158a7144"
May 26 15:33:00.138808 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.138771    2560 scope.go:117] "RemoveContainer" containerID="bddb5036273d3b0c9cf8b9c99f3f8043af73230242b86c47ffa08a0e40995164"
May 26 15:33:00.139641 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.139609    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"]
May 26 15:33:00.143063 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.143040    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-55575497b8-h7wkb"]
May 26 15:33:00.145381 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.145350    2560 scope.go:117] "RemoveContainer" containerID="5188e11e99ef4d5d1bbf2aca8c0a5c81bc44e70b156a825e32e13edde3de6d37"
May 26 15:33:00.151487 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.151459    2560 scope.go:117] "RemoveContainer" containerID="8bf84a9e2b6105d8fba0c34af0dc3bbcc252269c9d9da807407815cc0c3380ce"
May 26 15:33:00.157466 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.157448    2560 scope.go:117] "RemoveContainer" containerID="62cd81249054dbd8848a2323f1f8f7f05a0224212b9b1943bdebb7047656fdf5"
May 26 15:33:00.165001 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:00.164976    2560 scope.go:117] "RemoveContainer" containerID="b90c139e5a5415433b0c5f48277e113147c844c91e1ef560441903e866d52030"
May 26 15:33:01.041175 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:01.041142    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" path="/var/lib/kubelet/pods/1f984508-43c2-47e5-9df5-289f3dfdc890/volumes"
May 26 15:33:01.041733 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:01.041719    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="876137b5-3fa2-4166-b9a3-043955463f44" path="/var/lib/kubelet/pods/876137b5-3fa2-4166-b9a3-043955463f44/volumes"
May 26 15:33:11.688219 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688180    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-cvvw5"]
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688436    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="offline"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688448    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="offline"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688457    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="ui"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688463    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="ui"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688470    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="online"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688476    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="online"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688485    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="offline"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688490    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="offline"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688499    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="feast-apply"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688503    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="feast-apply"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688512    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="feast-init"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688516    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="feast-init"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688522    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="registry"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688527    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="registry"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688536    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="online"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688541    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="online"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688546    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="feast-apply"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688551    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="feast-apply"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688557    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="feast-init"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688562    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="feast-init"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688568    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="ui"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688572    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="ui"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688610    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="offline"
May 26 15:33:11.688609 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688630    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="ui"
May 26 15:33:11.689291 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688636    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="online"
May 26 15:33:11.689291 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688642    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="offline"
May 26 15:33:11.689291 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688647    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="ui"
May 26 15:33:11.689291 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688653    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f984508-43c2-47e5-9df5-289f3dfdc890" containerName="registry"
May 26 15:33:11.689291 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.688658    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="876137b5-3fa2-4166-b9a3-043955463f44" containerName="online"
May 26 15:33:11.691300 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.691285    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-cvvw5"
May 26 15:33:11.694302 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.694271    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 15:33:11.696361 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.696339    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-4n88m\""
May 26 15:33:11.696505 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.696406    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 15:33:11.699048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.699023    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-cvvw5"]
May 26 15:33:11.755515 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.755481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksg5t\" (UniqueName: \"kubernetes.io/projected/9f5846ff-60cb-4345-9f2e-5d14c34ad91b-kube-api-access-ksg5t\") pod \"redis-854544c579-cvvw5\" (UID: \"9f5846ff-60cb-4345-9f2e-5d14c34ad91b\") " pod="test-ns-feast/redis-854544c579-cvvw5"
May 26 15:33:11.855850 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.855807    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksg5t\" (UniqueName: \"kubernetes.io/projected/9f5846ff-60cb-4345-9f2e-5d14c34ad91b-kube-api-access-ksg5t\") pod \"redis-854544c579-cvvw5\" (UID: \"9f5846ff-60cb-4345-9f2e-5d14c34ad91b\") " pod="test-ns-feast/redis-854544c579-cvvw5"
May 26 15:33:11.866483 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:11.866450    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksg5t\" (UniqueName: \"kubernetes.io/projected/9f5846ff-60cb-4345-9f2e-5d14c34ad91b-kube-api-access-ksg5t\") pod \"redis-854544c579-cvvw5\" (UID: \"9f5846ff-60cb-4345-9f2e-5d14c34ad91b\") " pod="test-ns-feast/redis-854544c579-cvvw5"
May 26 15:33:12.000628 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:12.000578    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-cvvw5"
May 26 15:33:12.118522 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:12.118489    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-cvvw5"]
May 26 15:33:12.121778 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:33:12.121746    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f5846ff_60cb_4345_9f2e_5d14c34ad91b.slice/crio-33479527617a046da8fd30e4902ed49c2350a84c681ca726812dc5935a740933 WatchSource:0}: Error finding container 33479527617a046da8fd30e4902ed49c2350a84c681ca726812dc5935a740933: Status 404 returned error can't find the container with id 33479527617a046da8fd30e4902ed49c2350a84c681ca726812dc5935a740933
May 26 15:33:12.123277 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:12.123262    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:33:12.132451 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:12.132427    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-cvvw5" event={"ID":"9f5846ff-60cb-4345-9f2e-5d14c34ad91b","Type":"ContainerStarted","Data":"33479527617a046da8fd30e4902ed49c2350a84c681ca726812dc5935a740933"}
May 26 15:33:14.138902 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:14.138862    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-cvvw5" event={"ID":"9f5846ff-60cb-4345-9f2e-5d14c34ad91b","Type":"ContainerStarted","Data":"16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b"}
May 26 15:33:22.387747 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.387689    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-cvvw5" podStartSLOduration=10.145276997 podStartE2EDuration="11.38767309s" podCreationTimestamp="2026-05-26 15:33:11 +0000 UTC" firstStartedPulling="2026-05-26 15:33:12.123446671 +0000 UTC m=+743.695614292" lastFinishedPulling="2026-05-26 15:33:13.365842762 +0000 UTC m=+744.938010385" observedRunningTime="2026-05-26 15:33:14.156207351 +0000 UTC m=+745.728374994" watchObservedRunningTime="2026-05-26 15:33:22.38767309 +0000 UTC m=+753.959840733"
May 26 15:33:22.388144 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.387862    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"]
May 26 15:33:22.391143 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.391127    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.394064 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.394029    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 26 15:33:22.394064 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.394048    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 26 15:33:22.394243 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.394093    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-b94hz\""
May 26 15:33:22.394243 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.394055    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 26 15:33:22.394243 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.394133    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 26 15:33:22.394398 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.394284    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 26 15:33:22.402837 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.402815    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"]
May 26 15:33:22.415788 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.415765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-offline-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.415900 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.415807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c886ab60-584f-4685-9a21-ee04ed66cbb3-feast-data\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.415900 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.415827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22vzj\" (UniqueName: \"kubernetes.io/projected/c886ab60-584f-4685-9a21-ee04ed66cbb3-kube-api-access-22vzj\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.415900 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.415845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-registry-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.415900 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.415860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-online-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.516423 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.516361    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-offline-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.516626 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.516455    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c886ab60-584f-4685-9a21-ee04ed66cbb3-feast-data\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.516626 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.516473    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22vzj\" (UniqueName: \"kubernetes.io/projected/c886ab60-584f-4685-9a21-ee04ed66cbb3-kube-api-access-22vzj\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.516626 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.516492    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-registry-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.516626 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.516511    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-online-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.516626 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:33:22.516490    2560 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found
May 26 15:33:22.516626 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:33:22.516614    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-offline-tls podName:c886ab60-584f-4685-9a21-ee04ed66cbb3 nodeName:}" failed. No retries permitted until 2026-05-26 15:33:23.016593923 +0000 UTC m=+754.588761544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-offline-tls") pod "feast-credit-scoring-5c7f8db64c-crxqx" (UID: "c886ab60-584f-4685-9a21-ee04ed66cbb3") : secret "feast-credit-scoring-offline-tls" not found
May 26 15:33:22.516839 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:33:22.516627    2560 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
May 26 15:33:22.516839 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:33:22.516690    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-online-tls podName:c886ab60-584f-4685-9a21-ee04ed66cbb3 nodeName:}" failed. No retries permitted until 2026-05-26 15:33:23.016672601 +0000 UTC m=+754.588840222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-online-tls") pod "feast-credit-scoring-5c7f8db64c-crxqx" (UID: "c886ab60-584f-4685-9a21-ee04ed66cbb3") : secret "feast-credit-scoring-online-tls" not found
May 26 15:33:22.516839 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.516787    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c886ab60-584f-4685-9a21-ee04ed66cbb3-feast-data\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.518812 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.518789    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-registry-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:22.528048 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:22.528018    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22vzj\" (UniqueName: \"kubernetes.io/projected/c886ab60-584f-4685-9a21-ee04ed66cbb3-kube-api-access-22vzj\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:23.020587 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:23.020529    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-online-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:23.020761 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:23.020621    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-offline-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:23.022978 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:23.022946    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-offline-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:23.023080 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:23.022946    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-online-tls\") pod \"feast-credit-scoring-5c7f8db64c-crxqx\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") " pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:23.300079 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:23.299982    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:23.428056 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:23.428031    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"]
May 26 15:33:23.429176 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:33:23.429149    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc886ab60_584f_4685_9a21_ee04ed66cbb3.slice/crio-f9f29de5fbb7e44edd9d6618e583b6884c7f8731968903d6359d0bd1473b80f6 WatchSource:0}: Error finding container f9f29de5fbb7e44edd9d6618e583b6884c7f8731968903d6359d0bd1473b80f6: Status 404 returned error can't find the container with id f9f29de5fbb7e44edd9d6618e583b6884c7f8731968903d6359d0bd1473b80f6
May 26 15:33:24.169428 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:24.169390    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerStarted","Data":"a670a13db85e4f7b0926c95d5bb0a06526869e0d1fa056a426469ad951463981"}
May 26 15:33:24.169428 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:24.169433    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerStarted","Data":"f9f29de5fbb7e44edd9d6618e583b6884c7f8731968903d6359d0bd1473b80f6"}
May 26 15:33:25.173350 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:25.173262    2560 generic.go:358] "Generic (PLEG): container finished" podID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerID="a670a13db85e4f7b0926c95d5bb0a06526869e0d1fa056a426469ad951463981" exitCode=0
May 26 15:33:25.173350 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:25.173301    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerDied","Data":"a670a13db85e4f7b0926c95d5bb0a06526869e0d1fa056a426469ad951463981"}
May 26 15:33:26.178167 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:26.178135    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerStarted","Data":"8f5df703def6aa196dad3ca64546ab792ab1a2fffb12ac40bddace081fc8d237"}
May 26 15:33:32.195163 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:32.195127    2560 generic.go:358] "Generic (PLEG): container finished" podID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerID="8f5df703def6aa196dad3ca64546ab792ab1a2fffb12ac40bddace081fc8d237" exitCode=0
May 26 15:33:32.195615 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:32.195175    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerDied","Data":"8f5df703def6aa196dad3ca64546ab792ab1a2fffb12ac40bddace081fc8d237"}
May 26 15:33:33.201020 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:33.200980    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerStarted","Data":"d013bc35a2d1aed998a72597c10c5955c180c6d7f9822c237d3befa08cfc8a58"}
May 26 15:33:33.201020 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:33.201026    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerStarted","Data":"29e0f7f5e00bc352d000d83f1f5dae04d34fec9ca86183af48221a368836883d"}
May 26 15:33:33.201581 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:33.201036    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerStarted","Data":"886edc10add3d5203d52bec729cc5c3879db0e16a4f3c690eca653bd61d3f87e"}
May 26 15:33:33.226111 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:33.226033    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podStartSLOduration=11.226015682 podStartE2EDuration="11.226015682s" podCreationTimestamp="2026-05-26 15:33:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:33:33.223422666 +0000 UTC m=+764.795590311" watchObservedRunningTime="2026-05-26 15:33:33.226015682 +0000 UTC m=+764.798183324"
May 26 15:33:33.300878 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:33.300827    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:33.301073 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:33.300894    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:33.301073 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:33.300910    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:35.300610 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:35.300557    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:35.300610 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:35.300620    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:35.301145 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:35.300634    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:35.302535 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:35.302500    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused"
May 26 15:33:35.302685 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:35.302542    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 26 15:33:35.302685 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:35.302514    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 26 15:33:38.300388 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:38.300313    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused"
May 26 15:33:38.301241 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:38.301218    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:38.302057 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:38.302035    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:38.314212 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:38.314178    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:39.222894 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:39.222862    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:41.300648 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:41.300603    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused"
May 26 15:33:44.301454 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:44.301420    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:33:44.302098 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:33:44.302080    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:34:47.990092 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:47.990044    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"]
May 26 15:34:47.990638 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:47.990489    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="registry" containerID="cri-o://886edc10add3d5203d52bec729cc5c3879db0e16a4f3c690eca653bd61d3f87e" gracePeriod=30
May 26 15:34:47.990638 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:47.990511    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="offline" containerID="cri-o://d013bc35a2d1aed998a72597c10c5955c180c6d7f9822c237d3befa08cfc8a58" gracePeriod=30
May 26 15:34:47.990638 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:47.990540    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="online" containerID="cri-o://29e0f7f5e00bc352d000d83f1f5dae04d34fec9ca86183af48221a368836883d" gracePeriod=30
May 26 15:34:48.012252 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.012223    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-cvvw5"]
May 26 15:34:48.012447 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.012427    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-cvvw5" podUID="9f5846ff-60cb-4345-9f2e-5d14c34ad91b" containerName="redis" containerID="cri-o://16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b" gracePeriod=30
May 26 15:34:48.247160 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.247097    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-cvvw5"
May 26 15:34:48.264616 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.264562    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksg5t\" (UniqueName: \"kubernetes.io/projected/9f5846ff-60cb-4345-9f2e-5d14c34ad91b-kube-api-access-ksg5t\") pod \"9f5846ff-60cb-4345-9f2e-5d14c34ad91b\" (UID: \"9f5846ff-60cb-4345-9f2e-5d14c34ad91b\") "
May 26 15:34:48.266987 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.266941    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f5846ff-60cb-4345-9f2e-5d14c34ad91b-kube-api-access-ksg5t" (OuterVolumeSpecName: "kube-api-access-ksg5t") pod "9f5846ff-60cb-4345-9f2e-5d14c34ad91b" (UID: "9f5846ff-60cb-4345-9f2e-5d14c34ad91b"). InnerVolumeSpecName "kube-api-access-ksg5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:34:48.365621 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.365587    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksg5t\" (UniqueName: \"kubernetes.io/projected/9f5846ff-60cb-4345-9f2e-5d14c34ad91b-kube-api-access-ksg5t\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:34:48.406346 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.406312    2560 generic.go:358] "Generic (PLEG): container finished" podID="9f5846ff-60cb-4345-9f2e-5d14c34ad91b" containerID="16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b" exitCode=0
May 26 15:34:48.406563 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.406363    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-cvvw5"
May 26 15:34:48.406563 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.406405    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-cvvw5" event={"ID":"9f5846ff-60cb-4345-9f2e-5d14c34ad91b","Type":"ContainerDied","Data":"16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b"}
May 26 15:34:48.406563 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.406459    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-cvvw5" event={"ID":"9f5846ff-60cb-4345-9f2e-5d14c34ad91b","Type":"ContainerDied","Data":"33479527617a046da8fd30e4902ed49c2350a84c681ca726812dc5935a740933"}
May 26 15:34:48.406563 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.406482    2560 scope.go:117] "RemoveContainer" containerID="16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b"
May 26 15:34:48.415016 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.414993    2560 scope.go:117] "RemoveContainer" containerID="16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b"
May 26 15:34:48.415273 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:34:48.415254    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b\": container with ID starting with 16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b not found: ID does not exist" containerID="16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b"
May 26 15:34:48.415338 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.415280    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b"} err="failed to get container status \"16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b\": rpc error: code = NotFound desc = could not find container \"16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b\": container with ID starting with 16b73811d3ba279b49218154c2bb896e345531c9bd1f9817ae6eb3e6317d156b not found: ID does not exist"
May 26 15:34:48.426743 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.426711    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-cvvw5"]
May 26 15:34:48.430246 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:48.430223    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-cvvw5"]
May 26 15:34:49.041623 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:49.041532    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f5846ff-60cb-4345-9f2e-5d14c34ad91b" path="/var/lib/kubelet/pods/9f5846ff-60cb-4345-9f2e-5d14c34ad91b/volumes"
May 26 15:34:49.220396 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:49.220340    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 26 15:34:49.411782 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:49.411694    2560 generic.go:358] "Generic (PLEG): container finished" podID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerID="29e0f7f5e00bc352d000d83f1f5dae04d34fec9ca86183af48221a368836883d" exitCode=0
May 26 15:34:49.411782 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:49.411760    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerDied","Data":"29e0f7f5e00bc352d000d83f1f5dae04d34fec9ca86183af48221a368836883d"}
May 26 15:34:59.220723 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:34:59.220681    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 26 15:35:09.220829 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:09.220780    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused"
May 26 15:35:09.221206 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:09.220921    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:35:18.302417 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.302298    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused"
May 26 15:35:18.487589 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.487551    2560 generic.go:358] "Generic (PLEG): container finished" podID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerID="d013bc35a2d1aed998a72597c10c5955c180c6d7f9822c237d3befa08cfc8a58" exitCode=137
May 26 15:35:18.487589 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.487576    2560 generic.go:358] "Generic (PLEG): container finished" podID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerID="886edc10add3d5203d52bec729cc5c3879db0e16a4f3c690eca653bd61d3f87e" exitCode=137
May 26 15:35:18.487797 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.487619    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerDied","Data":"d013bc35a2d1aed998a72597c10c5955c180c6d7f9822c237d3befa08cfc8a58"}
May 26 15:35:18.487797 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.487655    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerDied","Data":"886edc10add3d5203d52bec729cc5c3879db0e16a4f3c690eca653bd61d3f87e"}
May 26 15:35:18.629696 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.629670    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:35:18.685716 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.685678    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-online-tls\") pod \"c886ab60-584f-4685-9a21-ee04ed66cbb3\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") "
May 26 15:35:18.685716 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.685725    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22vzj\" (UniqueName: \"kubernetes.io/projected/c886ab60-584f-4685-9a21-ee04ed66cbb3-kube-api-access-22vzj\") pod \"c886ab60-584f-4685-9a21-ee04ed66cbb3\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") "
May 26 15:35:18.685926 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.685760    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-offline-tls\") pod \"c886ab60-584f-4685-9a21-ee04ed66cbb3\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") "
May 26 15:35:18.685926 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.685864    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-registry-tls\") pod \"c886ab60-584f-4685-9a21-ee04ed66cbb3\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") "
May 26 15:35:18.685926 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.685916    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c886ab60-584f-4685-9a21-ee04ed66cbb3-feast-data\") pod \"c886ab60-584f-4685-9a21-ee04ed66cbb3\" (UID: \"c886ab60-584f-4685-9a21-ee04ed66cbb3\") "
May 26 15:35:18.687868 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.687829    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c886ab60-584f-4685-9a21-ee04ed66cbb3" (UID: "c886ab60-584f-4685-9a21-ee04ed66cbb3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:35:18.687868 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.687846    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-online-tls" (OuterVolumeSpecName: "online-tls") pod "c886ab60-584f-4685-9a21-ee04ed66cbb3" (UID: "c886ab60-584f-4685-9a21-ee04ed66cbb3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:35:18.688224 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.688201    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c886ab60-584f-4685-9a21-ee04ed66cbb3" (UID: "c886ab60-584f-4685-9a21-ee04ed66cbb3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:35:18.688224 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.688212    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c886ab60-584f-4685-9a21-ee04ed66cbb3-kube-api-access-22vzj" (OuterVolumeSpecName: "kube-api-access-22vzj") pod "c886ab60-584f-4685-9a21-ee04ed66cbb3" (UID: "c886ab60-584f-4685-9a21-ee04ed66cbb3"). InnerVolumeSpecName "kube-api-access-22vzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:35:18.697642 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.697609    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c886ab60-584f-4685-9a21-ee04ed66cbb3-feast-data" (OuterVolumeSpecName: "feast-data") pod "c886ab60-584f-4685-9a21-ee04ed66cbb3" (UID: "c886ab60-584f-4685-9a21-ee04ed66cbb3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:35:18.786499 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.786465    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-online-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:35:18.786499 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.786496    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22vzj\" (UniqueName: \"kubernetes.io/projected/c886ab60-584f-4685-9a21-ee04ed66cbb3-kube-api-access-22vzj\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:35:18.786499 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.786506    2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-offline-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:35:18.786691 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.786515    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c886ab60-584f-4685-9a21-ee04ed66cbb3-registry-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:35:18.786691 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:18.786523    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c886ab60-584f-4685-9a21-ee04ed66cbb3-feast-data\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:35:19.492297 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:19.492264    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx" event={"ID":"c886ab60-584f-4685-9a21-ee04ed66cbb3","Type":"ContainerDied","Data":"f9f29de5fbb7e44edd9d6618e583b6884c7f8731968903d6359d0bd1473b80f6"}
May 26 15:35:19.492832 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:19.492307    2560 scope.go:117] "RemoveContainer" containerID="d013bc35a2d1aed998a72597c10c5955c180c6d7f9822c237d3befa08cfc8a58"
May 26 15:35:19.492832 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:19.492333    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"
May 26 15:35:19.499711 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:19.499691    2560 scope.go:117] "RemoveContainer" containerID="29e0f7f5e00bc352d000d83f1f5dae04d34fec9ca86183af48221a368836883d"
May 26 15:35:19.506213 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:19.506194    2560 scope.go:117] "RemoveContainer" containerID="886edc10add3d5203d52bec729cc5c3879db0e16a4f3c690eca653bd61d3f87e"
May 26 15:35:19.512778 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:19.512753    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"]
May 26 15:35:19.513226 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:19.513205    2560 scope.go:117] "RemoveContainer" containerID="8f5df703def6aa196dad3ca64546ab792ab1a2fffb12ac40bddace081fc8d237"
May 26 15:35:19.518327 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:19.518306    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-5c7f8db64c-crxqx"]
May 26 15:35:19.519826 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:19.519805    2560 scope.go:117] "RemoveContainer" containerID="a670a13db85e4f7b0926c95d5bb0a06526869e0d1fa056a426469ad951463981"
May 26 15:35:21.041222 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:35:21.041188    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" path="/var/lib/kubelet/pods/c886ab60-584f-4685-9a21-ee04ed66cbb3/volumes"
May 26 15:36:59.951259 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951217    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"]
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951557    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5846ff-60cb-4345-9f2e-5d14c34ad91b" containerName="redis"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951576    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5846ff-60cb-4345-9f2e-5d14c34ad91b" containerName="redis"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951600    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="feast-init"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951609    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="feast-init"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951618    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="offline"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951628    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="offline"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951644    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="registry"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951651    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="registry"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951666    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="online"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951673    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="online"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951682    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="feast-apply"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951689    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="feast-apply"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951746    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="online"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951756    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="offline"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951767    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f5846ff-60cb-4345-9f2e-5d14c34ad91b" containerName="redis"
May 26 15:36:59.951834 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.951777    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c886ab60-584f-4685-9a21-ee04ed66cbb3" containerName="registry"
May 26 15:36:59.954922 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.954902    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:36:59.958056 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.958036    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 26 15:36:59.958292 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.958272    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 26 15:36:59.958511 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.958493    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 26 15:36:59.958644 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.958628    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 26 15:36:59.958717 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.958706    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 26 15:36:59.959674 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.959656    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-pjcbf\""
May 26 15:36:59.959730 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.959723    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 26 15:36:59.972395 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:36:59.972359    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"]
May 26 15:37:00.072983 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.072946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-registry-tls\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.072983 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.072985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-online-tls\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.073202 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.073052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5923892-7474-437c-b33f-4bd418bf3005-feast-data\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.073202 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.073103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvf6m\" (UniqueName: \"kubernetes.io/projected/e5923892-7474-437c-b33f-4bd418bf3005-kube-api-access-hvf6m\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.174301 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.174269    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-registry-tls\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.174457 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.174309    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-online-tls\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.174457 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.174437    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5923892-7474-437c-b33f-4bd418bf3005-feast-data\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.174562 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.174494    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvf6m\" (UniqueName: \"kubernetes.io/projected/e5923892-7474-437c-b33f-4bd418bf3005-kube-api-access-hvf6m\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.174776 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.174757    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5923892-7474-437c-b33f-4bd418bf3005-feast-data\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.176733 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.176715    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-registry-tls\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.176871 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.176741    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-online-tls\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.185569 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.185548    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvf6m\" (UniqueName: \"kubernetes.io/projected/e5923892-7474-437c-b33f-4bd418bf3005-kube-api-access-hvf6m\") pod \"feast-credit-scoring-6df66b6b99-rcmdj\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") " pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.264644 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.264617    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:00.392918 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.392885    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"]
May 26 15:37:00.395960 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:37:00.395922    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5923892_7474_437c_b33f_4bd418bf3005.slice/crio-0bce5375c433b492f8ff1bb9e6fb41d7db6dae797c2d7467449657fca81229bc WatchSource:0}: Error finding container 0bce5375c433b492f8ff1bb9e6fb41d7db6dae797c2d7467449657fca81229bc: Status 404 returned error can't find the container with id 0bce5375c433b492f8ff1bb9e6fb41d7db6dae797c2d7467449657fca81229bc
May 26 15:37:00.746549 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.746509    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerStarted","Data":"939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11"}
May 26 15:37:00.746549 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:00.746548    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerStarted","Data":"0bce5375c433b492f8ff1bb9e6fb41d7db6dae797c2d7467449657fca81229bc"}
May 26 15:37:01.750694 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:01.750664    2560 generic.go:358] "Generic (PLEG): container finished" podID="e5923892-7474-437c-b33f-4bd418bf3005" containerID="939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11" exitCode=0
May 26 15:37:01.751049 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:01.750708    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerDied","Data":"939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11"}
May 26 15:37:02.754501 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:02.754468    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerStarted","Data":"73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4"}
May 26 15:37:09.777539 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:09.777504    2560 generic.go:358] "Generic (PLEG): container finished" podID="e5923892-7474-437c-b33f-4bd418bf3005" containerID="73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4" exitCode=0
May 26 15:37:09.777900 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:09.777553    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerDied","Data":"73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4"}
May 26 15:37:10.783959 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:10.783917    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerStarted","Data":"a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9"}
May 26 15:37:10.783959 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:10.783966    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerStarted","Data":"da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6"}
May 26 15:37:10.809539 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:10.809471    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podStartSLOduration=11.809451909 podStartE2EDuration="11.809451909s" podCreationTimestamp="2026-05-26 15:36:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:37:10.809246313 +0000 UTC m=+982.381413968" watchObservedRunningTime="2026-05-26 15:37:10.809451909 +0000 UTC m=+982.381619552"
May 26 15:37:12.265061 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:12.265008    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:12.265061 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:12.265056    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:12.266516 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:12.266486    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.18:6571: connect: connection refused"
May 26 15:37:12.266516 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:12.266506    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 26 15:37:15.266308 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:15.266256    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.18:6571: connect: connection refused"
May 26 15:37:15.799442 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:15.799413    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:15.799844 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:15.799823    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:15.802556 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:15.802530    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:18.265599 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:18.265554    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.18:6571: connect: connection refused"
May 26 15:37:20.265342 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:20.265306    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:21.265549 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:21.265510    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:21.266274 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:21.266254    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:37:25.868084 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.868050    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"]
May 26 15:37:25.870184 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.870166    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:25.873006 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.872986    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 26 15:37:25.873238 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.873219    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-kptzm\""
May 26 15:37:25.873322 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.873258    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 26 15:37:25.873397 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.873326    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 26 15:37:25.884904 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.884880    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"]
May 26 15:37:25.947651 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.947617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-online-tls\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:25.947651 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.947655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebec91-afc0-4533-b040-d4cd55637707-feast-data\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:25.947840 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.947674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-registry-tls\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:25.947840 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:25.947717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/c5ebec91-afc0-4533-b040-d4cd55637707-kube-api-access-d28qx\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.048397 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.048334    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-online-tls\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.048397 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.048400    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebec91-afc0-4533-b040-d4cd55637707-feast-data\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.048637 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.048420    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-registry-tls\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.048637 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.048442    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/c5ebec91-afc0-4533-b040-d4cd55637707-kube-api-access-d28qx\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.048894 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.048868    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebec91-afc0-4533-b040-d4cd55637707-feast-data\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.050787 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.050765    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-online-tls\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.050924 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.050905    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-registry-tls\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.057575 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.057555    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/c5ebec91-afc0-4533-b040-d4cd55637707-kube-api-access-d28qx\") pod \"feast-driver-ranking-549c665b9b-kfmb4\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") " pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.178861 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.178780    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:26.301886 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.301860    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"]
May 26 15:37:26.305834 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:37:26.305805    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ebec91_afc0_4533_b040_d4cd55637707.slice/crio-d22191a2d69ba5744e9943825241d47610bd3dad9f03ce52ef65f9a6f37ac374 WatchSource:0}: Error finding container d22191a2d69ba5744e9943825241d47610bd3dad9f03ce52ef65f9a6f37ac374: Status 404 returned error can't find the container with id d22191a2d69ba5744e9943825241d47610bd3dad9f03ce52ef65f9a6f37ac374
May 26 15:37:26.829971 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.829935    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerStarted","Data":"0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6"}
May 26 15:37:26.829971 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:26.829971    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerStarted","Data":"d22191a2d69ba5744e9943825241d47610bd3dad9f03ce52ef65f9a6f37ac374"}
May 26 15:37:30.842255 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:30.842223    2560 generic.go:358] "Generic (PLEG): container finished" podID="c5ebec91-afc0-4533-b040-d4cd55637707" containerID="0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6" exitCode=0
May 26 15:37:30.842641 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:30.842289    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerDied","Data":"0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6"}
May 26 15:37:31.846415 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:31.846358    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerStarted","Data":"1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10"}
May 26 15:37:38.866496 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:38.866461    2560 generic.go:358] "Generic (PLEG): container finished" podID="c5ebec91-afc0-4533-b040-d4cd55637707" containerID="1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10" exitCode=0
May 26 15:37:38.866860 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:38.866536    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerDied","Data":"1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10"}
May 26 15:37:39.872460 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:39.872418    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerStarted","Data":"d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a"}
May 26 15:37:39.872835 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:39.872475    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerStarted","Data":"bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f"}
May 26 15:37:39.897974 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:39.897914    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podStartSLOduration=14.897894655 podStartE2EDuration="14.897894655s" podCreationTimestamp="2026-05-26 15:37:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:37:39.8977245 +0000 UTC m=+1011.469892144" watchObservedRunningTime="2026-05-26 15:37:39.897894655 +0000 UTC m=+1011.470062297"
May 26 15:37:41.179476 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:41.179424    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:41.179476 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:41.179480    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:41.180785 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:41.180752    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.19:6571: connect: connection refused"
May 26 15:37:41.180785 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:41.180772    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 26 15:37:44.179452 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:44.179364    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.19:6571: connect: connection refused"
May 26 15:37:44.179924 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:44.179470    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 26 15:37:46.179402 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:46.179325    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:46.179747 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:46.179413    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:47.179132 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:47.179089    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.19:6571: connect: connection refused"
May 26 15:37:47.186379 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:47.186342    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:47.190630 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:47.190607    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:50.179581 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:50.179543    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:37:50.180326 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:37:50.180307    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:39:05.245901 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:05.245867    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"]
May 26 15:39:05.246506 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:05.246197    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="registry" containerID="cri-o://da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6" gracePeriod=30
May 26 15:39:05.246506 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:05.246288    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="online" containerID="cri-o://a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9" gracePeriod=30
May 26 15:39:05.248455 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:05.248432    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"]
May 26 15:39:05.248738 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:05.248712    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="registry" containerID="cri-o://bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f" gracePeriod=30
May 26 15:39:05.248848 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:05.248774    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="online" containerID="cri-o://d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a" gracePeriod=30
May 26 15:39:05.800216 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:05.800163    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 26 15:39:06.109117 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:06.109085    2560 generic.go:358] "Generic (PLEG): container finished" podID="e5923892-7474-437c-b33f-4bd418bf3005" containerID="a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9" exitCode=0
May 26 15:39:06.109271 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:06.109153    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerDied","Data":"a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9"}
May 26 15:39:06.110933 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:06.110915    2560 generic.go:358] "Generic (PLEG): container finished" podID="c5ebec91-afc0-4533-b040-d4cd55637707" containerID="d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a" exitCode=0
May 26 15:39:06.111016 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:06.110940    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerDied","Data":"d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a"}
May 26 15:39:07.187228 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:07.187192    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 26 15:39:15.800593 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:15.800536    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 26 15:39:17.187036 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:17.186992    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 26 15:39:25.800662 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:25.800613    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 26 15:39:25.801128 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:25.800767    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:39:27.187076 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:27.187036    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
May 26 15:39:27.187483 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:27.187164    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:39:35.801078 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:35.801037    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
May 26 15:39:35.908076 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:35.908046    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:39:35.910731 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:35.910711    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:39:36.002546 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.002511    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebec91-afc0-4533-b040-d4cd55637707-feast-data\") pod \"c5ebec91-afc0-4533-b040-d4cd55637707\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") "
May 26 15:39:36.002546 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.002553    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-registry-tls\") pod \"e5923892-7474-437c-b33f-4bd418bf3005\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") "
May 26 15:39:36.002780 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.002573    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-online-tls\") pod \"c5ebec91-afc0-4533-b040-d4cd55637707\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") "
May 26 15:39:36.002780 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.002614    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvf6m\" (UniqueName: \"kubernetes.io/projected/e5923892-7474-437c-b33f-4bd418bf3005-kube-api-access-hvf6m\") pod \"e5923892-7474-437c-b33f-4bd418bf3005\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") "
May 26 15:39:36.002780 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.002666    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5923892-7474-437c-b33f-4bd418bf3005-feast-data\") pod \"e5923892-7474-437c-b33f-4bd418bf3005\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") "
May 26 15:39:36.002780 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.002692    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-registry-tls\") pod \"c5ebec91-afc0-4533-b040-d4cd55637707\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") "
May 26 15:39:36.002780 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.002725    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-online-tls\") pod \"e5923892-7474-437c-b33f-4bd418bf3005\" (UID: \"e5923892-7474-437c-b33f-4bd418bf3005\") "
May 26 15:39:36.002780 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.002750    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/c5ebec91-afc0-4533-b040-d4cd55637707-kube-api-access-d28qx\") pod \"c5ebec91-afc0-4533-b040-d4cd55637707\" (UID: \"c5ebec91-afc0-4533-b040-d4cd55637707\") "
May 26 15:39:36.003130 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.003083    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ebec91-afc0-4533-b040-d4cd55637707-feast-data" (OuterVolumeSpecName: "feast-data") pod "c5ebec91-afc0-4533-b040-d4cd55637707" (UID: "c5ebec91-afc0-4533-b040-d4cd55637707"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:39:36.005243 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.005208    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ebec91-afc0-4533-b040-d4cd55637707-kube-api-access-d28qx" (OuterVolumeSpecName: "kube-api-access-d28qx") pod "c5ebec91-afc0-4533-b040-d4cd55637707" (UID: "c5ebec91-afc0-4533-b040-d4cd55637707"). InnerVolumeSpecName "kube-api-access-d28qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:39:36.005243 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.005241    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e5923892-7474-437c-b33f-4bd418bf3005" (UID: "e5923892-7474-437c-b33f-4bd418bf3005"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:39:36.005424 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.005248    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5923892-7474-437c-b33f-4bd418bf3005-kube-api-access-hvf6m" (OuterVolumeSpecName: "kube-api-access-hvf6m") pod "e5923892-7474-437c-b33f-4bd418bf3005" (UID: "e5923892-7474-437c-b33f-4bd418bf3005"). InnerVolumeSpecName "kube-api-access-hvf6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:39:36.005424 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.005253    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-online-tls" (OuterVolumeSpecName: "online-tls") pod "c5ebec91-afc0-4533-b040-d4cd55637707" (UID: "c5ebec91-afc0-4533-b040-d4cd55637707"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:39:36.005424 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.005287    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c5ebec91-afc0-4533-b040-d4cd55637707" (UID: "c5ebec91-afc0-4533-b040-d4cd55637707"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:39:36.005522 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.005494    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-online-tls" (OuterVolumeSpecName: "online-tls") pod "e5923892-7474-437c-b33f-4bd418bf3005" (UID: "e5923892-7474-437c-b33f-4bd418bf3005"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 15:39:36.013100 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.013046    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5923892-7474-437c-b33f-4bd418bf3005-feast-data" (OuterVolumeSpecName: "feast-data") pod "e5923892-7474-437c-b33f-4bd418bf3005" (UID: "e5923892-7474-437c-b33f-4bd418bf3005"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:39:36.104225 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.104188    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-registry-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:39:36.104225 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.104220    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-online-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:39:36.104225 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.104232    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/c5ebec91-afc0-4533-b040-d4cd55637707-kube-api-access-d28qx\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:39:36.104486 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.104241    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebec91-afc0-4533-b040-d4cd55637707-feast-data\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:39:36.104486 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.104250    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5923892-7474-437c-b33f-4bd418bf3005-registry-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:39:36.104486 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.104258    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c5ebec91-afc0-4533-b040-d4cd55637707-online-tls\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:39:36.104486 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.104267    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvf6m\" (UniqueName: \"kubernetes.io/projected/e5923892-7474-437c-b33f-4bd418bf3005-kube-api-access-hvf6m\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:39:36.104486 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.104277    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5923892-7474-437c-b33f-4bd418bf3005-feast-data\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:39:36.189863 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.189830    2560 generic.go:358] "Generic (PLEG): container finished" podID="e5923892-7474-437c-b33f-4bd418bf3005" containerID="da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6" exitCode=137
May 26 15:39:36.190036 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.189899    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerDied","Data":"da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6"}
May 26 15:39:36.190036 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.189906    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"
May 26 15:39:36.190036 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.189927    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj" event={"ID":"e5923892-7474-437c-b33f-4bd418bf3005","Type":"ContainerDied","Data":"0bce5375c433b492f8ff1bb9e6fb41d7db6dae797c2d7467449657fca81229bc"}
May 26 15:39:36.190036 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.189944    2560 scope.go:117] "RemoveContainer" containerID="a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9"
May 26 15:39:36.191755 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.191725    2560 generic.go:358] "Generic (PLEG): container finished" podID="c5ebec91-afc0-4533-b040-d4cd55637707" containerID="bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f" exitCode=137
May 26 15:39:36.191883 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.191776    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerDied","Data":"bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f"}
May 26 15:39:36.191883 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.191787    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"
May 26 15:39:36.191883 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.191803    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4" event={"ID":"c5ebec91-afc0-4533-b040-d4cd55637707","Type":"ContainerDied","Data":"d22191a2d69ba5744e9943825241d47610bd3dad9f03ce52ef65f9a6f37ac374"}
May 26 15:39:36.199133 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.199112    2560 scope.go:117] "RemoveContainer" containerID="da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6"
May 26 15:39:36.206680 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.206663    2560 scope.go:117] "RemoveContainer" containerID="73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4"
May 26 15:39:36.213179 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.213162    2560 scope.go:117] "RemoveContainer" containerID="939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11"
May 26 15:39:36.216714 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.216688    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"]
May 26 15:39:36.220823 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.220805    2560 scope.go:117] "RemoveContainer" containerID="a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9"
May 26 15:39:36.220891 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.220807    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6df66b6b99-rcmdj"]
May 26 15:39:36.221123 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:39:36.221105    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9\": container with ID starting with a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9 not found: ID does not exist" containerID="a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9"
May 26 15:39:36.221159 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.221132    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9"} err="failed to get container status \"a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9\": rpc error: code = NotFound desc = could not find container \"a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9\": container with ID starting with a5999ad78db2046aadb319d202dd7fe5234cd4ffa0e19916402452d45e5ecdb9 not found: ID does not exist"
May 26 15:39:36.221159 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.221152    2560 scope.go:117] "RemoveContainer" containerID="da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6"
May 26 15:39:36.221408 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:39:36.221384    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6\": container with ID starting with da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6 not found: ID does not exist" containerID="da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6"
May 26 15:39:36.221456 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.221416    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6"} err="failed to get container status \"da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6\": rpc error: code = NotFound desc = could not find container \"da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6\": container with ID starting with da1703b927966d579d15e7550ebc7b19017ec38a832b2ec03d4afda27246c8b6 not found: ID does not exist"
May 26 15:39:36.221456 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.221433    2560 scope.go:117] "RemoveContainer" containerID="73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4"
May 26 15:39:36.221631 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:39:36.221614    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4\": container with ID starting with 73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4 not found: ID does not exist" containerID="73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4"
May 26 15:39:36.221669 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.221636    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4"} err="failed to get container status \"73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4\": rpc error: code = NotFound desc = could not find container \"73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4\": container with ID starting with 73090ad45072cc72924fdbd03b7c7b7bbad34756a7d6736a72a91598b28a87d4 not found: ID does not exist"
May 26 15:39:36.221669 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.221651    2560 scope.go:117] "RemoveContainer" containerID="939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11"
May 26 15:39:36.221862 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:39:36.221846    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11\": container with ID starting with 939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11 not found: ID does not exist" containerID="939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11"
May 26 15:39:36.221900 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.221869    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11"} err="failed to get container status \"939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11\": rpc error: code = NotFound desc = could not find container \"939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11\": container with ID starting with 939fc4b77bad197d7c30761f993baeff896f08b0dc091d04e7b3ca176ec07d11 not found: ID does not exist"
May 26 15:39:36.221900 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.221887    2560 scope.go:117] "RemoveContainer" containerID="d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a"
May 26 15:39:36.228550 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.228537    2560 scope.go:117] "RemoveContainer" containerID="bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f"
May 26 15:39:36.233348 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.233329    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"]
May 26 15:39:36.236673 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.236654    2560 scope.go:117] "RemoveContainer" containerID="1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10"
May 26 15:39:36.237350 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.237333    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-549c665b9b-kfmb4"]
May 26 15:39:36.243069 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.243052    2560 scope.go:117] "RemoveContainer" containerID="0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6"
May 26 15:39:36.249633 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.249617    2560 scope.go:117] "RemoveContainer" containerID="d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a"
May 26 15:39:36.249881 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:39:36.249864    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a\": container with ID starting with d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a not found: ID does not exist" containerID="d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a"
May 26 15:39:36.249926 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.249888    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a"} err="failed to get container status \"d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a\": rpc error: code = NotFound desc = could not find container \"d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a\": container with ID starting with d0aa19a250b79e210b49eb0a9fe5e78c6e67dcc68a35dd9d9ad0194779f07f8a not found: ID does not exist"
May 26 15:39:36.249926 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.249905    2560 scope.go:117] "RemoveContainer" containerID="bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f"
May 26 15:39:36.250098 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:39:36.250082    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f\": container with ID starting with bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f not found: ID does not exist" containerID="bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f"
May 26 15:39:36.250132 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.250100    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f"} err="failed to get container status \"bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f\": rpc error: code = NotFound desc = could not find container \"bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f\": container with ID starting with bef3a5480c015a15742c99602cf6591e1f3bb7efc1aad440cef9b7f2e47dd05f not found: ID does not exist"
May 26 15:39:36.250132 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.250110    2560 scope.go:117] "RemoveContainer" containerID="1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10"
May 26 15:39:36.250315 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:39:36.250297    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10\": container with ID starting with 1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10 not found: ID does not exist" containerID="1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10"
May 26 15:39:36.250363 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.250318    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10"} err="failed to get container status \"1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10\": rpc error: code = NotFound desc = could not find container \"1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10\": container with ID starting with 1a93f1cc12c09ead799ec6b20fa3c501eb794810329fc7cc4fcada22e89f2b10 not found: ID does not exist"
May 26 15:39:36.250363 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.250328    2560 scope.go:117] "RemoveContainer" containerID="0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6"
May 26 15:39:36.250560 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:39:36.250540    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6\": container with ID starting with 0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6 not found: ID does not exist" containerID="0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6"
May 26 15:39:36.250596 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:36.250565    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6"} err="failed to get container status \"0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6\": rpc error: code = NotFound desc = could not find container \"0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6\": container with ID starting with 0691903179d952d5a3475cdb6d7241a2bc38ce8a82cb12de6b0697c4c38596a6 not found: ID does not exist"
May 26 15:39:37.041036 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:37.041001    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" path="/var/lib/kubelet/pods/c5ebec91-afc0-4533-b040-d4cd55637707/volumes"
May 26 15:39:37.041488 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:39:37.041474    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5923892-7474-437c-b33f-4bd418bf3005" path="/var/lib/kubelet/pods/e5923892-7474-437c-b33f-4bd418bf3005/volumes"
May 26 15:49:57.240508 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240472    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zjqkp/must-gather-w4cxn"]
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240700    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="feast-init"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240713    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="feast-init"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240722    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="online"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240727    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="online"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240762    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="online"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240768    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="online"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240775    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="feast-apply"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240780    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="feast-apply"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240785    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="registry"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240790    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="registry"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240796    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="feast-init"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240801    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="feast-init"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240805    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="feast-apply"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240810    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="feast-apply"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240817    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="registry"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240821    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="registry"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240860    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="registry"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240867    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5ebec91-afc0-4533-b040-d4cd55637707" containerName="online"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240872    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="online"
May 26 15:49:57.240977 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.240878    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5923892-7474-437c-b33f-4bd418bf3005" containerName="registry"
May 26 15:49:57.242481 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.242466    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:49:57.245301 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.245280    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zjqkp\"/\"default-dockercfg-6jh57\""
May 26 15:49:57.246850 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.246834    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjqkp\"/\"kube-root-ca.crt\""
May 26 15:49:57.246931 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.246848    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjqkp\"/\"openshift-service-ca.crt\""
May 26 15:49:57.250190 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.250167    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjqkp/must-gather-w4cxn"]
May 26 15:49:57.254699 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.254681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsbqc\" (UniqueName: \"kubernetes.io/projected/cff75832-7a3f-405b-aba2-1531540110e4-kube-api-access-xsbqc\") pod \"must-gather-w4cxn\" (UID: \"cff75832-7a3f-405b-aba2-1531540110e4\") " pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:49:57.254782 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.254714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cff75832-7a3f-405b-aba2-1531540110e4-must-gather-output\") pod \"must-gather-w4cxn\" (UID: \"cff75832-7a3f-405b-aba2-1531540110e4\") " pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:49:57.355190 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.355149    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsbqc\" (UniqueName: \"kubernetes.io/projected/cff75832-7a3f-405b-aba2-1531540110e4-kube-api-access-xsbqc\") pod \"must-gather-w4cxn\" (UID: \"cff75832-7a3f-405b-aba2-1531540110e4\") " pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:49:57.355190 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.355197    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cff75832-7a3f-405b-aba2-1531540110e4-must-gather-output\") pod \"must-gather-w4cxn\" (UID: \"cff75832-7a3f-405b-aba2-1531540110e4\") " pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:49:57.355539 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.355524    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cff75832-7a3f-405b-aba2-1531540110e4-must-gather-output\") pod \"must-gather-w4cxn\" (UID: \"cff75832-7a3f-405b-aba2-1531540110e4\") " pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:49:57.363680 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.363655    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsbqc\" (UniqueName: \"kubernetes.io/projected/cff75832-7a3f-405b-aba2-1531540110e4-kube-api-access-xsbqc\") pod \"must-gather-w4cxn\" (UID: \"cff75832-7a3f-405b-aba2-1531540110e4\") " pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:49:57.552269 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.552185    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:49:57.673668 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.673628    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjqkp/must-gather-w4cxn"]
May 26 15:49:57.677084 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:49:57.677058    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcff75832_7a3f_405b_aba2_1531540110e4.slice/crio-5655d2271d06d070e60a650a15190869e839270767e975e8e6b5eebcfcc7abac WatchSource:0}: Error finding container 5655d2271d06d070e60a650a15190869e839270767e975e8e6b5eebcfcc7abac: Status 404 returned error can't find the container with id 5655d2271d06d070e60a650a15190869e839270767e975e8e6b5eebcfcc7abac
May 26 15:49:57.678744 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.678727    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 15:49:57.761183 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:49:57.761137    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjqkp/must-gather-w4cxn" event={"ID":"cff75832-7a3f-405b-aba2-1531540110e4","Type":"ContainerStarted","Data":"5655d2271d06d070e60a650a15190869e839270767e975e8e6b5eebcfcc7abac"}
May 26 15:50:04.781999 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:04.781958    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjqkp/must-gather-w4cxn" event={"ID":"cff75832-7a3f-405b-aba2-1531540110e4","Type":"ContainerStarted","Data":"b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00"}
May 26 15:50:04.781999 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:04.781998    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjqkp/must-gather-w4cxn" event={"ID":"cff75832-7a3f-405b-aba2-1531540110e4","Type":"ContainerStarted","Data":"4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6"}
May 26 15:50:04.799338 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:04.799247    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zjqkp/must-gather-w4cxn" podStartSLOduration=1.761907543 podStartE2EDuration="7.799234638s" podCreationTimestamp="2026-05-26 15:49:57 +0000 UTC" firstStartedPulling="2026-05-26 15:49:57.67887427 +0000 UTC m=+1749.251041894" lastFinishedPulling="2026-05-26 15:50:03.716201368 +0000 UTC m=+1755.288368989" observedRunningTime="2026-05-26 15:50:04.798238844 +0000 UTC m=+1756.370406489" watchObservedRunningTime="2026-05-26 15:50:04.799234638 +0000 UTC m=+1756.371402279"
May 26 15:50:13.809917 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:13.809883    2560 generic.go:358] "Generic (PLEG): container finished" podID="cff75832-7a3f-405b-aba2-1531540110e4" containerID="4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6" exitCode=0
May 26 15:50:13.810319 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:13.809957    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjqkp/must-gather-w4cxn" event={"ID":"cff75832-7a3f-405b-aba2-1531540110e4","Type":"ContainerDied","Data":"4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6"}
May 26 15:50:13.810319 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:13.810271    2560 scope.go:117] "RemoveContainer" containerID="4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6"
May 26 15:50:14.399281 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:14.399249    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zjqkp_must-gather-w4cxn_cff75832-7a3f-405b-aba2-1531540110e4/gather/0.log"
May 26 15:50:17.570224 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:17.570187    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zk77v_b5277094-f350-4b44-84a7-18dc051f137b/global-pull-secret-syncer/0.log"
May 26 15:50:17.651603 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:17.651547    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kf6ww_db605d53-5646-4f55-9299-5258fc583cf9/konnectivity-agent/0.log"
May 26 15:50:17.762956 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:17.762925    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-229.ec2.internal_ab53f28968cb404326448da577bad436/haproxy/0.log"
May 26 15:50:19.770262 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:19.770228    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-zjqkp/must-gather-w4cxn"]
May 26 15:50:19.770809 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:19.770532    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-zjqkp/must-gather-w4cxn" podUID="cff75832-7a3f-405b-aba2-1531540110e4" containerName="copy" containerID="cri-o://b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00" gracePeriod=2
May 26 15:50:19.776674 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:19.776644    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-zjqkp/must-gather-w4cxn"]
May 26 15:50:19.988183 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:19.988159    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zjqkp_must-gather-w4cxn_cff75832-7a3f-405b-aba2-1531540110e4/copy/0.log"
May 26 15:50:19.988528 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:19.988511    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:50:19.991340 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:19.991304    2560 status_manager.go:895] "Failed to get status for pod" podUID="cff75832-7a3f-405b-aba2-1531540110e4" pod="openshift-must-gather-zjqkp/must-gather-w4cxn" err="pods \"must-gather-w4cxn\" is forbidden: User \"system:node:ip-10-0-143-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zjqkp\": no relationship found between node 'ip-10-0-143-229.ec2.internal' and this object"
May 26 15:50:20.141061 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.140982    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cff75832-7a3f-405b-aba2-1531540110e4-must-gather-output\") pod \"cff75832-7a3f-405b-aba2-1531540110e4\" (UID: \"cff75832-7a3f-405b-aba2-1531540110e4\") "
May 26 15:50:20.141202 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.141069    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsbqc\" (UniqueName: \"kubernetes.io/projected/cff75832-7a3f-405b-aba2-1531540110e4-kube-api-access-xsbqc\") pod \"cff75832-7a3f-405b-aba2-1531540110e4\" (UID: \"cff75832-7a3f-405b-aba2-1531540110e4\") "
May 26 15:50:20.141459 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.141436    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff75832-7a3f-405b-aba2-1531540110e4-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "cff75832-7a3f-405b-aba2-1531540110e4" (UID: "cff75832-7a3f-405b-aba2-1531540110e4"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 15:50:20.143178 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.143152    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff75832-7a3f-405b-aba2-1531540110e4-kube-api-access-xsbqc" (OuterVolumeSpecName: "kube-api-access-xsbqc") pod "cff75832-7a3f-405b-aba2-1531540110e4" (UID: "cff75832-7a3f-405b-aba2-1531540110e4"). InnerVolumeSpecName "kube-api-access-xsbqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 15:50:20.241669 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.241626    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsbqc\" (UniqueName: \"kubernetes.io/projected/cff75832-7a3f-405b-aba2-1531540110e4-kube-api-access-xsbqc\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:50:20.241669 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.241660    2560 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cff75832-7a3f-405b-aba2-1531540110e4-must-gather-output\") on node \"ip-10-0-143-229.ec2.internal\" DevicePath \"\""
May 26 15:50:20.831648 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.831619    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zjqkp_must-gather-w4cxn_cff75832-7a3f-405b-aba2-1531540110e4/copy/0.log"
May 26 15:50:20.832060 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.831923    2560 generic.go:358] "Generic (PLEG): container finished" podID="cff75832-7a3f-405b-aba2-1531540110e4" containerID="b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00" exitCode=143
May 26 15:50:20.832060 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.831981    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjqkp/must-gather-w4cxn"
May 26 15:50:20.832060 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.832024    2560 scope.go:117] "RemoveContainer" containerID="b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00"
May 26 15:50:20.835161 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.835128    2560 status_manager.go:895] "Failed to get status for pod" podUID="cff75832-7a3f-405b-aba2-1531540110e4" pod="openshift-must-gather-zjqkp/must-gather-w4cxn" err="pods \"must-gather-w4cxn\" is forbidden: User \"system:node:ip-10-0-143-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zjqkp\": no relationship found between node 'ip-10-0-143-229.ec2.internal' and this object"
May 26 15:50:20.838858 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.838823    2560 scope.go:117] "RemoveContainer" containerID="4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6"
May 26 15:50:20.842505 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.842482    2560 status_manager.go:895] "Failed to get status for pod" podUID="cff75832-7a3f-405b-aba2-1531540110e4" pod="openshift-must-gather-zjqkp/must-gather-w4cxn" err="pods \"must-gather-w4cxn\" is forbidden: User \"system:node:ip-10-0-143-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zjqkp\": no relationship found between node 'ip-10-0-143-229.ec2.internal' and this object"
May 26 15:50:20.850052 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.850028    2560 scope.go:117] "RemoveContainer" containerID="b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00"
May 26 15:50:20.850304 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:50:20.850283    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00\": container with ID starting with b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00 not found: ID does not exist" containerID="b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00"
May 26 15:50:20.850386 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.850317    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00"} err="failed to get container status \"b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00\": rpc error: code = NotFound desc = could not find container \"b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00\": container with ID starting with b8c304d8a95a808007c0ab1f97e9e213adbcd32363e1e139d82a5900d49bcf00 not found: ID does not exist"
May 26 15:50:20.850386 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.850344    2560 scope.go:117] "RemoveContainer" containerID="4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6"
May 26 15:50:20.850604 ip-10-0-143-229 kubenswrapper[2560]: E0526 15:50:20.850588    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6\": container with ID starting with 4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6 not found: ID does not exist" containerID="4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6"
May 26 15:50:20.850642 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:20.850611    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6"} err="failed to get container status \"4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6\": rpc error: code = NotFound desc = could not find container \"4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6\": container with ID starting with 4a96186c6b8612d6957c8924bd23197294bcebc38d3c3f442fb685e5c11539c6 not found: ID does not exist"
May 26 15:50:21.040645 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:21.040610    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cff75832-7a3f-405b-aba2-1531540110e4" path="/var/lib/kubelet/pods/cff75832-7a3f-405b-aba2-1531540110e4/volumes"
May 26 15:50:21.294214 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:21.294186    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-plwvl_4332f04c-9344-44ca-907c-49c1edbdd148/node-exporter/0.log"
May 26 15:50:21.322112 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:21.322074    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-plwvl_4332f04c-9344-44ca-907c-49c1edbdd148/kube-rbac-proxy/0.log"
May 26 15:50:21.351547 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:21.351521    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-plwvl_4332f04c-9344-44ca-907c-49c1edbdd148/init-textfile/0.log"
May 26 15:50:23.950200 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.950162    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"]
May 26 15:50:23.950684 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.950486    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff75832-7a3f-405b-aba2-1531540110e4" containerName="gather"
May 26 15:50:23.950684 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.950505    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff75832-7a3f-405b-aba2-1531540110e4" containerName="gather"
May 26 15:50:23.950684 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.950517    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff75832-7a3f-405b-aba2-1531540110e4" containerName="copy"
May 26 15:50:23.950684 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.950525    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff75832-7a3f-405b-aba2-1531540110e4" containerName="copy"
May 26 15:50:23.950684 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.950599    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="cff75832-7a3f-405b-aba2-1531540110e4" containerName="copy"
May 26 15:50:23.950684 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.950613    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="cff75832-7a3f-405b-aba2-1531540110e4" containerName="gather"
May 26 15:50:23.953921 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.953895    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:23.956990 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.956968    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ln6p\"/\"openshift-service-ca.crt\""
May 26 15:50:23.957119 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.957009    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8ln6p\"/\"default-dockercfg-s9jsb\""
May 26 15:50:23.958182 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.958168    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ln6p\"/\"kube-root-ca.crt\""
May 26 15:50:23.966360 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:23.966323    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"]
May 26 15:50:24.070276 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.070233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-sys\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.070276 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.070276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-proc\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.070566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.070305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-podres\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.070566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.070326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-lib-modules\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.070566 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.070358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzvsr\" (UniqueName: \"kubernetes.io/projected/69eb943e-bd14-45ee-b641-aae9be7807ce-kube-api-access-kzvsr\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.171618 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.171567    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-proc\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.171618 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.171624    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-podres\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.171875 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.171645    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-lib-modules\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.171875 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.171675    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzvsr\" (UniqueName: \"kubernetes.io/projected/69eb943e-bd14-45ee-b641-aae9be7807ce-kube-api-access-kzvsr\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.171875 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.171696    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-proc\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.171875 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.171721    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-sys\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.171875 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.171770    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-sys\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.171875 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.171824    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-podres\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.172072 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.171870    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69eb943e-bd14-45ee-b641-aae9be7807ce-lib-modules\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.182075 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.182047    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzvsr\" (UniqueName: \"kubernetes.io/projected/69eb943e-bd14-45ee-b641-aae9be7807ce-kube-api-access-kzvsr\") pod \"perf-node-gather-daemonset-nhrn4\" (UID: \"69eb943e-bd14-45ee-b641-aae9be7807ce\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.263468 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.263432    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.389341 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.389308    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"]
May 26 15:50:24.392590 ip-10-0-143-229 kubenswrapper[2560]: W0526 15:50:24.392544    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69eb943e_bd14_45ee_b641_aae9be7807ce.slice/crio-8484f388aadf67165e179df4850190afe95a53384d4b7efbbd836efd51d069c3 WatchSource:0}: Error finding container 8484f388aadf67165e179df4850190afe95a53384d4b7efbbd836efd51d069c3: Status 404 returned error can't find the container with id 8484f388aadf67165e179df4850190afe95a53384d4b7efbbd836efd51d069c3
May 26 15:50:24.846772 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.846736    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4" event={"ID":"69eb943e-bd14-45ee-b641-aae9be7807ce","Type":"ContainerStarted","Data":"e37400ccd3e3c6b7ccb36ed5c719d76bbc938eac4ebaff0dbbaba765e702c572"}
May 26 15:50:24.846772 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.846775    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4" event={"ID":"69eb943e-bd14-45ee-b641-aae9be7807ce","Type":"ContainerStarted","Data":"8484f388aadf67165e179df4850190afe95a53384d4b7efbbd836efd51d069c3"}
May 26 15:50:24.847025 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.846879    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:24.872513 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:24.872464    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4" podStartSLOduration=1.872449602 podStartE2EDuration="1.872449602s" podCreationTimestamp="2026-05-26 15:50:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:50:24.8723057 +0000 UTC m=+1776.444473345" watchObservedRunningTime="2026-05-26 15:50:24.872449602 +0000 UTC m=+1776.444617244"
May 26 15:50:25.097220 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:25.097138    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njcdt_6dc65a42-c872-477d-a3db-545e2aec595e/dns/0.log"
May 26 15:50:25.121545 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:25.121506    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njcdt_6dc65a42-c872-477d-a3db-545e2aec595e/kube-rbac-proxy/0.log"
May 26 15:50:25.175159 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:25.175130    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-np6z6_27b43a61-5dab-42a0-a314-b81bc799dc6c/dns-node-resolver/0.log"
May 26 15:50:25.675328 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:25.675280    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqx9q_a0ee8ee6-c760-45d0-a193-aebac77e849a/node-ca/0.log"
May 26 15:50:26.812428 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:26.812397    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wzgkw_333fca6e-6577-47a0-a322-7e4c8046f987/serve-healthcheck-canary/0.log"
May 26 15:50:27.342525 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:27.342499    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpd9p_05b08468-114e-4c4d-84a1-e8185bbb767c/kube-rbac-proxy/0.log"
May 26 15:50:27.366216 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:27.366183    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpd9p_05b08468-114e-4c4d-84a1-e8185bbb767c/exporter/0.log"
May 26 15:50:27.388739 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:27.388711    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpd9p_05b08468-114e-4c4d-84a1-e8185bbb767c/extractor/0.log"
May 26 15:50:30.859473 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:30.859379    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-nhrn4"
May 26 15:50:33.058947 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.058867    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bjn_ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd/kube-multus-additional-cni-plugins/0.log"
May 26 15:50:33.094775 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.094742    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bjn_ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd/egress-router-binary-copy/0.log"
May 26 15:50:33.129632 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.129600    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bjn_ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd/cni-plugins/0.log"
May 26 15:50:33.162502 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.162467    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bjn_ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd/bond-cni-plugin/0.log"
May 26 15:50:33.195000 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.194974    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bjn_ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd/routeoverride-cni/0.log"
May 26 15:50:33.218958 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.218932    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bjn_ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd/whereabouts-cni-bincopy/0.log"
May 26 15:50:33.241091 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.241062    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5bjn_ebcd8d06-f1a6-4bb4-8fe0-99e943ef05dd/whereabouts-cni/0.log"
May 26 15:50:33.640409 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.640306    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d7j8m_0dfa6c5c-07c4-4096-b8ce-41cdb17074e9/kube-multus/0.log"
May 26 15:50:33.805640 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.805615    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ljhrb_ce8c0661-c426-4f51-97de-709e4d46b664/network-metrics-daemon/0.log"
May 26 15:50:33.830256 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:33.830225    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ljhrb_ce8c0661-c426-4f51-97de-709e4d46b664/kube-rbac-proxy/0.log"
May 26 15:50:34.585477 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:34.585395    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmh8_52061267-92fd-4dfa-bb08-75bc2c9d420f/ovn-controller/0.log"
May 26 15:50:34.621277 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:34.621213    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmh8_52061267-92fd-4dfa-bb08-75bc2c9d420f/ovn-acl-logging/0.log"
May 26 15:50:34.648851 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:34.648825    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmh8_52061267-92fd-4dfa-bb08-75bc2c9d420f/kube-rbac-proxy-node/0.log"
May 26 15:50:34.673258 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:34.673223    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmh8_52061267-92fd-4dfa-bb08-75bc2c9d420f/kube-rbac-proxy-ovn-metrics/0.log"
May 26 15:50:34.690918 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:34.690894    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmh8_52061267-92fd-4dfa-bb08-75bc2c9d420f/northd/0.log"
May 26 15:50:34.726513 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:34.726487    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmh8_52061267-92fd-4dfa-bb08-75bc2c9d420f/nbdb/0.log"
May 26 15:50:34.779895 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:34.779867    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmh8_52061267-92fd-4dfa-bb08-75bc2c9d420f/sbdb/0.log"
May 26 15:50:34.958705 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:34.958672    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmh8_52061267-92fd-4dfa-bb08-75bc2c9d420f/ovnkube-controller/0.log"
May 26 15:50:36.591364 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:36.591301    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-d7kpv_f5be5ddd-c88e-4659-bdbe-727479d61265/network-check-target-container/0.log"
May 26 15:50:37.561538 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:37.561504    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-fdx4j_249e20cb-bbe1-4d3d-afe8-0e339b0f8537/iptables-alerter/0.log"
May 26 15:50:38.199232 ip-10-0-143-229 kubenswrapper[2560]: I0526 15:50:38.199202    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-pdgxn_131b6fdd-2f70-4c4a-a552-dfe6aabf8c9f/tuned/0.log"